Nov 04 02:15:29.527858 ip-10-0-131-226 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 02:15:29.982299 ip-10-0-131-226 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:15:29.982299 ip-10-0-131-226 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 02:15:29.982299 ip-10-0-131-226 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:15:29.982299 ip-10-0-131-226 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:15:29.987365 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987294    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:29.987365 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987362    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:29.987365 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987365    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:29.987365 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987368    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:29.987365 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987371    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987373    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987377    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987379    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987382    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987385    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987387    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987390    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987392    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987395    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987397    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987400    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987402    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987405    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987407    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987410    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987412    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987415    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987417    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987419    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:29.987541 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987422    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987425    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987427    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987430    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987432    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987435    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987443    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987446    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987448    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987450    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987453    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987455    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987458    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987460    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987464    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987468    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987472    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987475    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987478    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987481    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:29.988007 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987483    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987486    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987488    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987491    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987493    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987496    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987505    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987507    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987510    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987512    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987515    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987517    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987520    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987522    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987524    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987527    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987529    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987532    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987536    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:29.988460 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987540    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987543    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987546    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987549    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987552    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987555    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987557    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987561    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987564    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987567    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987570    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987572    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987575    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987578    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987581    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987583    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987585    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987588    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987590    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:29.988910 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987611    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987622    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987625    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987627    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987630    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987633    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987636    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987638    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987641    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987643    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987646    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987649    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987651    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987654    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987656    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987659    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987661    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987664    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987667    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:29.989367 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987669    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987672    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987675    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987677    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.987680    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988441    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988449    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988454    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988458    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988461    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988465    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988468    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988471    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988473    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988476    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988479    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988482    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988484    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988488    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:29.989840 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988492    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988495    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988498    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988500    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988503    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988506    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988508    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988510    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988513    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988515    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988517    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988520    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988523    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988525    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988528    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988531    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988534    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988536    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988539    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:29.990304 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988542    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988544    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988546    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988549    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988551    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988554    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988556    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988559    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988561    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988563    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988567    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988569    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988572    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988575    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988577    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988580    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988582    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988585    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988587    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988589    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:29.990766 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988610    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988614    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988617    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988619    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988624    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988627    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988629    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988632    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988635    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988637    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988640    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988643    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988645    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988648    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988650    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988652    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988655    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988657    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988660    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988662    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:29.991260 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988665    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988667    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988670    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988673    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988675    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988678    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988680    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988683    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988686    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988688    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988690    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988693    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988696    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988698    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988701    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988703    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988707    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988709    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988713    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:29.991728 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988715    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988718    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988720    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988723    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988725    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988728    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988730    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988733    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988735    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988738    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988740    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988743    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988745    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.988747    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989205    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989210    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989214    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989219    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989222    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:29.992162 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989225    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989228    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989230    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989233    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989235    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989238    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989241    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989243    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989246    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989249    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989253    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989256    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989258    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989261    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989264    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989266    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989269    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989271    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989274    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989276    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:29.992587 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989279    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989282    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989284    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989286    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989289    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989291    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989294    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989296    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989298    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989301    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989304    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989307    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989309    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989312    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989314    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989318    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989321    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989323    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989326    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989328    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:29.993070 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989330    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989333    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989337    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989339    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989342    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989344    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989347    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989349    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989352    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989354    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989356    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989359    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989361    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989364    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989367    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989369    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989372    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989374    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989377    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:29.993518 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989380    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989382    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989384    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989387    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989390    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989392    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989395    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989399    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989404    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989407    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989409    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989412    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989415    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989417    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989419    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989423    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989425    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989427    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989430    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:29.993979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989432    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989435    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989437    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989440    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989442    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989444    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989447    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989449    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989452    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989454    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989456    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989459    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989461    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989464    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989466    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989468    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989472    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989474    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989477    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:29.994395 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989480    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989482    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989485    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.989487    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989583    2578 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989590    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989611    2578 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989616    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989620    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989623    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989627    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989632    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989635    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989638    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989642    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989645    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989648    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989651    2578 flags.go:64] FLAG: --cgroup-root=""
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989654    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989657    2578 flags.go:64] FLAG: --client-ca-file=""
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989659    2578 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989662    2578 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989667    2578 flags.go:64] FLAG: --cluster-domain=""
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989670    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 02:15:29.994877 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989673    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989676    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989679    2578 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989687    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989690    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989693    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989696    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989700    2578 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989703    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989706    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989710    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989712    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989717    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989719    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989722    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989725    2578 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989728    2578 flags.go:64] FLAG: --enable-server="true"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989731    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989735    2578 flags.go:64] FLAG: --event-burst="100"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989737    2578 flags.go:64] FLAG: --event-qps="50"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989740    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989743    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989746    2578 flags.go:64] FLAG: --eviction-hard=""
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989750    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 02:15:29.995423 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989752    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989755    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989758    2578 flags.go:64] FLAG: --eviction-soft=""
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989761    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989764    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989766    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989769    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989772    2578 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989775    2578 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989777    2578 flags.go:64] FLAG: --feature-gates=""
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989781    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989784    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989787    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989790    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989793    2578 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989795    2578 flags.go:64] FLAG: --help="false"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989798    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989802    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989805    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989807    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989810    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989814    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989816    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 02:15:29.996022 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989819    2578 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989822    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989825    2578 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989828    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989831    2578 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989833    2578 flags.go:64] FLAG: --kube-reserved=""
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989836    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989839    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989842    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989844    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989847    2578 flags.go:64] FLAG: --lock-file=""
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989850    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989853    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989856    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989861    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989864    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989867    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989870    2578 flags.go:64] FLAG: --logging-format="text"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989872    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989876    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989878    2578 flags.go:64] FLAG: --manifest-url=""
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989881    2578 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989885    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989888    2578 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989891    2578 flags.go:64] FLAG: --max-pods="110"
Nov 04 02:15:29.996550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989894    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989897    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989902    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989905    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989908    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989911    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989914    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989921    2578 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989925    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989928    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989931    2578 flags.go:64] FLAG: --pod-cidr=""
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989933    2578 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989936    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989939    2578 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989942    2578 flags.go:64] FLAG: --port="10250"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989945    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989948    2578 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0baaa5466bdb98294"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989951    2578 flags.go:64] FLAG: --qos-reserved=""
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989954    2578 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989956    2578 flags.go:64] FLAG: --register-node="true"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989959    2578 flags.go:64] FLAG: --register-with-taints=""
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989963    2578 flags.go:64] FLAG: --registry-burst="10"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989966    2578 flags.go:64] FLAG: --registry-qps="5"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989969    2578 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989971    2578 flags.go:64] FLAG: --reserved-memory=""
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989975    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 02:15:29.997132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989978    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989981    2578 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989983    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989986    2578 flags.go:64] FLAG: --runonce="false"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989989    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989992    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989995    2578 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.989998    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990003    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990010    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990013    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990016    2578 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990019    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990023    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990026    2578 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990029    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990032    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990035    2578 flags.go:64] FLAG: --system-cgroups=""
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990038    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990043    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990046    2578 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990049    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990060    2578 flags.go:64] FLAG: --tls-min-version=""
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990063    2578 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990065    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 02:15:29.997742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990068    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990071    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990074    2578 flags.go:64] FLAG: --v="2"
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990082    2578 flags.go:64] FLAG: --version="false"
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990086    2578 flags.go:64] FLAG: --vmodule=""
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990090    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990093    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990211    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990214    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990217    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990219    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990222    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990224    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990227    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990229    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990234    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990237    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990245    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990248    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990251    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990254    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:29.998316 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990257    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990260    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990262    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990265    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990267    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990270    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990272    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990275    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990277    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990280    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990283    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990286    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990289    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990292    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990294    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990296    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990299    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990301    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990304    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:29.998809 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990307    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990309    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990312    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990315    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990317    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990320    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990323    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990326    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990329    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990331    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990342    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990345    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990349    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990352    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990354    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990357    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990359    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990362    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990364    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990367    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:29.999247 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990369    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990372    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990374    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990377    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990379    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990382    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990384    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990386    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990389    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990392    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990394    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990396    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990399    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990401    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990404    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990406    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990409    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990411    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990414    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990417    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:29.999738 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990420    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990422    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990425    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990428    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990433    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990435    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990438    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990440    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990443    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990445    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990448    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990451    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990453    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990456    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990458    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990461    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990463    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990466    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990468    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:30.000211 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990471    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990473    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990476    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990478    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990481    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990483    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990487    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990491    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990494    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990497    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990499    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990502    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990506    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990508    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.990533    2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:15:30.000675 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990576    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990581    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990588    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990605    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990610    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990612    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990615    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990618    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990621    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990624    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990626    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990630    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990634    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990637    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990640    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990643    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990646    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990648    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990651    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:30.001051 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990653    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990656    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990658    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990661    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990663    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990666    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990668    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990671    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990673    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990676    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990678    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990682    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990685    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990687    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990690    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990693    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990702    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990705    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990707    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990710    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:30.001475 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990712    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990715    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990717    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990719    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990723    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990726    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990729    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990731    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990734    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990736    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990739    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990741    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990744    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990746    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990749    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990751    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990754    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990756    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990759    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990762    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:30.001951 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990764    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990767    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990769    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990773    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990776    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990779    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990781    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990785    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990787    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990791    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990793    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990795    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990798    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990800    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990803    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990805    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990808    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990810    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990813    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990815    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:30.002454 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990818    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990820    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990822    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990825    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990827    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990830    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990832    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990835    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990838    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990840    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990842    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990845    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990848    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990850    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990852    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990856    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990858    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990861    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990863    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990867    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:30.002933 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990870    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990873    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990876    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990879    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990881    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990891    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.990894    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.997459    2578 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.997473    2578 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.997484    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.997488    2578 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997547    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997552    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997556    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997559    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997562    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997565    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997568    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997570    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:30.003400 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997573    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997576    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997578    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997581    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997584    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997586    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997589    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997591    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997610    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997613    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997616    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997619    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997621    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997624    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997627    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997629    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997632    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997635    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997638    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:30.003864 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997642    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997645    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997650    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997653    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997656    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997658    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997661    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997663    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997666    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997668    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997671    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997674    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997676    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997679    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997681    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997683    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997686    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997689    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997691    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997693    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:30.004289 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997696    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997699    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997701    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997704    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997706    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997708    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997711    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997713    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997716    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997718    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997721    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997723    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997726    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997728    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997731    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997736    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997740    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997744    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997747    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:30.004800 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997749    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997752    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997755    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997758    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997760    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997763    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997766    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997768    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997771    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997773    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997776    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997778    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997781    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997784    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997786    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997789    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997791    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997794    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997796    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:30.005265 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997799    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997801    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997804    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997806    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997809    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997811    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997814    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997817    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997820    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997822    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997825    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997828    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997831    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997833    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997835    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997838    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997841    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997843    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997845    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997848    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:30.005708 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.997850    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.997876    2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998011    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998016    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998019    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998022    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998024    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998026    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998029    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998031    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998034    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998036    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998038    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998041    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998043    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998045    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:30.006174 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998048    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998051    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998053    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998055    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998058    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998062    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998066    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998072    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998075    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998078    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998080    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998083    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998086    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998088    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998090    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998093    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998096    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998098    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998101    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:30.006528 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998103    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998105    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998108    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998110    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998113    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998115    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998119    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998122    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998125    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998128    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998131    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998134    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998136    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998139    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998142    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998144    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998147    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998149    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998152    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:30.006979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998155    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998157    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998160    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998163    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998165    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998167    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998170    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998172    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998175    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998178    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998180    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998182    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998185    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998187    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998189    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998192    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998194    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998196    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998199    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:30.007399 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998201    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998204    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998206    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998209    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998211    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998213    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998216    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998218    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998221    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998223    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998226    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998228    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998231    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998233    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998235    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998238    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998241    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998243    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998246    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998248    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:30.007841 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998250    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998253    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998256    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998258    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998261    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998263    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998266    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998268    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998271    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998273    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998275    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998278    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998280    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998283    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998285    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.998306    2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:15:30.008286 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998336    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998340    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998342    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998346    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998348    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998351    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998354    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998357    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998359    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998361    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998364    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998366    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998369    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998372    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998374    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998377    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998379    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998382    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998384    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:30.008866 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998387    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998389    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998392    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998394    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998397    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998399    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998401    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998404    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998406    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998409    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998411    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998414    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998416    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998420    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998423    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998425    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998428    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998431    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998433    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:30.009533 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998436    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998438    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998441    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998443    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998446    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998448    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998450    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998453    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998456    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998458    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998461    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998463    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998466    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998468    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998472    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998475    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998479    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998482    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998484    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:30.010117 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998487    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998489    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998491    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998494    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998496    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998499    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998501    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998504    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998506    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998509    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998511    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998514    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998516    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998519    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998521    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998524    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998526    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998529    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998531    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998533    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:30.010564 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998536    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998538    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998542    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998544    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998547    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998549    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998552    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998554    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998557    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998559    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998561    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998564    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998566    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998568    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998571    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998573    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998575    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998578    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998580    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998583    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:30.011044 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998585    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998587    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998590    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998605    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998609    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998611    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998614    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998616    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:29.998619    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:29.998670    2578 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.002227    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.003225    2578 server.go:1014] "Starting client certificate rotation"
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.003330    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.004289    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.005372    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 02:15:30.011496 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.009995    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 02:15:30.023896 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.023877    2578 log.go:25] "Validated CRI v1 runtime API"
Nov 04 02:15:30.027479 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.027465    2578 log.go:25] "Validated CRI v1 image API"
Nov 04 02:15:30.028233 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.028210    2578 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 02:15:30.033547 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.033529    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 81455663-25c4-44d9-adf0-c91a694138cf:/dev/nvme0n1p3 cf823ccc-8f6a-4574-87db-73aa322c05e5:/dev/nvme0n1p4]
Nov 04 02:15:30.033624 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.033547    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 04 02:15:30.039179 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.039075    2578 manager.go:217] Machine: {Timestamp:2026-11-04 02:15:30.037557478 +0000 UTC m=+0.380850939 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3198226 MemoryCapacity:33164328960 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20bba444c13354a26fc8a076ea5081 SystemUUID:ec20bba4-44c1-3354-a26f-c8a076ea5081 BootID:be23f68d-728e-41ae-b560-1ff73e249624 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:d3:de:98:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:d3:de:98:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:61:1d:1d:7e:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164328960 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 02:15:30.039179 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.039175    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 02:15:30.039296 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.039244    2578 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 02:15:30.041886 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.041863    2578 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 02:15:30.042014 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.041887    2578 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-226.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 02:15:30.043162 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.043152    2578 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 02:15:30.043201 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.043164    2578 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 02:15:30.043201 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.043177    2578 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 02:15:30.043201 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.043187    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 02:15:30.044125 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.044116    2578 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 02:15:30.049935 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.049923    2578 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 02:15:30.050043 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.050034    2578 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 02:15:30.050870 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.050861    2578 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 02:15:30.050930 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.050874    2578 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 02:15:30.050930 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.050894    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 02:15:30.050930 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.050902    2578 kubelet.go:405] "Adding apiserver pod source"
Nov 04 02:15:30.050930 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.050913    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 02:15:30.051215 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.051201    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 02:15:30.053433 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.053417    2578 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 02:15:30.059289 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.059276    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 02:15:30.060550 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.060538    2578 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 02:15:30.060590 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.060568    2578 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 02:15:30.060733 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.060723    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 02:15:30.060760 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.060737    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 02:15:30.060760 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.060743    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 02:15:30.060760 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.060749    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 02:15:30.060760 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.060753    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 02:15:30.060760 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.060759    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 02:15:30.061507 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.061499    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 02:15:30.061534 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.061508    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 02:15:30.061534 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.061515    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 02:15:30.061534 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.061520    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 02:15:30.061534 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.061534    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 02:15:30.061744 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.061542    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 02:15:30.063181 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.063170    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 02:15:30.063215 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.063184    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 02:15:30.067247 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.067229    2578 server.go:1263] "Started kubelet"
Nov 04 02:15:30.067347 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.067294    2578 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 02:15:30.067399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.067332    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 02:15:30.067446 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.067409    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 02:15:30.067872 ip-10-0-131-226 systemd[1]: Started Kubernetes Kubelet.
Nov 04 02:15:30.074698 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.074667    2578 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 02:15:30.076071 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.076054    2578 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 02:15:30.082258 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.082240    2578 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 02:15:30.082258 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.082249    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 02:15:30.082381 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.082320    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:15:30.082972 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.082952    2578 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 02:15:30.082972 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.082973    2578 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 02:15:30.083111 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.083064    2578 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 02:15:30.083111 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.083069    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 02:15:30.083111 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.083076    2578 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 02:15:30.083267 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.083251    2578 factory.go:55] Registering systemd factory
Nov 04 02:15:30.083267 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.083269    2578 factory.go:223] Registration of the systemd container factory successfully
Nov 04 02:15:30.083401 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.083274    2578 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 04 02:15:30.083478 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.083467    2578 factory.go:153] Registering CRI-O factory
Nov 04 02:15:30.083517 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.083479    2578 factory.go:223] Registration of the crio container factory successfully
Nov 04 02:15:30.083517 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.083514    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 02:15:30.083577 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.083527    2578 factory.go:103] Registering Raw factory
Nov 04 02:15:30.083577 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.083537    2578 manager.go:1199] Started watching for new ooms in manager
Nov 04 02:15:30.084409 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.084398    2578 manager.go:319] Starting recovery of all containers
Nov 04 02:15:30.092994 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.092977    2578 manager.go:324] Recovery completed
Nov 04 02:15:30.097484 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.097471    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:30.099249 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.099234    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:30.099308 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.099262    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:30.099308 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.099273    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:30.099826 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.099814    2578 cpu_manager.go:226] "Starting" policy="none"
Nov 04 02:15:30.099883 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.099825    2578 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 02:15:30.099883 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.099840    2578 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 02:15:30.099883 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.099820    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:30.100476 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.100461    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:30.100539 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.100483    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:30.100539 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.100494    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:30.101385 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.101375    2578 policy_none.go:50] "Start"
Nov 04 02:15:30.101435 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.101389    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 02:15:30.101435 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.101399    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 02:15:30.102652 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.102642    2578 policy_none.go:44] "Start"
Nov 04 02:15:30.143148 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.143116    2578 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 02:15:30.145352 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.145335    2578 manager.go:341] "Starting Device Plugin manager"
Nov 04 02:15:30.145409 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.145367    2578 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 02:15:30.145409 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.145375    2578 server.go:87] "Starting device plugin registration server"
Nov 04 02:15:30.145633 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.145620    2578 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 02:15:30.145802 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.145636    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 02:15:30.145802 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.145765    2578 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 02:15:30.146001 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.145855    2578 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 02:15:30.146001 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.145862    2578 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 02:15:30.146248 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.146183    2578 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 02:15:30.146248 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.146231    2578 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:15:30.211723 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.211701    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 02:15:30.213060 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.212805    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 02:15:30.213060 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.212869    2578 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 02:15:30.213060 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.212892    2578 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 02:15:30.213060 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.212931    2578 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 04 02:15:30.217398 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.217373    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-226.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 04 02:15:30.218445 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.217363    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-226.us-west-2.compute.internal.18e4b5e11d7b7f23  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-226.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-226.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 02:15:30.067201827 +0000 UTC m=+0.410495288,LastTimestamp:2026-11-04 02:15:30.067201827 +0000 UTC m=+0.410495288,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-226.us-west-2.compute.internal,}"
Nov 04 02:15:30.246014 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.245957    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:30.246683 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.246668    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:30.246751 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.246694    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:30.246751 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.246707    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:30.246751 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.246736    2578 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.267701 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.267545    2578 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-226.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 04 02:15:30.313608 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.313574    2578 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"]
Nov 04 02:15:30.313692 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.313662    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:30.314955 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.314940    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:30.315026 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.314969    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:30.315026 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.314984    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:30.316455 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.316443    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:30.316646 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.316627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.316689 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.316663    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:30.317223 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.317208    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:30.317267 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.317237    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:30.317267 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.317248    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:30.317332 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.317210    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:30.317332 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.317313    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:30.317332 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.317327    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:30.318722 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.318706    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.318780 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.318736    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:30.319477 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.319461    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:30.319537 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.319492    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:30.319537 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.319508    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:30.344717 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.344697    2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found" node="ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.347644 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.347629    2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found" node="ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.350967 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.350950    2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 02:15:30.351044 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.351025    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dg8j5"
Nov 04 02:15:30.377815 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.377789    2578 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Nov 04 02:15:30.377815 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.377793    2578 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Nov 04 02:15:30.377965 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.377823    2578 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-226.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Nov 04 02:15:30.378015 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.377897    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-226.us-west-2.compute.internal.18e4b5e11f648499  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-226.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-226.us-west-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-226.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 02:15:30.099250329 +0000 UTC m=+0.442543790,LastTimestamp:2026-11-04 02:15:30.099250329 +0000 UTC m=+0.442543790,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-226.us-west-2.compute.internal,}"
Nov 04 02:15:30.384846 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.384829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e10f4f4a83a7a5f20f55bc800c3b250b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"e10f4f4a83a7a5f20f55bc800c3b250b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.384917 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.384853    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e10f4f4a83a7a5f20f55bc800c3b250b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"e10f4f4a83a7a5f20f55bc800c3b250b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.384917 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.384872    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68f285f0cd89b6c329b3b82af5b728f4-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"68f285f0cd89b6c329b3b82af5b728f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.485879 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.485859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e10f4f4a83a7a5f20f55bc800c3b250b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"e10f4f4a83a7a5f20f55bc800c3b250b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.485970 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.485883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e10f4f4a83a7a5f20f55bc800c3b250b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"e10f4f4a83a7a5f20f55bc800c3b250b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.485970 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.485900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68f285f0cd89b6c329b3b82af5b728f4-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"68f285f0cd89b6c329b3b82af5b728f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.485970 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.485942    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68f285f0cd89b6c329b3b82af5b728f4-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"68f285f0cd89b6c329b3b82af5b728f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.485970 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.485964    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e10f4f4a83a7a5f20f55bc800c3b250b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"e10f4f4a83a7a5f20f55bc800c3b250b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.486106 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.485973    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e10f4f4a83a7a5f20f55bc800c3b250b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"e10f4f4a83a7a5f20f55bc800c3b250b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.541765 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.541698    2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:30.542307 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.542287    2578 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-131-226.us-west-2.compute.internal\" not found" node="ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.596215 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.596188    2578 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-226.us-west-2.compute.internal\" not found" node="ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.648139 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.648111    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.652972 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.652556    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.742850 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.742827    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:30.743828 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.743811    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:30.743918 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.743841    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:30.743918 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.743854    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:30.743918 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.743882    2578 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.804893 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:30.804836    2578 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:30.804893 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.804863    2578 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-226.us-west-2.compute.internal\": node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:15:30.934040 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:30.934013    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:15:31.002935 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.002902    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 04 02:15:31.003451 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.003101    2578 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 02:15:31.003451 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:31.003099    2578 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a002968538e68413697f26034184b0ae-7fcf7513c18704a7.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-131-226.us-west-2.compute.internal.18e4b5e11f648499\": read tcp 10.0.131.226:40926->16.58.110.229:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-131-226.us-west-2.compute.internal.18e4b5e11f648499  default   5242 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-226.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-226.us-west-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-226.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 02:15:30 +0000 UTC,LastTimestamp:2026-11-04 02:15:30.246681167 +0000 UTC m=+0.589974629,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-226.us-west-2.compute.internal,}"
Nov 04 02:15:31.035666 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:31.035638    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:15:31.138570 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:31.138503    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:15:31.239540 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:31.239497    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:15:31.340344 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:31.340310    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:15:31.350164 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.350142    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:31.351065 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.351045    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:31.351170 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.351074    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:31.351170 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.351084    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:31.356408 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.356374    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 02:10:30 +0000 UTC" deadline="2028-07-15 20:09:46.979328172 +0000 UTC"
Nov 04 02:15:31.356463 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.356409    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14873h54m15.622923406s"
Nov 04 02:15:31.393951 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.393896    2578 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:31.442157 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:31.442124    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:15:31.542831 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:31.542805    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:15:31.644029 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:31.643964    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:15:31.745066 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:31.745037    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:15:31.766246 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.766220    2578 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:31.783398 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.783375    2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:31.849261 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.849240    2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:15:31.851295 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.851278    2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:15:31.876386 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:31.876359    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10f4f4a83a7a5f20f55bc800c3b250b.slice/crio-c7a760bcd4881f8bf9bf1453c6ebf69beef396e21624d4276a2f2396150b7914 WatchSource:0}: Error finding container c7a760bcd4881f8bf9bf1453c6ebf69beef396e21624d4276a2f2396150b7914: Status 404 returned error can't find the container with id c7a760bcd4881f8bf9bf1453c6ebf69beef396e21624d4276a2f2396150b7914
Nov 04 02:15:31.876891 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:31.876870    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f285f0cd89b6c329b3b82af5b728f4.slice/crio-bfbc9be40a84196258f25527d271e2b54144b6e7a9191d48158b17f3a781952d WatchSource:0}: Error finding container bfbc9be40a84196258f25527d271e2b54144b6e7a9191d48158b17f3a781952d: Status 404 returned error can't find the container with id bfbc9be40a84196258f25527d271e2b54144b6e7a9191d48158b17f3a781952d
Nov 04 02:15:31.884629 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.884594    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:15:31.914083 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.914038    2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:15:31.981428 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:31.981408    2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:32.052981 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.052964    2578 apiserver.go:52] "Watching apiserver"
Nov 04 02:15:32.056089 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.056074    2578 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:32.083349 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.083327    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 04 02:15:32.165697 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.165651    2578 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 02:15:32.165958 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.165940    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-96gx5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk","openshift-dns/node-resolver-42xbt","openshift-image-registry/node-ca-4628r","openshift-cluster-node-tuning-operator/tuned-c72gg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal","openshift-multus/multus-additional-cni-plugins-qchvs","openshift-ovn-kubernetes/ovnkube-node-2cfx8","kube-system/global-pull-secret-syncer-msgpp","kube-system/konnectivity-agent-n9lpj","openshift-multus/multus-cq8lx","openshift-multus/network-metrics-daemon-4fs2v","openshift-network-diagnostics/network-check-target-qnrfj","kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"]
Nov 04 02:15:32.169798 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.169781    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.172009 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.171989    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:32.172085 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.172062    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:32.174134 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.174114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:15:32.176295 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.176272    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:15:32.178655 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.178635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.181960 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.181852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.184278 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.184260    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:32.184369 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.184335    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:32.186634 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.186618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:15:32.189536 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.189516    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.191890 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.191873    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:15:32.194723 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.194707    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.195609 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.195580    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrrsx\" (UniqueName: \"kubernetes.io/projected/07e5822b-f9ff-4da7-9b1b-691bed7af623-kube-api-access-zrrsx\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.195733 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.195628    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysconfig\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.195662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-kubernetes\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.195889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovnkube-config\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.195919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovnkube-script-lib\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.195951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-dbus\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.195980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-host\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58ngg\" (UniqueName: \"kubernetes.io/projected/5401a6e8-141f-4823-b57f-aca208b89c7a-kube-api-access-58ngg\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvfgz\" (UniqueName: \"kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz\") pod \"network-check-target-qnrfj\" (UID: \"f54eb55a-276b-4d34-8190-ec19c6fe20fc\") " pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196124    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5819bbef-1a67-4bb3-b35c-2b8409d463a1-tmp-dir\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8wxq\" (UniqueName: \"kubernetes.io/projected/3ea825ae-6a0c-4858-89f7-4b992e555347-kube-api-access-x8wxq\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-cni-binary-copy\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-cni-bin\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196291    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-run\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196322    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-tuned\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.197399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196354    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-systemd-units\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-run-netns\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-systemd\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-env-overrides\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pth8s\" (UniqueName: \"kubernetes.io/projected/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-kube-api-access-pth8s\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196499    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-kubelet-config\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196528    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ls7h\" (UniqueName: \"kubernetes.io/projected/5819bbef-1a67-4bb3-b35c-2b8409d463a1-kube-api-access-5ls7h\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysctl-d\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196581    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysctl-conf\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovn-node-metrics-cert\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196642    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ea825ae-6a0c-4858-89f7-4b992e555347-serviceca\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-cnibin\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-modprobe-d\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-var-lib-kubelet\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.199292 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-kubelet\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196895    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-slash\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ea825ae-6a0c-4858-89f7-4b992e555347-host\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-system-cni-dir\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.196979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-lib-modules\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197013    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5401a6e8-141f-4823-b57f-aca208b89c7a-tmp\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-var-lib-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-ovn\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197203    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5819bbef-1a67-4bb3-b35c-2b8409d463a1-hosts-file\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-systemd\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197258    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-sys\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197290    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-etc-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-node-log\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-log-socket\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.199764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-cni-netd\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.200225 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.200225 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.197931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:32.200225 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.198001    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:32.216815 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.216775    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal" event={"ID":"68f285f0cd89b6c329b3b82af5b728f4","Type":"ContainerStarted","Data":"bfbc9be40a84196258f25527d271e2b54144b6e7a9191d48158b17f3a781952d"}
Nov 04 02:15:32.217935 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.217914    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal" event={"ID":"e10f4f4a83a7a5f20f55bc800c3b250b","Type":"ContainerStarted","Data":"c7a760bcd4881f8bf9bf1453c6ebf69beef396e21624d4276a2f2396150b7914"}
Nov 04 02:15:32.227633 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.227408    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 02:15:32.227633 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.227414    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 02:15:32.227633 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.227427    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 02:15:32.227633 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.227442    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 02:15:32.227633 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.227469    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 02:15:32.227633 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.227448    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zjj5c\""
Nov 04 02:15:32.230853 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.230836    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 02:15:32.230950 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.230931    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 02:15:32.230991 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.230959    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6q9ld\""
Nov 04 02:15:32.233204 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.233190    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 02:15:32.233272 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.233222    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-px2wd\""
Nov 04 02:15:32.233272 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.233229    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 02:15:32.233272 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.233223    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 02:15:32.235485 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.235469    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zrn9f\""
Nov 04 02:15:32.235533 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.235514    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:15:32.235567 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.235533    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 02:15:32.238624 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.238601    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 02:15:32.239179 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.239167    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 02:15:32.239263 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.239252    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 02:15:32.239307 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.239270    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 02:15:32.239430 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.239418    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wpmk6\""
Nov 04 02:15:32.278203 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.278183    2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 02:15:32.278287 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.278229    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ltm5j"
Nov 04 02:15:32.284193 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.284168    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 02:15:32.298057 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-host\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.298117 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.298117 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91cad462-1ef8-4bf5-aeca-92005dbf5393-host-slash\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:15:32.298117 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298094    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-host\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.298117 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-socket-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.298289 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298178    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.298289 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-cni-bin\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.298289 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5819bbef-1a67-4bb3-b35c-2b8409d463a1-tmp-dir\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:15:32.298396 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-run\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.298396 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-systemd\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.298396 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298348    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-env-overrides\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.298561 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298389    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-systemd\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.298561 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pth8s\" (UniqueName: \"kubernetes.io/projected/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-kube-api-access-pth8s\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.298561 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298452    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-run\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.298561 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298471    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5819bbef-1a67-4bb3-b35c-2b8409d463a1-tmp-dir\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:15:32.298561 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-kubelet-config\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:32.298561 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-daemon-config\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.298561 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298574    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ls7h\" (UniqueName: \"kubernetes.io/projected/5819bbef-1a67-4bb3-b35c-2b8409d463a1-kube-api-access-5ls7h\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298631    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-kubelet-config\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91cad462-1ef8-4bf5-aeca-92005dbf5393-iptables-alerter-script\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-sys-fs\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298745    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ea825ae-6a0c-4858-89f7-4b992e555347-serviceca\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-cnibin\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298788    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-env-overrides\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-modprobe-d\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298799    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-cnibin\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-var-lib-kubelet\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298892    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-modprobe-d\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298899    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-var-lib-kubelet\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-k8s-cni-cncf-io\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298918    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.298939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298935    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-lib-modules\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-var-lib-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.298993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-ovn\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299040    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-var-lib-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-system-cni-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299096    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-lib-modules\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-cni-multus\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299110    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-ovn\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-systemd\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299130    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ea825ae-6a0c-4858-89f7-4b992e555347-serviceca\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299151    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-etc-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299194    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-systemd\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299217    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-etc-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299221    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-node-log\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299238    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-node-log\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-cni-netd\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.299498 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299258    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-cni-netd\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovnkube-config\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl2xj\" (UniqueName: \"kubernetes.io/projected/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-kube-api-access-cl2xj\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d501b5d8-6030-4871-a7f9-a352f96a4d2f-agent-certs\") pod \"konnectivity-agent-n9lpj\" (UID: \"d501b5d8-6030-4871-a7f9-a352f96a4d2f\") " pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-conf-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrsx\" (UniqueName: \"kubernetes.io/projected/07e5822b-f9ff-4da7-9b1b-691bed7af623-kube-api-access-zrrsx\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysconfig\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovnkube-script-lib\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-dbus\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-cni-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-netns\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299481    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysconfig\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p445\" (UniqueName: \"kubernetes.io/projected/301d3a33-8043-4c7e-b2b6-af4c830ee21f-kube-api-access-2p445\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58ngg\" (UniqueName: \"kubernetes.io/projected/5401a6e8-141f-4823-b57f-aca208b89c7a-kube-api-access-58ngg\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d501b5d8-6030-4871-a7f9-a352f96a4d2f-konnectivity-ca\") pod \"konnectivity-agent-n9lpj\" (UID: \"d501b5d8-6030-4871-a7f9-a352f96a4d2f\") " pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-cnibin\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.300480 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299676    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovnkube-config\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299750    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-kubelet\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.299816    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300249    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-dbus\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvfgz\" (UniqueName: \"kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz\") pod \"network-check-target-qnrfj\" (UID: \"f54eb55a-276b-4d34-8190-ec19c6fe20fc\") " pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8wxq\" (UniqueName: \"kubernetes.io/projected/3ea825ae-6a0c-4858-89f7-4b992e555347-kube-api-access-x8wxq\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-cni-binary-copy\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-cni-bin\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300705    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-cni-bin\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300740    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-hostroot\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300776    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-multus-certs\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300829    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-tuned\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-systemd-units\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-run-netns\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.300970    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-systemd-units\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.301110 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301009    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-cni-binary-copy\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-registration-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301013    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-run-netns\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vpxs\" (UniqueName: \"kubernetes.io/projected/a1cc2630-7b85-40fb-9594-56865adf9eba-kube-api-access-4vpxs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysctl-d\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysctl-conf\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovn-node-metrics-cert\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301180    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-etc-selinux\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301198    2578 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/301d3a33-8043-4c7e-b2b6-af4c830ee21f-cni-binary-copy\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301227    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysctl-d\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-socket-dir-parent\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301358    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysctl-conf\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.301421    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-kubelet\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-slash\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.301641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ea825ae-6a0c-4858-89f7-4b992e555347-host\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-system-cni-dir\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5401a6e8-141f-4823-b57f-aca208b89c7a-tmp\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-etc-kubernetes\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301681    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-slash\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5819bbef-1a67-4bb3-b35c-2b8409d463a1-hosts-file\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.301724    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret podName:3e6dcb66-ce72-40ee-86fd-96d07dc4960f nodeName:}" failed. No retries permitted until 2026-11-04 02:15:32.801671586 +0000 UTC m=+3.144965048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret") pod "global-pull-secret-syncer-msgpp" (UID: "3e6dcb66-ce72-40ee-86fd-96d07dc4960f") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301732    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-system-cni-dir\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301740    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5819bbef-1a67-4bb3-b35c-2b8409d463a1-hosts-file\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301756    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ea825ae-6a0c-4858-89f7-4b992e555347-host\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-sys\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-log-socket\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301828    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-device-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301847    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-sys\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-kubernetes\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301868    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-log-socket\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301902    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-kubernetes\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.302335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301904    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn89t\" (UniqueName: \"kubernetes.io/projected/91cad462-1ef8-4bf5-aeca-92005dbf5393-kube-api-access-vn89t\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:15:32.302880 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301917    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.302880 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.301978    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-kubelet\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.304368 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.304345    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5401a6e8-141f-4823-b57f-aca208b89c7a-tmp\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.304436 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.304383    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-tuned\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.304483 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.304436    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovn-node-metrics-cert\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.336007 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.335988    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 02:15:32.336322 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.336303    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 02:15:32.336378 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.336334    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 02:15:32.336703 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.336658    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 02:15:32.336703 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.336672    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m589d\""
Nov 04 02:15:32.336703 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.336670    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:15:32.336703 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.336700    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 02:15:32.336940 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.336705    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 02:15:32.336940 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.336762    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 02:15:32.336940 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.336773    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 02:15:32.336940 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.336791    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-275xk\""
Nov 04 02:15:32.336940 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.336791    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-n8x9d\""
Nov 04 02:15:32.336940 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.336802    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 02:15:32.336940 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.336864    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h2f9b\""
Nov 04 02:15:32.337359 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.337346    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 02:15:32.342726 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.342702    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovnkube-script-lib\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.365423 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.365403    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:32.365423 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.365426    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:32.365586 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.365439    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvfgz for pod openshift-network-diagnostics/network-check-target-qnrfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:32.365586 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.365519    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz podName:f54eb55a-276b-4d34-8190-ec19c6fe20fc nodeName:}" failed. No retries permitted until 2026-11-04 02:15:32.865500932 +0000 UTC m=+3.208794404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mvfgz" (UniqueName: "kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz") pod "network-check-target-qnrfj" (UID: "f54eb55a-276b-4d34-8190-ec19c6fe20fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:32.365758 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.365736    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pth8s\" (UniqueName: \"kubernetes.io/projected/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-kube-api-access-pth8s\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.365971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.365950    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58ngg\" (UniqueName: \"kubernetes.io/projected/5401a6e8-141f-4823-b57f-aca208b89c7a-kube-api-access-58ngg\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.366158 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.366134    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ls7h\" (UniqueName: \"kubernetes.io/projected/5819bbef-1a67-4bb3-b35c-2b8409d463a1-kube-api-access-5ls7h\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:15:32.367451 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.367430    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrsx\" (UniqueName: \"kubernetes.io/projected/07e5822b-f9ff-4da7-9b1b-691bed7af623-kube-api-access-zrrsx\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.367588 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.367568    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8wxq\" (UniqueName: \"kubernetes.io/projected/3ea825ae-6a0c-4858-89f7-4b992e555347-kube-api-access-x8wxq\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:15:32.402957 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.402925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl2xj\" (UniqueName: \"kubernetes.io/projected/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-kube-api-access-cl2xj\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.403073 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.402963    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d501b5d8-6030-4871-a7f9-a352f96a4d2f-agent-certs\") pod \"konnectivity-agent-n9lpj\" (UID: \"d501b5d8-6030-4871-a7f9-a352f96a4d2f\") " pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:15:32.403073 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.402985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-conf-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403073 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403038    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-conf-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403236 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-cni-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403236 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-netns\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403236 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p445\" (UniqueName: \"kubernetes.io/projected/301d3a33-8043-4c7e-b2b6-af4c830ee21f-kube-api-access-2p445\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403236 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d501b5d8-6030-4871-a7f9-a352f96a4d2f-konnectivity-ca\") pod \"konnectivity-agent-n9lpj\" (UID: \"d501b5d8-6030-4871-a7f9-a352f96a4d2f\") " pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:15:32.403236 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-cnibin\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403236 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403194    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-cni-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403236 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403202    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-netns\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403236 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-kubelet\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403477 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403260    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-kubelet\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403477 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-hostroot\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403477 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403286    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-hostroot\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403477 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403285    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-cnibin\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403477 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-multus-certs\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403477 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-registration-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.403477 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vpxs\" (UniqueName: \"kubernetes.io/projected/a1cc2630-7b85-40fb-9594-56865adf9eba-kube-api-access-4vpxs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:32.403477 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403409    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-multus-certs\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403477 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403417    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-registration-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.403477 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-etc-selinux\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.403477 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/301d3a33-8043-4c7e-b2b6-af4c830ee21f-cni-binary-copy\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-socket-dir-parent\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403536    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-etc-selinux\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403540    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-socket-dir-parent\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-etc-kubernetes\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403582    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-etc-kubernetes\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-device-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn89t\" (UniqueName: \"kubernetes.io/projected/91cad462-1ef8-4bf5-aeca-92005dbf5393-kube-api-access-vn89t\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91cad462-1ef8-4bf5-aeca-92005dbf5393-host-slash\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403639    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-device-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403667    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-socket-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-cni-bin\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403731    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91cad462-1ef8-4bf5-aeca-92005dbf5393-host-slash\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-daemon-config\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91cad462-1ef8-4bf5-aeca-92005dbf5393-iptables-alerter-script\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403734    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-cni-bin\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.403910 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-sys-fs\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-k8s-cni-cncf-io\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-system-cni-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.403884    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-cni-multus\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403922    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-sys-fs\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.403950    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs podName:a1cc2630-7b85-40fb-9594-56865adf9eba nodeName:}" failed. No retries permitted until 2026-11-04 02:15:32.903931916 +0000 UTC m=+3.247225374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs") pod "network-metrics-daemon-4fs2v" (UID: "a1cc2630-7b85-40fb-9594-56865adf9eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403957    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-socket-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.403961    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-cni-multus\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.404005    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-k8s-cni-cncf-io\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.404052    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.404100    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-system-cni-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.404344    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/301d3a33-8043-4c7e-b2b6-af4c830ee21f-cni-binary-copy\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.404390    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d501b5d8-6030-4871-a7f9-a352f96a4d2f-konnectivity-ca\") pod \"konnectivity-agent-n9lpj\" (UID: \"d501b5d8-6030-4871-a7f9-a352f96a4d2f\") " pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.404418    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-daemon-config\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.404742 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.404434    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91cad462-1ef8-4bf5-aeca-92005dbf5393-iptables-alerter-script\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:15:32.406246 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.406226    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d501b5d8-6030-4871-a7f9-a352f96a4d2f-agent-certs\") pod \"konnectivity-agent-n9lpj\" (UID: \"d501b5d8-6030-4871-a7f9-a352f96a4d2f\") " pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:15:32.469529 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.469479    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn89t\" (UniqueName: \"kubernetes.io/projected/91cad462-1ef8-4bf5-aeca-92005dbf5393-kube-api-access-vn89t\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:15:32.469605 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.469587    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl2xj\" (UniqueName: \"kubernetes.io/projected/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-kube-api-access-cl2xj\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.472777 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.472747    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vpxs\" (UniqueName: \"kubernetes.io/projected/a1cc2630-7b85-40fb-9594-56865adf9eba-kube-api-access-4vpxs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:32.473294 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.473274    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p445\" (UniqueName: \"kubernetes.io/projected/301d3a33-8043-4c7e-b2b6-af4c830ee21f-kube-api-access-2p445\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.493187 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.493168    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:15:32.496422 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.496402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:15:32.503806 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.503780    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:15:32.504073 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:32.504047    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5819bbef_1a67_4bb3_b35c_2b8409d463a1.slice/crio-64d451f8dac4b84a39c95c060239390585f3990fa17b2c68646cfebbfc6d8c12 WatchSource:0}: Error finding container 64d451f8dac4b84a39c95c060239390585f3990fa17b2c68646cfebbfc6d8c12: Status 404 returned error can't find the container with id 64d451f8dac4b84a39c95c060239390585f3990fa17b2c68646cfebbfc6d8c12
Nov 04 02:15:32.504765 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.504739    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:15:32.506968 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:32.506951    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea825ae_6a0c_4858_89f7_4b992e555347.slice/crio-12b5708e7b013073998cf09ee262746798c0b566be1b06469233a0b3da804cc0 WatchSource:0}: Error finding container 12b5708e7b013073998cf09ee262746798c0b566be1b06469233a0b3da804cc0: Status 404 returned error can't find the container with id 12b5708e7b013073998cf09ee262746798c0b566be1b06469233a0b3da804cc0
Nov 04 02:15:32.514685 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:32.514649    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e5822b_f9ff_4da7_9b1b_691bed7af623.slice/crio-c758780f59d829812e8f0d525c5be027151a8549d580f1bb5d27aab7ccddb402 WatchSource:0}: Error finding container c758780f59d829812e8f0d525c5be027151a8549d580f1bb5d27aab7ccddb402: Status 404 returned error can't find the container with id c758780f59d829812e8f0d525c5be027151a8549d580f1bb5d27aab7ccddb402
Nov 04 02:15:32.515213 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:32.515191    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5401a6e8_141f_4823_b57f_aca208b89c7a.slice/crio-0ec62f353be6ab2249e987baffa7f97e41d4ded121bed04283060b76dec7e032 WatchSource:0}: Error finding container 0ec62f353be6ab2249e987baffa7f97e41d4ded121bed04283060b76dec7e032: Status 404 returned error can't find the container with id 0ec62f353be6ab2249e987baffa7f97e41d4ded121bed04283060b76dec7e032
Nov 04 02:15:32.517390 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.517351    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:15:32.526979 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:32.526960    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91cad462_1ef8_4bf5_aeca_92005dbf5393.slice/crio-135cc9a3e61287d30c813de29bf70a5fdc8d7ec126884bc23a66a741a2c6af8a WatchSource:0}: Error finding container 135cc9a3e61287d30c813de29bf70a5fdc8d7ec126884bc23a66a741a2c6af8a: Status 404 returned error can't find the container with id 135cc9a3e61287d30c813de29bf70a5fdc8d7ec126884bc23a66a741a2c6af8a
Nov 04 02:15:32.528432 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.528413    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:15:32.531302 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.531287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:15:32.533177 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.533158    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:32.535401 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.535381    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cq8lx"
Nov 04 02:15:32.537925 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:32.537906    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb687fe1_110e_4a6b_a552_9a9ed8445eb0.slice/crio-07366ed31c7c2c5c6219bbdd53f4011474c530c801bd00e62e5299d25fede82e WatchSource:0}: Error finding container 07366ed31c7c2c5c6219bbdd53f4011474c530c801bd00e62e5299d25fede82e: Status 404 returned error can't find the container with id 07366ed31c7c2c5c6219bbdd53f4011474c530c801bd00e62e5299d25fede82e
Nov 04 02:15:32.541699 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:32.541670    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd501b5d8_6030_4871_a7f9_a352f96a4d2f.slice/crio-9b798169d6d688d13f7c1b0156655306ac7c034ab1e914daded6649af0791f88 WatchSource:0}: Error finding container 9b798169d6d688d13f7c1b0156655306ac7c034ab1e914daded6649af0791f88: Status 404 returned error can't find the container with id 9b798169d6d688d13f7c1b0156655306ac7c034ab1e914daded6649af0791f88
Nov 04 02:15:32.545012 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:32.544994    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5bf92a_b637_4ed5_b2a8_2b6e2d5b3c9b.slice/crio-0cf71b24d678ded93aaa490836053fbb19b9a46ed384e64a9550d2a1e698ceea WatchSource:0}: Error finding container 0cf71b24d678ded93aaa490836053fbb19b9a46ed384e64a9550d2a1e698ceea: Status 404 returned error can't find the container with id 0cf71b24d678ded93aaa490836053fbb19b9a46ed384e64a9550d2a1e698ceea
Nov 04 02:15:32.547839 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:15:32.547819    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod301d3a33_8043_4c7e_b2b6_af4c830ee21f.slice/crio-29a625a7cb60a606bb848ca30edc00d07a72230392f4d4c4399af7e8f4f33a75 WatchSource:0}: Error finding container 29a625a7cb60a606bb848ca30edc00d07a72230392f4d4c4399af7e8f4f33a75: Status 404 returned error can't find the container with id 29a625a7cb60a606bb848ca30edc00d07a72230392f4d4c4399af7e8f4f33a75
Nov 04 02:15:32.806511 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.806430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:32.806661 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.806552    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:32.806661 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.806606    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret podName:3e6dcb66-ce72-40ee-86fd-96d07dc4960f nodeName:}" failed. No retries permitted until 2026-11-04 02:15:33.806592912 +0000 UTC m=+4.149886364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret") pod "global-pull-secret-syncer-msgpp" (UID: "3e6dcb66-ce72-40ee-86fd-96d07dc4960f") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:32.907388 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.907358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:32.907519 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:32.907403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvfgz\" (UniqueName: \"kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz\") pod \"network-check-target-qnrfj\" (UID: \"f54eb55a-276b-4d34-8190-ec19c6fe20fc\") " pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:32.907519 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.907481    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:32.907519 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.907503    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:32.907519 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.907515    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:32.907668 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.907523    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvfgz for pod openshift-network-diagnostics/network-check-target-qnrfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:32.907668 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.907542    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs podName:a1cc2630-7b85-40fb-9594-56865adf9eba nodeName:}" failed. No retries permitted until 2026-11-04 02:15:33.907525325 +0000 UTC m=+4.250818794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs") pod "network-metrics-daemon-4fs2v" (UID: "a1cc2630-7b85-40fb-9594-56865adf9eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:32.907668 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:32.907559    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz podName:f54eb55a-276b-4d34-8190-ec19c6fe20fc nodeName:}" failed. No retries permitted until 2026-11-04 02:15:33.907549879 +0000 UTC m=+4.250843330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvfgz" (UniqueName: "kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz") pod "network-check-target-qnrfj" (UID: "f54eb55a-276b-4d34-8190-ec19c6fe20fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:33.222080 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.221998    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n9lpj" event={"ID":"d501b5d8-6030-4871-a7f9-a352f96a4d2f","Type":"ContainerStarted","Data":"9b798169d6d688d13f7c1b0156655306ac7c034ab1e914daded6649af0791f88"}
Nov 04 02:15:33.224036 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.224003    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-96gx5" event={"ID":"91cad462-1ef8-4bf5-aeca-92005dbf5393","Type":"ContainerStarted","Data":"135cc9a3e61287d30c813de29bf70a5fdc8d7ec126884bc23a66a741a2c6af8a"}
Nov 04 02:15:33.225715 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.225685    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c72gg" event={"ID":"5401a6e8-141f-4823-b57f-aca208b89c7a","Type":"ContainerStarted","Data":"0ec62f353be6ab2249e987baffa7f97e41d4ded121bed04283060b76dec7e032"}
Nov 04 02:15:33.226963 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.226935    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4628r" event={"ID":"3ea825ae-6a0c-4858-89f7-4b992e555347","Type":"ContainerStarted","Data":"12b5708e7b013073998cf09ee262746798c0b566be1b06469233a0b3da804cc0"}
Nov 04 02:15:33.228638 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.228597    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cq8lx" event={"ID":"301d3a33-8043-4c7e-b2b6-af4c830ee21f","Type":"ContainerStarted","Data":"29a625a7cb60a606bb848ca30edc00d07a72230392f4d4c4399af7e8f4f33a75"}
Nov 04 02:15:33.234454 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.230460    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk" event={"ID":"cb687fe1-110e-4a6b-a552-9a9ed8445eb0","Type":"ContainerStarted","Data":"07366ed31c7c2c5c6219bbdd53f4011474c530c801bd00e62e5299d25fede82e"}
Nov 04 02:15:33.234454 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.233975    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qchvs" event={"ID":"07e5822b-f9ff-4da7-9b1b-691bed7af623","Type":"ContainerStarted","Data":"c758780f59d829812e8f0d525c5be027151a8549d580f1bb5d27aab7ccddb402"}
Nov 04 02:15:33.237240 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.237214    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-42xbt" event={"ID":"5819bbef-1a67-4bb3-b35c-2b8409d463a1","Type":"ContainerStarted","Data":"64d451f8dac4b84a39c95c060239390585f3990fa17b2c68646cfebbfc6d8c12"}
Nov 04 02:15:33.238506 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.238483    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8" event={"ID":"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b","Type":"ContainerStarted","Data":"0cf71b24d678ded93aaa490836053fbb19b9a46ed384e64a9550d2a1e698ceea"}
Nov 04 02:15:33.280885 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.280831    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 02:10:32 +0000 UTC" deadline="2028-04-29 02:38:52.307469029 +0000 UTC"
Nov 04 02:15:33.280885 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.280879    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13008h23m19.026593906s"
Nov 04 02:15:33.815452 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.815408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:33.815680 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:33.815575    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:33.815680 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:33.815644    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret podName:3e6dcb66-ce72-40ee-86fd-96d07dc4960f nodeName:}" failed. No retries permitted until 2026-11-04 02:15:35.815625036 +0000 UTC m=+6.158918502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret") pod "global-pull-secret-syncer-msgpp" (UID: "3e6dcb66-ce72-40ee-86fd-96d07dc4960f") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:33.916043 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.915899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:33.916043 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:33.915981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvfgz\" (UniqueName: \"kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz\") pod \"network-check-target-qnrfj\" (UID: \"f54eb55a-276b-4d34-8190-ec19c6fe20fc\") " pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:33.916297 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:33.916160    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:33.916297 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:33.916185    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:33.916297 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:33.916226    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvfgz for pod openshift-network-diagnostics/network-check-target-qnrfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:33.916453 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:33.916324    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz podName:f54eb55a-276b-4d34-8190-ec19c6fe20fc nodeName:}" failed. No retries permitted until 2026-11-04 02:15:35.916299733 +0000 UTC m=+6.259593189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvfgz" (UniqueName: "kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz") pod "network-check-target-qnrfj" (UID: "f54eb55a-276b-4d34-8190-ec19c6fe20fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:33.916520 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:33.916451    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:33.916520 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:33.916493    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs podName:a1cc2630-7b85-40fb-9594-56865adf9eba nodeName:}" failed. No retries permitted until 2026-11-04 02:15:35.916479664 +0000 UTC m=+6.259773118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs") pod "network-metrics-daemon-4fs2v" (UID: "a1cc2630-7b85-40fb-9594-56865adf9eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:34.217317 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:34.215987    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:34.217317 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:34.216095    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:34.217317 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:34.216153    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:34.217317 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:34.216199    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:34.217317 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:34.216236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:34.217317 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:34.216276    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:34.281520 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:34.281472    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 02:10:32 +0000 UTC" deadline="2028-04-05 05:57:32.639432108 +0000 UTC"
Nov 04 02:15:34.281520 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:34.281518    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12435h41m58.357919301s"
Nov 04 02:15:35.834403 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:35.833947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:35.834403 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:35.834127    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:35.834403 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:35.834356    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret podName:3e6dcb66-ce72-40ee-86fd-96d07dc4960f nodeName:}" failed. No retries permitted until 2026-11-04 02:15:39.834332916 +0000 UTC m=+10.177626382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret") pod "global-pull-secret-syncer-msgpp" (UID: "3e6dcb66-ce72-40ee-86fd-96d07dc4960f") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:35.935026 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:35.934943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:35.935026 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:35.935021    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvfgz\" (UniqueName: \"kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz\") pod \"network-check-target-qnrfj\" (UID: \"f54eb55a-276b-4d34-8190-ec19c6fe20fc\") " pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:35.935241 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:35.935213    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:35.935241 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:35.935235    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:35.935362 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:35.935252    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvfgz for pod openshift-network-diagnostics/network-check-target-qnrfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:35.935362 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:35.935312    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz podName:f54eb55a-276b-4d34-8190-ec19c6fe20fc nodeName:}" failed. No retries permitted until 2026-11-04 02:15:39.935293947 +0000 UTC m=+10.278587398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvfgz" (UniqueName: "kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz") pod "network-check-target-qnrfj" (UID: "f54eb55a-276b-4d34-8190-ec19c6fe20fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:35.935478 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:35.935397    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:35.935478 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:35.935440    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs podName:a1cc2630-7b85-40fb-9594-56865adf9eba nodeName:}" failed. No retries permitted until 2026-11-04 02:15:39.935427232 +0000 UTC m=+10.278720687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs") pod "network-metrics-daemon-4fs2v" (UID: "a1cc2630-7b85-40fb-9594-56865adf9eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:36.214931 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:36.214901    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:36.215153 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:36.215059    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:36.215153 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:36.214900    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:36.215153 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:36.215095    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:36.215344 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:36.215170    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:36.215344 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:36.215258    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:36.259653 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:36.259610    2578 generic.go:356] "Generic (PLEG): container finished" podID="e10f4f4a83a7a5f20f55bc800c3b250b" containerID="ac6a65c738e8b65cebdb126c66d6ed1a9a7155fd85a066709dffc5af7010b235" exitCode=0
Nov 04 02:15:36.259837 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:36.259699    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal" event={"ID":"e10f4f4a83a7a5f20f55bc800c3b250b","Type":"ContainerDied","Data":"ac6a65c738e8b65cebdb126c66d6ed1a9a7155fd85a066709dffc5af7010b235"}
Nov 04 02:15:37.275717 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:37.275214    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal" event={"ID":"e10f4f4a83a7a5f20f55bc800c3b250b","Type":"ContainerStarted","Data":"eecd6d6828dc14da9f3204e1fdd1e5e79c233bf33eeafdb075a9ecccd93a86ed"}
Nov 04 02:15:37.284611 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:37.283925    2578 generic.go:356] "Generic (PLEG): container finished" podID="07e5822b-f9ff-4da7-9b1b-691bed7af623" containerID="a7751d238699d36311f17d20bafd42ef7ebf4a6cb40258f5957dc270690e8fc2" exitCode=0
Nov 04 02:15:37.284611 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:37.283972    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qchvs" event={"ID":"07e5822b-f9ff-4da7-9b1b-691bed7af623","Type":"ContainerDied","Data":"a7751d238699d36311f17d20bafd42ef7ebf4a6cb40258f5957dc270690e8fc2"}
Nov 04 02:15:37.535008 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:37.534911    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal" podStartSLOduration=5.534888417 podStartE2EDuration="5.534888417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:37.40195452 +0000 UTC m=+7.745247995" watchObservedRunningTime="2026-11-04 02:15:37.534888417 +0000 UTC m=+7.878181893"
Nov 04 02:15:38.216134 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:38.216092    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:38.216298 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:38.216222    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:38.216340 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:38.216297    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:38.216400 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:38.216382    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:38.216454 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:38.216440    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:38.216533 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:38.216516    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:38.297047 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:38.296998    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n9lpj" event={"ID":"d501b5d8-6030-4871-a7f9-a352f96a4d2f","Type":"ContainerStarted","Data":"117324d9f78c27b259053f279547eca47e2f18b3b394166b1b8e3d46279935ff"}
Nov 04 02:15:38.302719 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:38.302626    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal" event={"ID":"68f285f0cd89b6c329b3b82af5b728f4","Type":"ContainerStarted","Data":"e0854c25777e046587cd6605d2c9db9708dec88103a645dfa57cb060f6109921"}
Nov 04 02:15:38.426481 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:38.425835    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n9lpj" podStartSLOduration=2.594484495 podStartE2EDuration="7.425814561s" totalImagesPullingTime="4.831330066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:38.425014672 +0000 UTC m=+8.768308150" watchObservedRunningTime="2026-11-04 02:15:38.425814561 +0000 UTC m=+8.769108035"
Nov 04 02:15:39.312422 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:39.311981    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4628r" event={"ID":"3ea825ae-6a0c-4858-89f7-4b992e555347","Type":"ContainerStarted","Data":"e0ba871c2922a6851d27811980de7e5b28193ec681883b87583e1e4e9dc43fac"}
Nov 04 02:15:39.427688 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:39.427579    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal" podStartSLOduration=7.427558656 podStartE2EDuration="7.427558656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:38.549549534 +0000 UTC m=+8.892843008" watchObservedRunningTime="2026-11-04 02:15:39.427558656 +0000 UTC m=+9.770852128"
Nov 04 02:15:39.871538 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:39.871291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:39.871538 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:39.871437    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:39.871538 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:39.871497    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret podName:3e6dcb66-ce72-40ee-86fd-96d07dc4960f nodeName:}" failed. No retries permitted until 2026-11-04 02:15:47.871479417 +0000 UTC m=+18.214772871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret") pod "global-pull-secret-syncer-msgpp" (UID: "3e6dcb66-ce72-40ee-86fd-96d07dc4960f") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:39.973148 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:39.972650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:39.973148 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:39.972727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvfgz\" (UniqueName: \"kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz\") pod \"network-check-target-qnrfj\" (UID: \"f54eb55a-276b-4d34-8190-ec19c6fe20fc\") " pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:39.973148 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:39.972899    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:39.973148 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:39.972914    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:39.973148 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:39.972928    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvfgz for pod openshift-network-diagnostics/network-check-target-qnrfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:39.973148 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:39.972984    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz podName:f54eb55a-276b-4d34-8190-ec19c6fe20fc nodeName:}" failed. No retries permitted until 2026-11-04 02:15:47.972965898 +0000 UTC m=+18.316259350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvfgz" (UniqueName: "kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz") pod "network-check-target-qnrfj" (UID: "f54eb55a-276b-4d34-8190-ec19c6fe20fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:39.973148 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:39.973062    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:39.973148 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:39.973093    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs podName:a1cc2630-7b85-40fb-9594-56865adf9eba nodeName:}" failed. No retries permitted until 2026-11-04 02:15:47.97308279 +0000 UTC m=+18.316376244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs") pod "network-metrics-daemon-4fs2v" (UID: "a1cc2630-7b85-40fb-9594-56865adf9eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:40.216391 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:40.214721    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:40.216391 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:40.214851    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:40.216391 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:40.214929    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:40.216391 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:40.214999    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:40.216391 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:40.215050    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:40.216391 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:40.215114    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:40.315970 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:40.315934    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk" event={"ID":"cb687fe1-110e-4a6b-a552-9a9ed8445eb0","Type":"ContainerStarted","Data":"09042a366ce2010397d3afbdb8f39cb17c461c63bb7a4647442d40ef9380816a"}
Nov 04 02:15:41.321610 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:41.321556    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cq8lx" event={"ID":"301d3a33-8043-4c7e-b2b6-af4c830ee21f","Type":"ContainerStarted","Data":"91f37db10088c60798d32541c9b68fae6c847a815b8cdf1003a5e0016c2d4780"}
Nov 04 02:15:41.440833 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:41.440761    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-cq8lx" podStartSLOduration=2.125730037 podStartE2EDuration="10.440745978s" totalImagesPullingTime="8.315015941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:41.44029388 +0000 UTC m=+11.783587354" watchObservedRunningTime="2026-11-04 02:15:41.440745978 +0000 UTC m=+11.784039449"
Nov 04 02:15:41.442966 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:41.442927    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4628r" podStartSLOduration=4.513589377 podStartE2EDuration="10.442916521s" totalImagesPullingTime="5.929327144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:39.428052613 +0000 UTC m=+9.771346086" watchObservedRunningTime="2026-11-04 02:15:41.442916521 +0000 UTC m=+11.786210044"
Nov 04 02:15:41.474687 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:41.474653    2578 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 02:15:42.157728 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:42.157572    2578 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T02:15:41.474676634Z","UUID":"3d7c6259-03b8-4fa6-bd23-9e48fa9a638c","Handler":null,"Name":"","Endpoint":""}
Nov 04 02:15:42.159042 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:42.158867    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 02:15:42.159144 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:42.159053    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 02:15:42.213436 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:42.213406    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:42.213436 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:42.213432    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:42.213631 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:42.213442    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:42.213631 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:42.213539    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:42.213739 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:42.213653    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:42.213789 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:42.213758    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:42.326214 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:42.326182    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk" event={"ID":"cb687fe1-110e-4a6b-a552-9a9ed8445eb0","Type":"ContainerStarted","Data":"18f9ee21bccb313289de2ad45aa6a8bbd9883908652cb48b78538f41f0c15cbb"}
Nov 04 02:15:42.328392 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:42.328356    2578 generic.go:356] "Generic (PLEG): container finished" podID="07e5822b-f9ff-4da7-9b1b-691bed7af623" containerID="8ec8fea516d34513c7e91a5770c6a5ad39b546aebbe888dd87831037bae9afca" exitCode=0
Nov 04 02:15:42.328676 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:42.328650    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qchvs" event={"ID":"07e5822b-f9ff-4da7-9b1b-691bed7af623","Type":"ContainerDied","Data":"8ec8fea516d34513c7e91a5770c6a5ad39b546aebbe888dd87831037bae9afca"}
Nov 04 02:15:42.331670 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:42.331649    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-42xbt" event={"ID":"5819bbef-1a67-4bb3-b35c-2b8409d463a1","Type":"ContainerStarted","Data":"9d645a903039f9e0c8d245b1bb91d90550a694685c196b3af96e140ea4d1880e"}
Nov 04 02:15:43.281279 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:43.281256    2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:15:43.281721 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:43.281702    2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:15:43.335086 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:43.335056    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk" event={"ID":"cb687fe1-110e-4a6b-a552-9a9ed8445eb0","Type":"ContainerStarted","Data":"238e4f59b92361267cc956a6397be54332ed7fcb54ed0f433de28ecb071c689f"}
Nov 04 02:15:43.336412 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:43.336392    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-96gx5" event={"ID":"91cad462-1ef8-4bf5-aeca-92005dbf5393","Type":"ContainerStarted","Data":"992dcee150c03cd8b79d520fc282ebf7e14e1e901df6dc236355c0b32368626e"}
Nov 04 02:15:43.337919 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:43.337891    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c72gg" event={"ID":"5401a6e8-141f-4823-b57f-aca208b89c7a","Type":"ContainerStarted","Data":"20ca58d516766f7ca2130e20eaed69ec546eb2e3dd1ba3e6a931e5c317bf3f2c"}
Nov 04 02:15:43.397232 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:43.397195    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-42xbt" podStartSLOduration=3.289299829 podStartE2EDuration="12.397182547s" totalImagesPullingTime="9.107882718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:42.567273985 +0000 UTC m=+12.910567454" watchObservedRunningTime="2026-11-04 02:15:43.397182547 +0000 UTC m=+13.740476018"
Nov 04 02:15:43.515876 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:43.515820    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c72gg" podStartSLOduration=1.969736068 podStartE2EDuration="12.515806378s" totalImagesPullingTime="10.54607031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:43.515480828 +0000 UTC m=+13.858774298" watchObservedRunningTime="2026-11-04 02:15:43.515806378 +0000 UTC m=+13.859099867"
Nov 04 02:15:43.748821 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:43.748739    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-96gx5" podStartSLOduration=3.762865079 podStartE2EDuration="12.748724632s" totalImagesPullingTime="8.985859553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:43.630277098 +0000 UTC m=+13.973570568" watchObservedRunningTime="2026-11-04 02:15:43.748724632 +0000 UTC m=+14.092018085"
Nov 04 02:15:43.748950 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:43.748835    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk" podStartSLOduration=2.6734209030000002 podStartE2EDuration="12.748828606s" totalImagesPullingTime="10.075407703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:43.74854198 +0000 UTC m=+14.091835451" watchObservedRunningTime="2026-11-04 02:15:43.748828606 +0000 UTC m=+14.092122076"
Nov 04 02:15:44.216836 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:44.216808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:44.217016 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:44.216853    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:44.217016 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:44.216853    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:44.217016 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:44.216922    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:44.217144 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:44.217023    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:44.217144 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:44.217097    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:44.341786 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:44.341757    2578 generic.go:356] "Generic (PLEG): container finished" podID="07e5822b-f9ff-4da7-9b1b-691bed7af623" containerID="d346546fa98df493d75cef93ff59d1dee7ad758192a44a80d23c0e7540387f87" exitCode=0
Nov 04 02:15:44.342270 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:44.341861    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qchvs" event={"ID":"07e5822b-f9ff-4da7-9b1b-691bed7af623","Type":"ContainerDied","Data":"d346546fa98df493d75cef93ff59d1dee7ad758192a44a80d23c0e7540387f87"}
Nov 04 02:15:46.217117 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:46.216947    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:46.217548 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:46.216978    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:46.217548 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:46.217196    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:46.217548 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:46.217299    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:46.217548 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:46.216987    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:46.217548 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:46.217388    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:46.347892 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:46.347856    2578 generic.go:356] "Generic (PLEG): container finished" podID="07e5822b-f9ff-4da7-9b1b-691bed7af623" containerID="e16d6cf75aef5066baf67161888845cfb3e8492e6b2ebe2efc7f7a9de0ba396b" exitCode=0
Nov 04 02:15:46.348041 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:46.347909    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qchvs" event={"ID":"07e5822b-f9ff-4da7-9b1b-691bed7af623","Type":"ContainerDied","Data":"e16d6cf75aef5066baf67161888845cfb3e8492e6b2ebe2efc7f7a9de0ba396b"}
Nov 04 02:15:47.934358 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:47.934327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:47.934819 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:47.934418    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:47.934819 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:47.934462    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret podName:3e6dcb66-ce72-40ee-86fd-96d07dc4960f nodeName:}" failed. No retries permitted until 2026-11-04 02:16:03.934449277 +0000 UTC m=+34.277742726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret") pod "global-pull-secret-syncer-msgpp" (UID: "3e6dcb66-ce72-40ee-86fd-96d07dc4960f") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:48.035323 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:48.035291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:48.035491 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:48.035342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvfgz\" (UniqueName: \"kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz\") pod \"network-check-target-qnrfj\" (UID: \"f54eb55a-276b-4d34-8190-ec19c6fe20fc\") " pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:48.035491 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:48.035453    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:48.035491 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:48.035471    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:48.035491 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:48.035487    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:48.035491 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:48.035496    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvfgz for pod openshift-network-diagnostics/network-check-target-qnrfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:48.035735 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:48.035523    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs podName:a1cc2630-7b85-40fb-9594-56865adf9eba nodeName:}" failed. No retries permitted until 2026-11-04 02:16:04.035504056 +0000 UTC m=+34.378797508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs") pod "network-metrics-daemon-4fs2v" (UID: "a1cc2630-7b85-40fb-9594-56865adf9eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:48.035735 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:48.035546    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz podName:f54eb55a-276b-4d34-8190-ec19c6fe20fc nodeName:}" failed. No retries permitted until 2026-11-04 02:16:04.035535009 +0000 UTC m=+34.378828463 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvfgz" (UniqueName: "kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz") pod "network-check-target-qnrfj" (UID: "f54eb55a-276b-4d34-8190-ec19c6fe20fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:48.213328 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:48.213246    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:48.213486 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:48.213246    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:48.213486 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:48.213389    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:48.213486 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:48.213464    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:48.213651 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:48.213256    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:48.213651 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:48.213559    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:49.357702 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:49.357668    2578 generic.go:356] "Generic (PLEG): container finished" podID="07e5822b-f9ff-4da7-9b1b-691bed7af623" containerID="f27818bdba90880dc0d14e79c995a0e255cf58b1f77baa9f30bc090be1c9d745" exitCode=0
Nov 04 02:15:49.358091 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:49.357714    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qchvs" event={"ID":"07e5822b-f9ff-4da7-9b1b-691bed7af623","Type":"ContainerDied","Data":"f27818bdba90880dc0d14e79c995a0e255cf58b1f77baa9f30bc090be1c9d745"}
Nov 04 02:15:50.216510 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:50.216481    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:50.216744 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:50.216580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:50.216744 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:50.216588    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:50.216744 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:50.216624    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:50.216744 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:50.216680    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:50.216744 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:50.216746    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:50.362736 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:50.362704    2578 generic.go:356] "Generic (PLEG): container finished" podID="07e5822b-f9ff-4da7-9b1b-691bed7af623" containerID="875da786609a51e807ab41ac45b4b7e2c60157144bcb7c67c54f9cb6d4d909cd" exitCode=0
Nov 04 02:15:50.363160 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:50.362746    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qchvs" event={"ID":"07e5822b-f9ff-4da7-9b1b-691bed7af623","Type":"ContainerDied","Data":"875da786609a51e807ab41ac45b4b7e2c60157144bcb7c67c54f9cb6d4d909cd"}
Nov 04 02:15:51.367765 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:51.367724    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qchvs" event={"ID":"07e5822b-f9ff-4da7-9b1b-691bed7af623","Type":"ContainerStarted","Data":"e9540f5e01a5ef7245cb2d9cbfbd872bcf78e019ab042318d7b3be35b5608bb6"}
Nov 04 02:15:51.591409 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:51.591355    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qchvs" podStartSLOduration=6.786749385 podStartE2EDuration="20.591340596s" totalImagesPullingTime="13.804591211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:51.590946825 +0000 UTC m=+21.934240295" watchObservedRunningTime="2026-11-04 02:15:51.591340596 +0000 UTC m=+21.934634072"
Nov 04 02:15:52.213543 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:52.213500    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:52.213543 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:52.213552    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:52.213806 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:52.213521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:52.213806 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:52.213662    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:52.213806 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:52.213726    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:52.213806 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:52.213797    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:54.213115 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:54.213084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:54.213773 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:54.213223    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:54.213773 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:54.213096    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:54.213773 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:54.213451    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:54.213773 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:54.213513    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:54.213773 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:54.213577    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:55.378476 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:55.378329    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:15:55.378896 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:55.378781    2578 generic.go:356] "Generic (PLEG): container finished" podID="cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b" containerID="4fe4b73161bc83039d6c37b39c0f2f07d21c9657b49c510c87cf7df51f0268a7" exitCode=1
Nov 04 02:15:55.378896 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:55.378810    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8" event={"ID":"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b","Type":"ContainerStarted","Data":"cc94c7e48f3b3fa4e834d9cdfba718dfb55d1810382ffc38225367a3ad51701c"}
Nov 04 02:15:55.378896 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:55.378887    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8" event={"ID":"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b","Type":"ContainerStarted","Data":"8d3f51727cdadced21f756d520334a9574e401c88c22249e3380ad05beef054e"}
Nov 04 02:15:55.378989 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:55.378920    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8" event={"ID":"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b","Type":"ContainerStarted","Data":"2a5b20630c6f9e121249872fc49464e27603e95fad2575e0824897768ce232a2"}
Nov 04 02:15:55.378989 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:55.378952    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8" event={"ID":"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b","Type":"ContainerStarted","Data":"6a10c66ad41059e2d0f5a74576f48d870785d307654cc2170b09103f7b341714"}
Nov 04 02:15:55.378989 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:55.378980    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8" event={"ID":"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b","Type":"ContainerDied","Data":"4fe4b73161bc83039d6c37b39c0f2f07d21c9657b49c510c87cf7df51f0268a7"}
Nov 04 02:15:55.379072 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:55.379017    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8" event={"ID":"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b","Type":"ContainerStarted","Data":"8561ae69e40707d2db91150f5d62e107e8596fbd3a4335406adc909906f88537"}
Nov 04 02:15:56.213048 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:56.213018    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:56.213225 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:56.213114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:56.213225 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:56.213125    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:56.213225 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:56.213200    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:56.213382 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:56.213194    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:56.213382 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:56.213265    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:56.215832 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:56.215815    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:15:56.215935 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:56.215865    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:15:57.385940 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:57.385911    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:15:57.386352 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:57.386212    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8" event={"ID":"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b","Type":"ContainerStarted","Data":"6d213055d754f3af72cdc252ee3865860b951d0700214bc61e0a54607a85d2f4"}
Nov 04 02:15:58.214113 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:58.214076    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:15:58.214113 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:58.214106    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:15:58.214314 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:58.214191    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:15:58.214314 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:58.214206    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:15:58.214314 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:58.214253    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:15:58.214404 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:15:58.214354    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:15:59.394261 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:59.394233    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:15:59.394865 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:59.394610    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8" event={"ID":"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b","Type":"ContainerStarted","Data":"aa0b8fcb4562d6f53144498d48783a93e7b1bc244aa1e45c6a2c7c9d0e57cef0"}
Nov 04 02:15:59.394865 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:59.394844    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:59.395016 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:59.395001    2578 scope.go:122] "RemoveContainer" containerID="4fe4b73161bc83039d6c37b39c0f2f07d21c9657b49c510c87cf7df51f0268a7"
Nov 04 02:15:59.395062 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:59.395019    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:59.395179 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:59.395168    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:59.411902 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:59.411879    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:15:59.412609 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:15:59.412580    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:00.214652 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:00.214469    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:00.214813 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:00.214539    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:00.214813 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:00.214563    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:00.214928 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:00.214831    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:00.214928 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:00.214702    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:00.214928 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:00.214892    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:00.399829 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:00.399804    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:16:00.400236 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:00.400180    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8" event={"ID":"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b","Type":"ContainerStarted","Data":"024e629ad625f3eb7016b1590fad6b93c0c439c0531472afb7c55952e1d8e1d8"}
Nov 04 02:16:00.605401 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:00.605355    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8" podStartSLOduration=7.422319525 podStartE2EDuration="29.605342964s" totalImagesPullingTime="22.183023439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:00.57947867 +0000 UTC m=+30.922772140" watchObservedRunningTime="2026-11-04 02:16:00.605342964 +0000 UTC m=+30.948636433"
Nov 04 02:16:02.214007 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:02.213972    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:02.214007 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:02.214004    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:02.214514 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:02.214126    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:02.214514 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:02.214164    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:02.214514 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:02.214244    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:02.214514 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:02.214295    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:03.951335 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:03.951292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:03.951749 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:03.951443    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:16:03.951749 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:03.951502    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret podName:3e6dcb66-ce72-40ee-86fd-96d07dc4960f nodeName:}" failed. No retries permitted until 2026-11-04 02:16:35.951488667 +0000 UTC m=+66.294782116 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret") pod "global-pull-secret-syncer-msgpp" (UID: "3e6dcb66-ce72-40ee-86fd-96d07dc4960f") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:16:04.052437 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:04.052397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:04.052591 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:04.052449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvfgz\" (UniqueName: \"kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz\") pod \"network-check-target-qnrfj\" (UID: \"f54eb55a-276b-4d34-8190-ec19c6fe20fc\") " pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:04.052591 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:04.052548    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:16:04.052591 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:04.052562    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:16:04.052591 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:04.052574    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:16:04.052591 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:04.052586    2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvfgz for pod openshift-network-diagnostics/network-check-target-qnrfj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:16:04.052758 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:04.052632    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs podName:a1cc2630-7b85-40fb-9594-56865adf9eba nodeName:}" failed. No retries permitted until 2026-11-04 02:16:36.052613799 +0000 UTC m=+66.395907265 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs") pod "network-metrics-daemon-4fs2v" (UID: "a1cc2630-7b85-40fb-9594-56865adf9eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:16:04.052758 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:04.052647    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz podName:f54eb55a-276b-4d34-8190-ec19c6fe20fc nodeName:}" failed. No retries permitted until 2026-11-04 02:16:36.052640573 +0000 UTC m=+66.395934022 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvfgz" (UniqueName: "kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz") pod "network-check-target-qnrfj" (UID: "f54eb55a-276b-4d34-8190-ec19c6fe20fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:16:04.214177 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:04.214100    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:04.214177 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:04.214132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:04.214390 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:04.214098    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:04.214390 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:04.214214    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:04.214390 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:04.214286    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:04.214390 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:04.214362    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:06.213265 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:06.213230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:06.213790 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:06.213230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:06.213790 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:06.213241    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:06.213790 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:06.213326    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:06.213790 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:06.213468    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:06.213790 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:06.213542    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:08.213552 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:08.213514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:08.213552 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:08.213545    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:08.214050 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:08.213630    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:08.214050 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:08.213648    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:08.214050 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:08.213729    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:08.214050 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:08.213817    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:08.669939 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:08.669913    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-42xbt_5819bbef-1a67-4bb3-b35c-2b8409d463a1/dns-node-resolver/0.log"
Nov 04 02:16:09.287452 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:09.287427    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4628r_3ea825ae-6a0c-4858-89f7-4b992e555347/node-ca/0.log"
Nov 04 02:16:10.215025 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:10.214993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:10.215194 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:10.215089    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:10.215194 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:10.215105    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:10.215194 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:10.215168    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:10.215367 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:10.215196    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:10.215367 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:10.215276    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:12.213580 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:12.213547    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:12.213996 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:12.213618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:12.213996 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:12.213629    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:12.213996 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:12.213726    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:12.213996 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:12.213800    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:12.213996 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:12.213862    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:14.213571 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:14.213539    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:14.213571 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:14.213568    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:14.214078 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:14.213540    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:14.214078 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:14.213668    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:14.214078 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:14.213770    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:14.214078 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:14.213833    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:16.213385 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:16.213344    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:16.213385 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:16.213368    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:16.213843 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:16.213518    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:16.213843 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:16.213558    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:16.213843 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:16.213662    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:16.213843 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:16.213732    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:18.214021 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:18.213983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:18.214506 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:18.213995    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:18.214506 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:18.214083    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:18.214506 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:18.213999    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:18.214506 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:18.214143    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:18.214506 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:18.214222    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:20.216043 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:20.216011    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:20.216744 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:20.216705    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:20.216744 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:20.216693    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:20.216924 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:20.216842    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:20.216924 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:20.216843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:20.217040 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:20.216997    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:21.971546 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:21.971520    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-msgpp"]
Nov 04 02:16:21.971980 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:21.971639    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:21.971980 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:21.971730    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:21.976696 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:21.976676    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qnrfj"]
Nov 04 02:16:21.976808 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:21.976752    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:21.976852 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:21.976824    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:21.977450 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:21.977428    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4fs2v"]
Nov 04 02:16:21.977542 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:21.977528    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:21.977668 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:21.977649    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:23.213476 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:23.213397    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:23.213850 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:23.213534    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:24.213761 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:24.213729    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:24.214189 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:24.213843    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:24.214189 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:24.213894    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:24.214189 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:24.213993    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:25.213501 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:25.213473    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:25.213679 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:25.213578    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4fs2v" podUID="a1cc2630-7b85-40fb-9594-56865adf9eba"
Nov 04 02:16:26.213284 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:26.213253    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:26.213674 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:26.213359    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qnrfj" podUID="f54eb55a-276b-4d34-8190-ec19c6fe20fc"
Nov 04 02:16:26.213674 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:26.213444    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:26.213674 ip-10-0-131-226 kubenswrapper[2578]: E1104 02:16:26.213551    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-msgpp" podUID="3e6dcb66-ce72-40ee-86fd-96d07dc4960f"
Nov 04 02:16:26.931639 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:26.931410    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeReady"
Nov 04 02:16:26.931781 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:26.931665    2578 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 04 02:16:27.098887 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.098851    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7hk2x"]
Nov 04 02:16:27.100922 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.100899    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xq8jl"]
Nov 04 02:16:27.101361 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.101333    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.109158 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.109119    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xq8jl"]
Nov 04 02:16:27.109283 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.109169    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7hk2x"]
Nov 04 02:16:27.109283 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.109246    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.137863 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.137840    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-29hdm"]
Nov 04 02:16:27.139675 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.139657    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-29hdm"
Nov 04 02:16:27.154703 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.154685    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 02:16:27.154819 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.154733    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 02:16:27.154819 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.154805    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n2j4c\""
Nov 04 02:16:27.161991 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.161969    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 02:16:27.162260 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.162245    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 02:16:27.162454 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.162441    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pszzf\""
Nov 04 02:16:27.196096 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.196031    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-29hdm"]
Nov 04 02:16:27.204223 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.204201    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghph7\" (UniqueName: \"kubernetes.io/projected/04d1e991-8105-4b6e-b079-242cfbb2ece8-kube-api-access-ghph7\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.204319 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.204227    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0627c0af-c804-48a6-87bf-a9e9d27c0d48-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.204319 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.204244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhnmh\" (UniqueName: \"kubernetes.io/projected/0627c0af-c804-48a6-87bf-a9e9d27c0d48-kube-api-access-xhnmh\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.204319 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.204280    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/04d1e991-8105-4b6e-b079-242cfbb2ece8-metrics-tls\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.204411 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.204353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/04d1e991-8105-4b6e-b079-242cfbb2ece8-config-volume\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.204442 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.204429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/090eb434-52cf-4ada-86a3-dedbd7814699-cert\") pod \"ingress-canary-29hdm\" (UID: \"090eb434-52cf-4ada-86a3-dedbd7814699\") " pod="openshift-ingress-canary/ingress-canary-29hdm"
Nov 04 02:16:27.204472 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.204458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d1e991-8105-4b6e-b079-242cfbb2ece8-tmp-dir\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.204520 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.204507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0627c0af-c804-48a6-87bf-a9e9d27c0d48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.204552 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.204527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt7n4\" (UniqueName: \"kubernetes.io/projected/090eb434-52cf-4ada-86a3-dedbd7814699-kube-api-access-lt7n4\") pod \"ingress-canary-29hdm\" (UID: \"090eb434-52cf-4ada-86a3-dedbd7814699\") " pod="openshift-ingress-canary/ingress-canary-29hdm"
Nov 04 02:16:27.204620 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.204591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0627c0af-c804-48a6-87bf-a9e9d27c0d48-data-volume\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.204651 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.204631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0627c0af-c804-48a6-87bf-a9e9d27c0d48-crio-socket\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.213886 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.213868    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:27.255241 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.255208    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 02:16:27.255241 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.255241    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 02:16:27.255407 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.255264    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 02:16:27.255407 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.255288    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 02:16:27.255407 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.255290    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 02:16:27.255407 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.255372    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-v7b9k\""
Nov 04 02:16:27.266570 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.266555    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k925t\""
Nov 04 02:16:27.267244 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.267234    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 02:16:27.305679 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.305652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d1e991-8105-4b6e-b079-242cfbb2ece8-tmp-dir\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.305793 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.305693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0627c0af-c804-48a6-87bf-a9e9d27c0d48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.305793 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.305710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt7n4\" (UniqueName: \"kubernetes.io/projected/090eb434-52cf-4ada-86a3-dedbd7814699-kube-api-access-lt7n4\") pod \"ingress-canary-29hdm\" (UID: \"090eb434-52cf-4ada-86a3-dedbd7814699\") " pod="openshift-ingress-canary/ingress-canary-29hdm"
Nov 04 02:16:27.305888 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.305834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0627c0af-c804-48a6-87bf-a9e9d27c0d48-data-volume\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.305888 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.305878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0627c0af-c804-48a6-87bf-a9e9d27c0d48-crio-socket\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.305988 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.305923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghph7\" (UniqueName: \"kubernetes.io/projected/04d1e991-8105-4b6e-b079-242cfbb2ece8-kube-api-access-ghph7\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.305988 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.305949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0627c0af-c804-48a6-87bf-a9e9d27c0d48-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.305988 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.305976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhnmh\" (UniqueName: \"kubernetes.io/projected/0627c0af-c804-48a6-87bf-a9e9d27c0d48-kube-api-access-xhnmh\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.305988 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.305979    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d1e991-8105-4b6e-b079-242cfbb2ece8-tmp-dir\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.306161 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.306033    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/04d1e991-8105-4b6e-b079-242cfbb2ece8-metrics-tls\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.306161 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.306077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/04d1e991-8105-4b6e-b079-242cfbb2ece8-config-volume\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.306161 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.306120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/090eb434-52cf-4ada-86a3-dedbd7814699-cert\") pod \"ingress-canary-29hdm\" (UID: \"090eb434-52cf-4ada-86a3-dedbd7814699\") " pod="openshift-ingress-canary/ingress-canary-29hdm"
Nov 04 02:16:27.306161 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.306125    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0627c0af-c804-48a6-87bf-a9e9d27c0d48-data-volume\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.306161 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.306138    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0627c0af-c804-48a6-87bf-a9e9d27c0d48-crio-socket\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.306692 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.306665    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0627c0af-c804-48a6-87bf-a9e9d27c0d48-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.306788 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.306705    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/04d1e991-8105-4b6e-b079-242cfbb2ece8-config-volume\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.309557 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.309539    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/04d1e991-8105-4b6e-b079-242cfbb2ece8-metrics-tls\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.309671 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.309653    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0627c0af-c804-48a6-87bf-a9e9d27c0d48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.309707 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.309682    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/090eb434-52cf-4ada-86a3-dedbd7814699-cert\") pod \"ingress-canary-29hdm\" (UID: \"090eb434-52cf-4ada-86a3-dedbd7814699\") " pod="openshift-ingress-canary/ingress-canary-29hdm"
Nov 04 02:16:27.367222 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.367185    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhnmh\" (UniqueName: \"kubernetes.io/projected/0627c0af-c804-48a6-87bf-a9e9d27c0d48-kube-api-access-xhnmh\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.367361 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.367196    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghph7\" (UniqueName: \"kubernetes.io/projected/04d1e991-8105-4b6e-b079-242cfbb2ece8-kube-api-access-ghph7\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.367361 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.367341    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt7n4\" (UniqueName: \"kubernetes.io/projected/090eb434-52cf-4ada-86a3-dedbd7814699-kube-api-access-lt7n4\") pod \"ingress-canary-29hdm\" (UID: \"090eb434-52cf-4ada-86a3-dedbd7814699\") " pod="openshift-ingress-canary/ingress-canary-29hdm"
Nov 04 02:16:27.417114 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.417078    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:27.423466 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.423446    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:27.448954 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.448883    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-29hdm"
Nov 04 02:16:27.858368 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.858338    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xq8jl"]
Nov 04 02:16:27.861166 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.861143    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7hk2x"]
Nov 04 02:16:27.864822 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:16:27.864761    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d1e991_8105_4b6e_b079_242cfbb2ece8.slice/crio-b634db14fce15759a5ce404a81cb61a3063f74b81f05ef30044f40c9294c9ee7 WatchSource:0}: Error finding container b634db14fce15759a5ce404a81cb61a3063f74b81f05ef30044f40c9294c9ee7: Status 404 returned error can't find the container with id b634db14fce15759a5ce404a81cb61a3063f74b81f05ef30044f40c9294c9ee7
Nov 04 02:16:27.906790 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:27.906767    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-29hdm"]
Nov 04 02:16:27.910442 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:16:27.910422    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod090eb434_52cf_4ada_86a3_dedbd7814699.slice/crio-66c4eddb3ebc8dd5e6b4eb9c6623ffdb31b3fe7f79a07222012bf55ddc8f40d9 WatchSource:0}: Error finding container 66c4eddb3ebc8dd5e6b4eb9c6623ffdb31b3fe7f79a07222012bf55ddc8f40d9: Status 404 returned error can't find the container with id 66c4eddb3ebc8dd5e6b4eb9c6623ffdb31b3fe7f79a07222012bf55ddc8f40d9
Nov 04 02:16:28.000512 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.000333    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh"]
Nov 04 02:16:28.002685 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.002671    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh"
Nov 04 02:16:28.057000 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.056970    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Nov 04 02:16:28.057155 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.057049    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kddl5\""
Nov 04 02:16:28.057537 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.057508    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh"]
Nov 04 02:16:28.112248 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.112177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5fdaac0b-352b-4199-a772-a7013fab3fe7-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-xsflh\" (UID: \"5fdaac0b-352b-4199-a772-a7013fab3fe7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh"
Nov 04 02:16:28.212656 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.212622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5fdaac0b-352b-4199-a772-a7013fab3fe7-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-xsflh\" (UID: \"5fdaac0b-352b-4199-a772-a7013fab3fe7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh"
Nov 04 02:16:28.213260 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.213231    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:28.213506 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.213474    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:28.215558 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.215537    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5fdaac0b-352b-4199-a772-a7013fab3fe7-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-xsflh\" (UID: \"5fdaac0b-352b-4199-a772-a7013fab3fe7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh"
Nov 04 02:16:28.266444 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.266416    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 02:16:28.266629 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.266587    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 02:16:28.266684 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.266645    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-nw2cx\""
Nov 04 02:16:28.266684 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.266665    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 02:16:28.266684 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.266665    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-gsgrb\""
Nov 04 02:16:28.315384 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.315358    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh"
Nov 04 02:16:28.454239 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.454206    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-29hdm" event={"ID":"090eb434-52cf-4ada-86a3-dedbd7814699","Type":"ContainerStarted","Data":"66c4eddb3ebc8dd5e6b4eb9c6623ffdb31b3fe7f79a07222012bf55ddc8f40d9"}
Nov 04 02:16:28.455770 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.455740    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xq8jl" event={"ID":"0627c0af-c804-48a6-87bf-a9e9d27c0d48","Type":"ContainerStarted","Data":"5833d09a8fa833541ec9925db954592e2f2063d1dc1868ad1e1624d82a45813d"}
Nov 04 02:16:28.455893 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.455794    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xq8jl" event={"ID":"0627c0af-c804-48a6-87bf-a9e9d27c0d48","Type":"ContainerStarted","Data":"66c9caeb9a86e1175a21f98028f593989e7a1f83e255ebdc89466303af191ff4"}
Nov 04 02:16:28.456762 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.456736    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7hk2x" event={"ID":"04d1e991-8105-4b6e-b079-242cfbb2ece8","Type":"ContainerStarted","Data":"b634db14fce15759a5ce404a81cb61a3063f74b81f05ef30044f40c9294c9ee7"}
Nov 04 02:16:28.685517 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:28.685452    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh"]
Nov 04 02:16:28.689124 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:16:28.689096    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdaac0b_352b_4199_a772_a7013fab3fe7.slice/crio-bf4cc57d3ca4656b96c7f216764af99da489fb9f2454e37a8d0477799561d7e3 WatchSource:0}: Error finding container bf4cc57d3ca4656b96c7f216764af99da489fb9f2454e37a8d0477799561d7e3: Status 404 returned error can't find the container with id bf4cc57d3ca4656b96c7f216764af99da489fb9f2454e37a8d0477799561d7e3
Nov 04 02:16:29.461795 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:29.461709    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xq8jl" event={"ID":"0627c0af-c804-48a6-87bf-a9e9d27c0d48","Type":"ContainerStarted","Data":"33f01c90a4c46bdc82f1db5c0788bb8a408f65057883a53d30a13da76a3907f5"}
Nov 04 02:16:29.463107 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:29.463069    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh" event={"ID":"5fdaac0b-352b-4199-a772-a7013fab3fe7","Type":"ContainerStarted","Data":"bf4cc57d3ca4656b96c7f216764af99da489fb9f2454e37a8d0477799561d7e3"}
Nov 04 02:16:31.418239 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:31.417969    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:31.471050 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:31.471016    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xq8jl" event={"ID":"0627c0af-c804-48a6-87bf-a9e9d27c0d48","Type":"ContainerStarted","Data":"13aa979c699e9c26c1885654b7785c312021b6cb12dcbc252ff946460326fa29"}
Nov 04 02:16:31.472556 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:31.472530    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh" event={"ID":"5fdaac0b-352b-4199-a772-a7013fab3fe7","Type":"ContainerStarted","Data":"9e6c92a2bd5c0cbfd67ee73d7773781f18c96ab39c052456c8bb4cd54e1d8365"}
Nov 04 02:16:31.472897 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:31.472877    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh"
Nov 04 02:16:31.474081 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:31.474057    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-29hdm" event={"ID":"090eb434-52cf-4ada-86a3-dedbd7814699","Type":"ContainerStarted","Data":"7299b3cc17422d36745984722e3f5eef56f2df0c03a20dcffbbc5f9229f0d0ad"}
Nov 04 02:16:31.476205 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:31.476179    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7hk2x" event={"ID":"04d1e991-8105-4b6e-b079-242cfbb2ece8","Type":"ContainerStarted","Data":"5b3d594ad04909839483059140e8c8a4ac9095a93c8bd9bdca204d8b4a3bf42d"}
Nov 04 02:16:31.476325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:31.476225    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7hk2x" event={"ID":"04d1e991-8105-4b6e-b079-242cfbb2ece8","Type":"ContainerStarted","Data":"210bdce9c36a8fa314c71818b8702a907e84ddb6b9e37479c261655e28bd4680"}
Nov 04 02:16:31.476385 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:31.476329    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:31.478130 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:31.478112    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh"
Nov 04 02:16:31.772317 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:31.772269    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-7hk2x" podStartSLOduration=3.282754816 podStartE2EDuration="5.772255151s" totalImagesPullingTime="2.489500335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:31.770414418 +0000 UTC m=+62.113707889" watchObservedRunningTime="2026-11-04 02:16:31.772255151 +0000 UTC m=+62.115548619"
Nov 04 02:16:31.889824 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:31.889738    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh" podStartSLOduration=3.172824514 podStartE2EDuration="4.889725337s" totalImagesPullingTime="1.716900823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:31.889184003 +0000 UTC m=+62.232477473" watchObservedRunningTime="2026-11-04 02:16:31.889725337 +0000 UTC m=+62.233018807"
Nov 04 02:16:32.010439 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.010385    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xq8jl" podStartSLOduration=2.742257013 podStartE2EDuration="6.010370765s" totalImagesPullingTime="3.268113752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:16:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:32.009643765 +0000 UTC m=+62.352937235" watchObservedRunningTime="2026-11-04 02:16:32.010370765 +0000 UTC m=+62.353664239"
Nov 04 02:16:32.128954 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.128904    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-29hdm" podStartSLOduration=1.660766229 podStartE2EDuration="5.128889407s" totalImagesPullingTime="3.468123178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:32.127919248 +0000 UTC m=+62.471212720" watchObservedRunningTime="2026-11-04 02:16:32.128889407 +0000 UTC m=+62.472182878"
Nov 04 02:16:32.332224 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.332188    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-pl5st"]
Nov 04 02:16:32.334679 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.334664    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:16:32.397299 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.397267    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 04 02:16:32.397508 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.397363    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 04 02:16:32.397508 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.397390    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-xp28c\""
Nov 04 02:16:32.398044 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.398021    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-pl5st"]
Nov 04 02:16:32.447298 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.447198    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99qgd\" (UniqueName: \"kubernetes.io/projected/4a7f9252-6cad-4558-beb5-d30528b7be82-kube-api-access-99qgd\") pod \"downloads-6dd789c8b7-pl5st\" (UID: \"4a7f9252-6cad-4558-beb5-d30528b7be82\") " pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:16:32.447712 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.447386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a7f9252-6cad-4558-beb5-d30528b7be82-tmp\") pod \"downloads-6dd789c8b7-pl5st\" (UID: \"4a7f9252-6cad-4558-beb5-d30528b7be82\") " pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:16:32.548495 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.548458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a7f9252-6cad-4558-beb5-d30528b7be82-tmp\") pod \"downloads-6dd789c8b7-pl5st\" (UID: \"4a7f9252-6cad-4558-beb5-d30528b7be82\") " pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:16:32.548739 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.548708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99qgd\" (UniqueName: \"kubernetes.io/projected/4a7f9252-6cad-4558-beb5-d30528b7be82-kube-api-access-99qgd\") pod \"downloads-6dd789c8b7-pl5st\" (UID: \"4a7f9252-6cad-4558-beb5-d30528b7be82\") " pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:16:32.548916 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.548893    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a7f9252-6cad-4558-beb5-d30528b7be82-tmp\") pod \"downloads-6dd789c8b7-pl5st\" (UID: \"4a7f9252-6cad-4558-beb5-d30528b7be82\") " pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:16:32.614393 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.614363    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99qgd\" (UniqueName: \"kubernetes.io/projected/4a7f9252-6cad-4558-beb5-d30528b7be82-kube-api-access-99qgd\") pod \"downloads-6dd789c8b7-pl5st\" (UID: \"4a7f9252-6cad-4558-beb5-d30528b7be82\") " pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:16:32.644434 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.644406    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:16:32.654279 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.654261    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"]
Nov 04 02:16:32.656899 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.656878    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:32.712488 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.712425    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 02:16:32.712967 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.712951    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Nov 04 02:16:32.713012 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.712992    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Nov 04 02:16:32.713012 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.713010    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fp959\""
Nov 04 02:16:32.713068 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.713044    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 02:16:32.713278 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.713265    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 04 02:16:32.714589 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.714569    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"]
Nov 04 02:16:32.751036 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.751012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfkqh\" (UniqueName: \"kubernetes.io/projected/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-kube-api-access-lfkqh\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:32.751157 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.751057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:32.751157 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.751084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:32.751229 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.751175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:32.852269 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.852231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:32.852269 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.852269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:32.852497 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.852298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:32.852497 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.852345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfkqh\" (UniqueName: \"kubernetes.io/projected/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-kube-api-access-lfkqh\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:32.853044 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.853017    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:32.854735 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.854712    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:32.854735 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.854730    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:32.916592 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.916564    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfkqh\" (UniqueName: \"kubernetes.io/projected/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-kube-api-access-lfkqh\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:32.970876 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:32.970788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:33.063099 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:33.063068    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-pl5st"]
Nov 04 02:16:33.066106 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:16:33.066086    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a7f9252_6cad_4558_beb5_d30528b7be82.slice/crio-7c205fe8f4c88b574b14a6e4deb15326e680c8524420bec357d681952615c394 WatchSource:0}: Error finding container 7c205fe8f4c88b574b14a6e4deb15326e680c8524420bec357d681952615c394: Status 404 returned error can't find the container with id 7c205fe8f4c88b574b14a6e4deb15326e680c8524420bec357d681952615c394
Nov 04 02:16:33.336717 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:33.336685    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"]
Nov 04 02:16:33.340067 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:16:33.340044    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod638f2276_6417_4b5f_a0d1_5d3d0e85d63a.slice/crio-30f036cec01c80d095a3f33b16f7c47eaee6b55b9d8eff816baf8eef7498907d WatchSource:0}: Error finding container 30f036cec01c80d095a3f33b16f7c47eaee6b55b9d8eff816baf8eef7498907d: Status 404 returned error can't find the container with id 30f036cec01c80d095a3f33b16f7c47eaee6b55b9d8eff816baf8eef7498907d
Nov 04 02:16:33.483857 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:33.483823    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-pl5st" event={"ID":"4a7f9252-6cad-4558-beb5-d30528b7be82","Type":"ContainerStarted","Data":"7c205fe8f4c88b574b14a6e4deb15326e680c8524420bec357d681952615c394"}
Nov 04 02:16:33.484941 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:33.484913    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc" event={"ID":"638f2276-6417-4b5f-a0d1-5d3d0e85d63a","Type":"ContainerStarted","Data":"30f036cec01c80d095a3f33b16f7c47eaee6b55b9d8eff816baf8eef7498907d"}
Nov 04 02:16:35.493762 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:35.493727    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc" event={"ID":"638f2276-6417-4b5f-a0d1-5d3d0e85d63a","Type":"ContainerStarted","Data":"78f6e27f042d5e6cc1ba22bad5cec62fcebf837396d534e10815c8b1a725d381"}
Nov 04 02:16:35.494209 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:35.493786    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc" event={"ID":"638f2276-6417-4b5f-a0d1-5d3d0e85d63a","Type":"ContainerStarted","Data":"72d9a2466942af4d398d46d26689d4f7f4db3f4fe13acc09f422576298e818ed"}
Nov 04 02:16:35.655075 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:35.654974    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc" podStartSLOduration=1.737216488 podStartE2EDuration="3.654959212s" totalImagesPullingTime="1.917742724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:35.654396393 +0000 UTC m=+65.997689867" watchObservedRunningTime="2026-11-04 02:16:35.654959212 +0000 UTC m=+65.998252701"
Nov 04 02:16:35.977164 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:35.977078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:36.029491 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.029458    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 02:16:36.040154 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.040119    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:36.077641 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.077611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvfgz\" (UniqueName: \"kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz\") pod \"network-check-target-qnrfj\" (UID: \"f54eb55a-276b-4d34-8190-ec19c6fe20fc\") " pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:36.077808 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.077742    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:36.129748 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.129720    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 02:16:36.129977 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.129958    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 02:16:36.140349 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.140326    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:36.189999 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.189969    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 02:16:36.201835 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.201806    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvfgz\" (UniqueName: \"kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz\") pod \"network-check-target-qnrfj\" (UID: \"f54eb55a-276b-4d34-8190-ec19c6fe20fc\") " pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:36.277428 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.277392    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k925t\""
Nov 04 02:16:36.285581 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.285555    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:36.376132 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.376106    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-gsgrb\""
Nov 04 02:16:36.380868 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.380833    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-nw2cx\""
Nov 04 02:16:36.384880 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.384847    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:36.389691 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.389673    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:36.666230 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.666152    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4fs2v"]
Nov 04 02:16:36.670188 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:16:36.670159    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1cc2630_7b85_40fb_9594_56865adf9eba.slice/crio-49c2eeb3d0b106c38a447cb969c3bbfb9e8326d7acd0519cc47617ca8c141ade WatchSource:0}: Error finding container 49c2eeb3d0b106c38a447cb969c3bbfb9e8326d7acd0519cc47617ca8c141ade: Status 404 returned error can't find the container with id 49c2eeb3d0b106c38a447cb969c3bbfb9e8326d7acd0519cc47617ca8c141ade
Nov 04 02:16:36.764173 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.764142    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qnrfj"]
Nov 04 02:16:36.767510 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:16:36.767478    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54eb55a_276b_4d34_8190_ec19c6fe20fc.slice/crio-d159da075ec537d69ac51f7a2808576275da4b5917e55d31a4f68e5e01c46bef WatchSource:0}: Error finding container d159da075ec537d69ac51f7a2808576275da4b5917e55d31a4f68e5e01c46bef: Status 404 returned error can't find the container with id d159da075ec537d69ac51f7a2808576275da4b5917e55d31a4f68e5e01c46bef
Nov 04 02:16:36.783076 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:36.783051    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-msgpp"]
Nov 04 02:16:37.502829 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:37.502784    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-msgpp" event={"ID":"3e6dcb66-ce72-40ee-86fd-96d07dc4960f","Type":"ContainerStarted","Data":"7d51e8686bef1c87e1f41374916ddbd896996446df9b04948dabd417788ecfe5"}
Nov 04 02:16:37.504164 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:37.504134    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4fs2v" event={"ID":"a1cc2630-7b85-40fb-9594-56865adf9eba","Type":"ContainerStarted","Data":"49c2eeb3d0b106c38a447cb969c3bbfb9e8326d7acd0519cc47617ca8c141ade"}
Nov 04 02:16:37.505431 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:37.505397    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qnrfj" event={"ID":"f54eb55a-276b-4d34-8190-ec19c6fe20fc","Type":"ContainerStarted","Data":"d159da075ec537d69ac51f7a2808576275da4b5917e55d31a4f68e5e01c46bef"}
Nov 04 02:16:39.183276 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.183242    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"]
Nov 04 02:16:39.185911 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.185889    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.291190 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.291141    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-789pm\""
Nov 04 02:16:39.291376 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.291224    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Nov 04 02:16:39.291376 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.291305    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Nov 04 02:16:39.292804 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.292753    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"]
Nov 04 02:16:39.302778 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.302745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4473b042-87a2-4397-a283-2ac777fc838e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.302927 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.302872    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4473b042-87a2-4397-a283-2ac777fc838e-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.302927 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.302904    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztlt2\" (UniqueName: \"kubernetes.io/projected/4473b042-87a2-4397-a283-2ac777fc838e-kube-api-access-ztlt2\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.303056 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.302946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4473b042-87a2-4397-a283-2ac777fc838e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.343582 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.343553    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"]
Nov 04 02:16:39.346246 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.346223    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xt6nc"]
Nov 04 02:16:39.346355 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.346335    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.350667 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.350645    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.397698 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.397620    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"]
Nov 04 02:16:39.399655 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.399632    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Nov 04 02:16:39.400235 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.400204    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Nov 04 02:16:39.400510 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.400479    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hgns4\""
Nov 04 02:16:39.400510 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.400498    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-root\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq2rp\" (UniqueName: \"kubernetes.io/projected/64552c37-114a-47cf-8c71-cbab012174d0-kube-api-access-nq2rp\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmshk\" (UniqueName: \"kubernetes.io/projected/a222092c-b379-4b4b-a857-de3236571886-kube-api-access-xmshk\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403547    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qzhl8\""
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403582    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4473b042-87a2-4397-a283-2ac777fc838e-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a222092c-b379-4b4b-a857-de3236571886-node-exporter-textfile\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a222092c-b379-4b4b-a857-de3236571886-node-exporter-tls\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403680    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4473b042-87a2-4397-a283-2ac777fc838e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403713    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403744    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztlt2\" (UniqueName: \"kubernetes.io/projected/4473b042-87a2-4397-a283-2ac777fc838e-kube-api-access-ztlt2\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a222092c-b379-4b4b-a857-de3236571886-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403843    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/64552c37-114a-47cf-8c71-cbab012174d0-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.403971 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403861    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 04 02:16:39.404757 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.404703    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4473b042-87a2-4397-a283-2ac777fc838e-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.405312 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.403910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64552c37-114a-47cf-8c71-cbab012174d0-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.405312 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.404949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a222092c-b379-4b4b-a857-de3236571886-metrics-client-ca\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.405312 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.404976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-sys\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.405312 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.405002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a222092c-b379-4b4b-a857-de3236571886-node-exporter-accelerators-collector-config\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.405312 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.405030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-node-exporter-wtmp\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.405312 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.405060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4473b042-87a2-4397-a283-2ac777fc838e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.405312 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.405098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.411253 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.411216    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4473b042-87a2-4397-a283-2ac777fc838e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.412659 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.412612    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4473b042-87a2-4397-a283-2ac777fc838e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.470094 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.469938    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztlt2\" (UniqueName: \"kubernetes.io/projected/4473b042-87a2-4397-a283-2ac777fc838e-kube-api-access-ztlt2\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.503659 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.503625    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.505876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.505910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.505939    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-root\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.505975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq2rp\" (UniqueName: \"kubernetes.io/projected/64552c37-114a-47cf-8c71-cbab012174d0-kube-api-access-nq2rp\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmshk\" (UniqueName: \"kubernetes.io/projected/a222092c-b379-4b4b-a857-de3236571886-kube-api-access-xmshk\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a222092c-b379-4b4b-a857-de3236571886-node-exporter-textfile\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a222092c-b379-4b4b-a857-de3236571886-node-exporter-tls\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a222092c-b379-4b4b-a857-de3236571886-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/64552c37-114a-47cf-8c71-cbab012174d0-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64552c37-114a-47cf-8c71-cbab012174d0-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a222092c-b379-4b4b-a857-de3236571886-metrics-client-ca\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-sys\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.506325 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a222092c-b379-4b4b-a857-de3236571886-node-exporter-accelerators-collector-config\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.506894 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506357    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-node-exporter-wtmp\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.506894 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506515    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-node-exporter-wtmp\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.506894 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506569    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-root\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.506894 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.506858    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.507155 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.507127    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/64552c37-114a-47cf-8c71-cbab012174d0-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.507352 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.507331    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a222092c-b379-4b4b-a857-de3236571886-node-exporter-accelerators-collector-config\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.508363 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.508338    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64552c37-114a-47cf-8c71-cbab012174d0-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.508469 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.508377    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a222092c-b379-4b4b-a857-de3236571886-metrics-client-ca\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.508469 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.508456    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-sys\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.508559 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.508544    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a222092c-b379-4b4b-a857-de3236571886-node-exporter-textfile\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.511161 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.511129    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a222092c-b379-4b4b-a857-de3236571886-node-exporter-tls\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.511699 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.511668    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.512694 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.512669    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a222092c-b379-4b4b-a857-de3236571886-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.518532 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.518502    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.526583 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.526097    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4fs2v" event={"ID":"a1cc2630-7b85-40fb-9594-56865adf9eba","Type":"ContainerStarted","Data":"db5ce303990183999c7461297b849d19867d89f29f36ff85abdfa3058feedbb5"}
Nov 04 02:16:39.526583 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.526191    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4fs2v" event={"ID":"a1cc2630-7b85-40fb-9594-56865adf9eba","Type":"ContainerStarted","Data":"b28d53324bd4c70e18876fb863d91d58a3fe1fd64e7798e8615c587c12f061c9"}
Nov 04 02:16:39.571190 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.571157    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq2rp\" (UniqueName: \"kubernetes.io/projected/64552c37-114a-47cf-8c71-cbab012174d0-kube-api-access-nq2rp\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.576753 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.575706    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmshk\" (UniqueName: \"kubernetes.io/projected/a222092c-b379-4b4b-a857-de3236571886-kube-api-access-xmshk\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.666246 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.666213    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:39.672748 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.672549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:39.717537 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.717456    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4fs2v" podStartSLOduration=66.675173211 podStartE2EDuration="1m8.717406503s" totalImagesPullingTime="2.042233292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:39.71511518 +0000 UTC m=+70.058408652" watchObservedRunningTime="2026-11-04 02:16:39.717406503 +0000 UTC m=+70.060699977"
Nov 04 02:16:39.950481 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:39.950433    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"]
Nov 04 02:16:39.960186 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:16:39.955729    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4473b042_87a2_4397_a283_2ac777fc838e.slice/crio-db8442a311d92d802af5cd615c6528d4d4589e750c8d167f048aec25c421ac85 WatchSource:0}: Error finding container db8442a311d92d802af5cd615c6528d4d4589e750c8d167f048aec25c421ac85: Status 404 returned error can't find the container with id db8442a311d92d802af5cd615c6528d4d4589e750c8d167f048aec25c421ac85
Nov 04 02:16:40.075023 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:40.074980    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"]
Nov 04 02:16:40.533230 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:40.533161    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xt6nc" event={"ID":"a222092c-b379-4b4b-a857-de3236571886","Type":"ContainerStarted","Data":"3b750e5d4566332669cfd0ae382e0d4b1a0b302ff342cb3cb0b6a3d06e47a45d"}
Nov 04 02:16:40.535029 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:40.534949    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c" event={"ID":"64552c37-114a-47cf-8c71-cbab012174d0","Type":"ContainerStarted","Data":"87732c27cff64440370d8dc697d4c6e32becdd69402dc36ff3dbc2b64672e951"}
Nov 04 02:16:40.538167 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:40.538075    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7" event={"ID":"4473b042-87a2-4397-a283-2ac777fc838e","Type":"ContainerStarted","Data":"57358a2bba4f3434648dc6e1dfa35e27539c0abce01635b6528683c622b6dc76"}
Nov 04 02:16:40.538167 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:40.538108    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7" event={"ID":"4473b042-87a2-4397-a283-2ac777fc838e","Type":"ContainerStarted","Data":"4da43c7d8f9820ba6cca989437cf0d772ecc0eec951f6936f0b88ea987b4e7a6"}
Nov 04 02:16:40.538167 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:40.538125    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7" event={"ID":"4473b042-87a2-4397-a283-2ac777fc838e","Type":"ContainerStarted","Data":"db8442a311d92d802af5cd615c6528d4d4589e750c8d167f048aec25c421ac85"}
Nov 04 02:16:41.483126 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.482410    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:41.673401 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.672569    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 02:16:41.681399 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.679719    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.731043 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.731001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.731043 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.731040    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.731297 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.731062    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.731297 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.731090    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-web-config\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.731297 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.731260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.731297 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.731292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.731495 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.731316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.731495 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.731347    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.731495 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.731367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gxrn\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-kube-api-access-8gxrn\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.731495 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.731384    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-out\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.731495 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.731404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.731495 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.731420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.731495 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.731434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.832249 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.832222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.832352 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.832270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.832352 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.832298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.832352 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.832334    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.832504 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.832355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gxrn\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-kube-api-access-8gxrn\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.832504 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.832371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-out\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.832504 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.832400    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.832504 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.832427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.832504 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.832450    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.832749 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.832504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.832749 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.832528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.832749 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.832543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.832749 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.832561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-web-config\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.833667 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.833644    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.833913 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.833893    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.836343 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.836318    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-out\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.842843 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.842807    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 04 02:16:41.843048 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.842918    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 04 02:16:41.843048 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.843002    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 04 02:16:41.843185 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.843085    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 04 02:16:41.843185 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.843179    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 04 02:16:41.843283 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.843241    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 04 02:16:41.843352 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.843308    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 04 02:16:41.843462 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.843414    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bl9b9\""
Nov 04 02:16:41.843462 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.843450    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.843571 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.843481    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 04 02:16:41.843571 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.843564    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 04 02:16:41.849217 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.848972    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 02:16:41.854139 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.854116    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.856097 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.855799    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-web-config\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.856097 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.855811    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.856246 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.856163    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.856722 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.856685    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.856886 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.856863    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.856966 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.856947    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.857990 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.857967    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:41.897223 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:41.897187    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gxrn\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-kube-api-access-8gxrn\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:42.011944 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.011716    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:42.475398 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.475119    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 02:16:42.489991 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:16:42.489955    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a84a40d_70f6_4504_8e0b_6933cc89bbfa.slice/crio-b028decfb32c3d5780b789bdffd5da787661aa51f3d77712282d50cecfb37612 WatchSource:0}: Error finding container b028decfb32c3d5780b789bdffd5da787661aa51f3d77712282d50cecfb37612: Status 404 returned error can't find the container with id b028decfb32c3d5780b789bdffd5da787661aa51f3d77712282d50cecfb37612
Nov 04 02:16:42.556633 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.556578    2578 generic.go:356] "Generic (PLEG): container finished" podID="a222092c-b379-4b4b-a857-de3236571886" containerID="b83a5af2ee729173a71f934cffb3cbd494fd79e828b45ea9c5c8fc1df8cf64ed" exitCode=0
Nov 04 02:16:42.556735 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.556647    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xt6nc" event={"ID":"a222092c-b379-4b4b-a857-de3236571886","Type":"ContainerDied","Data":"b83a5af2ee729173a71f934cffb3cbd494fd79e828b45ea9c5c8fc1df8cf64ed"}
Nov 04 02:16:42.559345 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.559322    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerStarted","Data":"b028decfb32c3d5780b789bdffd5da787661aa51f3d77712282d50cecfb37612"}
Nov 04 02:16:42.562764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.561501    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qnrfj" event={"ID":"f54eb55a-276b-4d34-8190-ec19c6fe20fc","Type":"ContainerStarted","Data":"82cb308bc312f7d5f968443614c2fc16050b56582d79a72ef952ea1ae8848f3d"}
Nov 04 02:16:42.562764 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.561966    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:42.565984 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.565929    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7" event={"ID":"4473b042-87a2-4397-a283-2ac777fc838e","Type":"ContainerStarted","Data":"25cc8d1de9417c956c11a2f5d8745e0294403253d3aad3c6e2f5bfe0a9c190c5"}
Nov 04 02:16:42.700007 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.699972    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cc795fcf6-5wtjm"]
Nov 04 02:16:42.705951 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.705712    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.762084 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.762054    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 04 02:16:42.762242 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.762127    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 04 02:16:42.763011 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.762985    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 04 02:16:42.775372 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.774637    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc795fcf6-5wtjm"]
Nov 04 02:16:42.792242 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.792175    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l84rh\""
Nov 04 02:16:42.792427 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.792302    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 04 02:16:42.792427 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.792346    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 04 02:16:42.841659 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.841620    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp6hd\" (UniqueName: \"kubernetes.io/projected/c0855012-4612-4411-ba60-ef2a3139231b-kube-api-access-vp6hd\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.841659 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.841673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-oauth-serving-cert\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.841902 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.841703    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-console-config\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.841902 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.841784    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-service-ca\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.841902 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.841846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0855012-4612-4411-ba60-ef2a3139231b-tmp\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.841902 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.841889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-serving-cert\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.842096 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.841972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-oauth-config\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.881753 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.881689    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qnrfj" podStartSLOduration=67.089134826 podStartE2EDuration="1m11.881674443s" totalImagesPullingTime="4.792539617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:42.880675355 +0000 UTC m=+73.223968838" watchObservedRunningTime="2026-11-04 02:16:42.881674443 +0000 UTC m=+73.224967913"
Nov 04 02:16:42.942855 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.942818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-serving-cert\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.943032 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.942903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-oauth-config\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.943032 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.942940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp6hd\" (UniqueName: \"kubernetes.io/projected/c0855012-4612-4411-ba60-ef2a3139231b-kube-api-access-vp6hd\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.943032 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.942969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-oauth-serving-cert\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.943032 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.942996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-console-config\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.943032 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.943023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-service-ca\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.943324 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.943051    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0855012-4612-4411-ba60-ef2a3139231b-tmp\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.943528 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.943445    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0855012-4612-4411-ba60-ef2a3139231b-tmp\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.944260 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.943966    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-oauth-serving-cert\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.944260 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.944128    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-console-config\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.944260 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.944222    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-service-ca\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.946584 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.946564    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-oauth-config\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:42.946985 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:42.946965    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-serving-cert\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:43.005890 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.005857    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp6hd\" (UniqueName: \"kubernetes.io/projected/c0855012-4612-4411-ba60-ef2a3139231b-kube-api-access-vp6hd\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:43.007262 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.007211    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7" podStartSLOduration=1.9786540129999999 podStartE2EDuration="4.007194779s" totalImagesPullingTime="2.028540766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:43.006200243 +0000 UTC m=+73.349493715" watchObservedRunningTime="2026-11-04 02:16:43.007194779 +0000 UTC m=+73.350488251"
Nov 04 02:16:43.023368 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.023334    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:43.415367 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.415283    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc795fcf6-5wtjm"]
Nov 04 02:16:43.420674 ip-10-0-131-226 kubenswrapper[2578]: W1104 02:16:43.420648    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0855012_4612_4411_ba60_ef2a3139231b.slice/crio-8e0fda1747e862fc167653b7502767229cb2982fb8b5bd6569c24b46c28b8f85 WatchSource:0}: Error finding container 8e0fda1747e862fc167653b7502767229cb2982fb8b5bd6569c24b46c28b8f85: Status 404 returned error can't find the container with id 8e0fda1747e862fc167653b7502767229cb2982fb8b5bd6569c24b46c28b8f85
Nov 04 02:16:43.575707 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.575258    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xt6nc" event={"ID":"a222092c-b379-4b4b-a857-de3236571886","Type":"ContainerStarted","Data":"2a0b400ecfdaeb329c9e3eea90cf02e965a7d1d189d0405d0e48a92f78b477bd"}
Nov 04 02:16:43.575707 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.575327    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xt6nc" event={"ID":"a222092c-b379-4b4b-a857-de3236571886","Type":"ContainerStarted","Data":"92dbbdc4958e6957a754d7791a02e374c7ff08c49a7c816f682a7231f579bb3c"}
Nov 04 02:16:43.585026 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.584912    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c" event={"ID":"64552c37-114a-47cf-8c71-cbab012174d0","Type":"ContainerStarted","Data":"8c28f7d47b2db2e07d6233d83eae6419ace097d4715ebe36b24853028ff53d3c"}
Nov 04 02:16:43.585026 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.584995    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c" event={"ID":"64552c37-114a-47cf-8c71-cbab012174d0","Type":"ContainerStarted","Data":"68b99e9c641b202497a2389568a2cba84d914a44c963e7285d9f6f066cef085e"}
Nov 04 02:16:43.585026 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.585027    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c" event={"ID":"64552c37-114a-47cf-8c71-cbab012174d0","Type":"ContainerStarted","Data":"726241dce4dc8476426afcbda0d109d8d8bb67bfc666997d96f593d674a118da"}
Nov 04 02:16:43.586757 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.586704    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc795fcf6-5wtjm" event={"ID":"c0855012-4612-4411-ba60-ef2a3139231b","Type":"ContainerStarted","Data":"8e0fda1747e862fc167653b7502767229cb2982fb8b5bd6569c24b46c28b8f85"}
Nov 04 02:16:43.699635 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.699510    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xt6nc" podStartSLOduration=2.541430115 podStartE2EDuration="4.699489312s" totalImagesPullingTime="2.074779498s" totalInitContainerRuntime="83.279699ms" isStatefulPod=true podCreationTimestamp="2026-11-04 02:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:43.697540286 +0000 UTC m=+74.040833757" watchObservedRunningTime="2026-11-04 02:16:43.699489312 +0000 UTC m=+74.042782783"
Nov 04 02:16:43.830407 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.830351    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c" podStartSLOduration=2.424672846 podStartE2EDuration="4.830334885s" totalImagesPullingTime="2.405662039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:43.828001325 +0000 UTC m=+74.171294797" watchObservedRunningTime="2026-11-04 02:16:43.830334885 +0000 UTC m=+74.173628354"
Nov 04 02:16:43.979018 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.978942    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"]
Nov 04 02:16:43.981683 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:43.981656    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:44.036301 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.036231    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"]
Nov 04 02:16:44.038135 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.038106    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Nov 04 02:16:44.038250 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.038173    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fgw9c\""
Nov 04 02:16:44.054435 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.054405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l8wf\" (UniqueName: \"kubernetes.io/projected/539faf35-0294-46b3-847c-c8e33464ba7b-kube-api-access-6l8wf\") pod \"monitoring-plugin-77f4f76594-75ztr\" (UID: \"539faf35-0294-46b3-847c-c8e33464ba7b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:44.054567 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.054458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539faf35-0294-46b3-847c-c8e33464ba7b-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-75ztr\" (UID: \"539faf35-0294-46b3-847c-c8e33464ba7b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:44.155427 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.155398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l8wf\" (UniqueName: \"kubernetes.io/projected/539faf35-0294-46b3-847c-c8e33464ba7b-kube-api-access-6l8wf\") pod \"monitoring-plugin-77f4f76594-75ztr\" (UID: \"539faf35-0294-46b3-847c-c8e33464ba7b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:44.155540 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.155455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539faf35-0294-46b3-847c-c8e33464ba7b-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-75ztr\" (UID: \"539faf35-0294-46b3-847c-c8e33464ba7b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:44.158736 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.158678    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539faf35-0294-46b3-847c-c8e33464ba7b-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-75ztr\" (UID: \"539faf35-0294-46b3-847c-c8e33464ba7b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:44.224985 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.224964    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l8wf\" (UniqueName: \"kubernetes.io/projected/539faf35-0294-46b3-847c-c8e33464ba7b-kube-api-access-6l8wf\") pod \"monitoring-plugin-77f4f76594-75ztr\" (UID: \"539faf35-0294-46b3-847c-c8e33464ba7b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:44.295646 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.295415    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:44.324356 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.324325    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66b6494b5d-lk428"]
Nov 04 02:16:44.327240 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.327219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:44.386141 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.386109    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66b6494b5d-lk428"]
Nov 04 02:16:44.386919 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.386896    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fhxh5\""
Nov 04 02:16:44.387071 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.386901    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Nov 04 02:16:44.387161 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.386904    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 04 02:16:44.387161 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.386904    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Nov 04 02:16:44.387255 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.386980    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Nov 04 02:16:44.387255 ip-10-0-131-226 kubenswrapper[2578]: I1104 02:16:44.387015    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9kbhsp1bpvo1i\""
Nov 04 02:16:44.418977 ip-10-0-131-226 systemd[1]: Stopping Kubernetes Kubelet...
Nov 04 02:16:44.439050 ip-10-0-131-226 systemd[1]: kubelet.service: Deactivated successfully.
Nov 04 02:16:44.439250 ip-10-0-131-226 systemd[1]: Stopped Kubernetes Kubelet.
Nov 04 02:16:44.439460 ip-10-0-131-226 systemd[1]: kubelet.service: Consumed 3.839s CPU time.
Nov 04 02:16:44.450375 ip-10-0-131-226 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 02:16:44.526085 ip-10-0-131-226 kubenswrapper[5450]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:16:44.526085 ip-10-0-131-226 kubenswrapper[5450]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 02:16:44.526085 ip-10-0-131-226 kubenswrapper[5450]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:16:44.526085 ip-10-0-131-226 kubenswrapper[5450]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:16:44.528577 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528481    5450 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:44.528577 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528574    5450 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:44.528577 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528579    5450 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:44.528577 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528584    5450 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528588    5450 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528607    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528611    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528620    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528624    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528628    5450 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528632    5450 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528636    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528640    5450 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528644    5450 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528647    5450 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528651    5450 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528655    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528659    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528663    5450 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528667    5450 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528671    5450 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528675    5450 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:44.528855 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528679    5450 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528683    5450 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528687    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528691    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528694    5450 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528698    5450 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528703    5450 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528707    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528712    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528719    5450 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528726    5450 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528732    5450 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528737    5450 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528743    5450 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528748    5450 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528752    5450 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528764    5450 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528769    5450 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528773    5450 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:44.529802 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528778    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528782    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528786    5450 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528791    5450 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528795    5450 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528800    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528804    5450 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528808    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528813    5450 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528817    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528822    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528826    5450 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528830    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528834    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528838    5450 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528842    5450 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528847    5450 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528851    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528854    5450 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528859    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:44.530656 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528863    5450 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528868    5450 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528872    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528876    5450 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528881    5450 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528885    5450 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528890    5450 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528894    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528898    5450 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528902    5450 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528907    5450 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528912    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528917    5450 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528921    5450 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528925    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528934    5450 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528938    5450 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528942    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528947    5450 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:44.531532 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528951    5450 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528955    5450 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528959    5450 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528963    5450 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528967    5450 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528971    5450 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528976    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528980    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528984    5450 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528988    5450 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528993    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.528997    5450 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529001    5450 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529005    5450 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529010    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529014    5450 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529018    5450 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529023    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529027    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529031    5450 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:44.532373 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529038    5450 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529042    5450 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529046    5450 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529050    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529054    5450 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.529060    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530323    5450 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530335    5450 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530344    5450 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530350    5450 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530355    5450 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530359    5450 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530363    5450 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530368    5450 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530373    5450 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530378    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530383    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530388    5450 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530392    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:44.533237 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530397    5450 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530401    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530405    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530409    5450 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530414    5450 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530419    5450 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530423    5450 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530428    5450 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530432    5450 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530437    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530441    5450 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530445    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530449    5450 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530454    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530458    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530462    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530467    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530471    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530475    5450 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:44.534075 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530489    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530494    5450 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530501    5450 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530505    5450 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530509    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530514    5450 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530518    5450 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530522    5450 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530527    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530531    5450 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530535    5450 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530539    5450 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530543    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530548    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530552    5450 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530556    5450 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530561    5450 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530565    5450 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530569    5450 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530574    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:44.534886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530578    5450 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530582    5450 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530587    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530591    5450 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530611    5450 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530615    5450 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530620    5450 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530624    5450 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530628    5450 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530632    5450 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530636    5450 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530641    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530645    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530660    5450 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530666    5450 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530670    5450 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530674    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530678    5450 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530682    5450 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:44.535514 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530687    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530691    5450 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530696    5450 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530700    5450 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530705    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530709    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530716    5450 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530722    5450 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530727    5450 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530732    5450 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530736    5450 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530740    5450 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530745    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530749    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530753    5450 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530757    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530762    5450 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530766    5450 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530770    5450 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530774    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:44.535996 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530778    5450 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530782    5450 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530786    5450 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530790    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530795    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530799    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530803    5450 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530815    5450 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530819    5450 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530826    5450 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530830    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530834    5450 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530839    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530843    5450 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.530847    5450 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531683    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531694    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531698    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531703    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:44.536465 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531707    5450 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531711    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531715    5450 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531720    5450 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531724    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531728    5450 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531733    5450 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531737    5450 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531741    5450 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531745    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531749    5450 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531753    5450 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531757    5450 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531762    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531767    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531771    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531776    5450 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531780    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531785    5450 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531789    5450 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:44.537017 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531798    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531805    5450 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531812    5450 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531819    5450 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531824    5450 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531830    5450 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531834    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531841    5450 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531845    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531850    5450 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531854    5450 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531858    5450 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531863    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531867    5450 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531871    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531875    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531880    5450 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531884    5450 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531888    5450 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:44.537510 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531893    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531897    5450 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531901    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531906    5450 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531911    5450 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531916    5450 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531920    5450 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531924    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531928    5450 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531932    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531937    5450 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531942    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531946    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531951    5450 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531956    5450 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531960    5450 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531964    5450 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531968    5450 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531972    5450 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531977    5450 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:44.537973 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531983    5450 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531987    5450 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531991    5450 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.531996    5450 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532000    5450 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532005    5450 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532009    5450 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532013    5450 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532017    5450 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532021    5450 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532025    5450 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532030    5450 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532034    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532038    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532042    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532046    5450 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532050    5450 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532054    5450 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532060    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532064    5450 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:44.538472 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532068    5450 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532073    5450 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532077    5450 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532081    5450 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532085    5450 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532089    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532093    5450 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532098    5450 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532102    5450 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532107    5450 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532111    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532115    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532121    5450 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532125    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532129    5450 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532133    5450 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532138    5450 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532142    5450 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532146    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:44.538964 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532150    5450 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532154    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532160    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.532164    5450 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532300    5450 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532317    5450 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532327    5450 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532334    5450 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532342    5450 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532347    5450 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532354    5450 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532363    5450 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532368    5450 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532373    5450 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532378    5450 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532383    5450 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532388    5450 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532393    5450 flags.go:64] FLAG: --cgroup-root=""
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532397    5450 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532402    5450 flags.go:64] FLAG: --client-ca-file=""
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532407    5450 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532413    5450 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532419    5450 flags.go:64] FLAG: --cluster-domain=""
Nov 04 02:16:44.539674 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532424    5450 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532429    5450 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532434    5450 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532439    5450 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532446    5450 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532451    5450 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532456    5450 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532461    5450 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532466    5450 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532471    5450 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532475    5450 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532480    5450 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532486    5450 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532493    5450 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532497    5450 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532502    5450 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532507    5450 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532512    5450 flags.go:64] FLAG: --enable-server="true"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532516    5450 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532524    5450 flags.go:64] FLAG: --event-burst="100"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532531    5450 flags.go:64] FLAG: --event-qps="50"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532536    5450 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532541    5450 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532546    5450 flags.go:64] FLAG: --eviction-hard=""
Nov 04 02:16:44.540446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532553    5450 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532558    5450 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532563    5450 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532568    5450 flags.go:64] FLAG: --eviction-soft=""
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532573    5450 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532577    5450 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532582    5450 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532588    5450 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532610    5450 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532615    5450 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532620    5450 flags.go:64] FLAG: --feature-gates=""
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532627    5450 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532632    5450 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532637    5450 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532642    5450 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532647    5450 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532652    5450 flags.go:64] FLAG: --help="false"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532657    5450 flags.go:64] FLAG: --hostname-override="ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532662    5450 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532667    5450 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532672    5450 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532677    5450 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532683    5450 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 02:16:44.541056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532688    5450 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532693    5450 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532697    5450 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532702    5450 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532707    5450 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532714    5450 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532719    5450 flags.go:64] FLAG: --kube-reserved=""
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532724    5450 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532729    5450 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532733    5450 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532738    5450 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532743    5450 flags.go:64] FLAG: --lock-file=""
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532747    5450 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532752    5450 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532757    5450 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532766    5450 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532771    5450 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532777    5450 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532781    5450 flags.go:64] FLAG: --logging-format="text"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532786    5450 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532791    5450 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532796    5450 flags.go:64] FLAG: --manifest-url=""
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532801    5450 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532808    5450 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532814    5450 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 02:16:44.541614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532820    5450 flags.go:64] FLAG: --max-pods="110"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532825    5450 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532830    5450 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532834    5450 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532838    5450 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532843    5450 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532848    5450 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532853    5450 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532864    5450 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532869    5450 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532874    5450 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532879    5450 flags.go:64] FLAG: --pod-cidr=""
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532889    5450 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532893    5450 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532898    5450 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532903    5450 flags.go:64] FLAG: --port="10250"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532909    5450 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532914    5450 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0baaa5466bdb98294"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532919    5450 flags.go:64] FLAG: --qos-reserved=""
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532924    5450 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532929    5450 flags.go:64] FLAG: --register-node="true"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532934    5450 flags.go:64] FLAG: --register-with-taints=""
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532940    5450 flags.go:64] FLAG: --registry-burst="10"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532945    5450 flags.go:64] FLAG: --registry-qps="5"
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532949    5450 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532955    5450 flags.go:64] FLAG: --reserved-memory=""
Nov 04 02:16:44.542507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532961    5450 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532967    5450 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532972    5450 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532977    5450 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532982    5450 flags.go:64] FLAG: --runonce="false"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532986    5450 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532991    5450 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.532996    5450 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533001    5450 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533006    5450 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533011    5450 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533016    5450 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533021    5450 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533026    5450 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533030    5450 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533035    5450 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533039    5450 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533045    5450 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533051    5450 flags.go:64] FLAG: --system-cgroups=""
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533056    5450 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533064    5450 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533069    5450 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533073    5450 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533083    5450 flags.go:64] FLAG: --tls-min-version=""
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533088    5450 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 02:16:44.543157 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533093    5450 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533097    5450 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533102    5450 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533107    5450 flags.go:64] FLAG: --v="2"
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533114    5450 flags.go:64] FLAG: --version="false"
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533121    5450 flags.go:64] FLAG: --vmodule=""
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533127    5450 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.533133    5450 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533408    5450 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533423    5450 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533430    5450 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533435    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533440    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533447    5450 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533454    5450 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533459    5450 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533463    5450 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533468    5450 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533472    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533477    5450 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533482    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:44.543832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533486    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533490    5450 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533494    5450 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533498    5450 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533505    5450 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533509    5450 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533513    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533518    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533533    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533540    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533545    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533549    5450 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533555    5450 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533559    5450 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533564    5450 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533568    5450 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533572    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533576    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533581    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:44.544392 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533631    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533636    5450 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533640    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533644    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533654    5450 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533659    5450 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533663    5450 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533668    5450 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533672    5450 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533676    5450 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533680    5450 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533684    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533689    5450 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533693    5450 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533697    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533702    5450 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533706    5450 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533713    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533717    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533721    5450 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:44.544975 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533726    5450 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533730    5450 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533736    5450 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533740    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533745    5450 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533749    5450 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533754    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533758    5450 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533762    5450 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533767    5450 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533771    5450 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533776    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533780    5450 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533787    5450 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533794    5450 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533800    5450 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533806    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533811    5450 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533816    5450 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:44.545644 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533820    5450 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533825    5450 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533830    5450 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533834    5450 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533838    5450 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533842    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533846    5450 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533851    5450 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533855    5450 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533859    5450 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533865    5450 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533870    5450 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533875    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533879    5450 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533883    5450 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533889    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533894    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533898    5450 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533903    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533907    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:44.546158 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533912    5450 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533916    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533920    5450 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533925    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533929    5450 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533933    5450 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533938    5450 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533944    5450 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533948    5450 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533952    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533956    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533960    5450 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533965    5450 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533969    5450 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.533974    5450 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.534020    5450 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:16:44.546908 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534076    5450 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534084    5450 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534088    5450 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534092    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534096    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534103    5450 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534109    5450 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534116    5450 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534120    5450 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534125    5450 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534130    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534136    5450 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534140    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534144    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534149    5450 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534153    5450 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534157    5450 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534161    5450 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534166    5450 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534170    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:44.547608 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534174    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534179    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534183    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534188    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534193    5450 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534197    5450 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534202    5450 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534206    5450 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534217    5450 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534221    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534225    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534230    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534235    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534239    5450 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534244    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534248    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534252    5450 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534256    5450 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534260    5450 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534266    5450 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:44.548288 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534270    5450 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534275    5450 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534279    5450 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534285    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534291    5450 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534295    5450 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534300    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534304    5450 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534308    5450 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534312    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534317    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534321    5450 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534325    5450 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534330    5450 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534334    5450 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534338    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534343    5450 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534348    5450 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534352    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:44.548898 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534356    5450 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534360    5450 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534364    5450 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534369    5450 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534373    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534377    5450 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534384    5450 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534389    5450 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534394    5450 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534398    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534403    5450 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534407    5450 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534413    5450 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534418    5450 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534423    5450 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534427    5450 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534432    5450 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534437    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534441    5450 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:44.549394 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534445    5450 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534450    5450 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534454    5450 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534458    5450 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534465    5450 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534469    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534473    5450 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534477    5450 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534481    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534485    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534490    5450 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534494    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534499    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534503    5450 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534507    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534511    5450 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534515    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534519    5450 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534523    5450 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534527    5450 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:44.550002 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534532    5450 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534536    5450 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534541    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534545    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534549    5450 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534555    5450 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534559    5450 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.534563    5450 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.539365    5450 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.539387    5450 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.539433    5450 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.539440    5450 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539748    5450 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539760    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539765    5450 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539769    5450 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539774    5450 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539778    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539787    5450 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:44.550555 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539792    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539796    5450 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539800    5450 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539805    5450 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539810    5450 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539840    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539845    5450 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539849    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539854    5450 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539858    5450 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539863    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539867    5450 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539876    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539881    5450 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539885    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539890    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539894    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539899    5450 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539903    5450 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539907    5450 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:44.551080 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539911    5450 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539916    5450 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539922    5450 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539928    5450 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539937    5450 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539942    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539946    5450 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539951    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539955    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539959    5450 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539963    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539967    5450 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539971    5450 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539976    5450 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539980    5450 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539984    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539988    5450 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.539997    5450 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540029    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540033    5450 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:44.551603 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540038    5450 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540043    5450 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540047    5450 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540051    5450 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540056    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540060    5450 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540064    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540070    5450 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540076    5450 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540086    5450 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540092    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540096    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540100    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540104    5450 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540108    5450 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540112    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540116    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540120    5450 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540124    5450 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:44.552082 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540128    5450 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540132    5450 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540137    5450 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540146    5450 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540150    5450 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540154    5450 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540158    5450 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540162    5450 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540166    5450 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540170    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540174    5450 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540178    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540210    5450 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540215    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540218    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540259    5450 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540267    5450 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540272    5450 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540275    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540278    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:44.552561 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540281    5450 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540284    5450 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540287    5450 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540290    5450 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540293    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540295    5450 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540457    5450 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540467    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540473    5450 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540478    5450 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540483    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540488    5450 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540492    5450 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540496    5450 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540500    5450 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540503    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540507    5450 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540511    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540515    5450 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:44.553324 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540519    5450 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.540568    5450 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540824    5450 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540831    5450 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540836    5450 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540840    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540844    5450 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540847    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540850    5450 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540853    5450 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540857    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540859    5450 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540862    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540865    5450 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540867    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:44.553880 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540870    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540873    5450 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540875    5450 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540878    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540881    5450 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540883    5450 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540886    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540888    5450 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540891    5450 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540894    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540896    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540899    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540903    5450 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540907    5450 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540909    5450 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540912    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540915    5450 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540917    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540920    5450 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540922    5450 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:44.554230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540925    5450 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540928    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540930    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540933    5450 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540936    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540940    5450 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540942    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540945    5450 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540947    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540950    5450 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540952    5450 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540955    5450 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540957    5450 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540960    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540962    5450 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540965    5450 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540968    5450 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540970    5450 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540972    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540975    5450 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:44.554699 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540977    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540980    5450 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540983    5450 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540986    5450 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540988    5450 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540991    5450 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540993    5450 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540996    5450 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.540999    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541001    5450 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541004    5450 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541006    5450 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541009    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541012    5450 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541015    5450 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541018    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541020    5450 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541023    5450 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541031    5450 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:44.555169 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541034    5450 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541037    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541040    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541042    5450 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541045    5450 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541047    5450 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541050    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541052    5450 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541055    5450 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541058    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541060    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541063    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541066    5450 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541068    5450 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541071    5450 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541074    5450 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541076    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541079    5450 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541081    5450 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:44.555627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541084    5450 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541086    5450 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541089    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541091    5450 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541094    5450 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541096    5450 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541099    5450 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541101    5450 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541104    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541106    5450 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541109    5450 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541112    5450 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541114    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541122    5450 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541125    5450 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.541151    5450 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:16:44.556058 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541184    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541189    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541193    5450 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541196    5450 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541198    5450 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541201    5450 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541203    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541206    5450 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541209    5450 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541212    5450 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541215    5450 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541217    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541220    5450 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541223    5450 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541225    5450 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541228    5450 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541230    5450 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541232    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541235    5450 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:44.556427 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541237    5450 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541240    5450 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541242    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541245    5450 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541247    5450 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541250    5450 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541252    5450 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541256    5450 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541260    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541263    5450 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541265    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541274    5450 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541277    5450 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541279    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541282    5450 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541284    5450 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541287    5450 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541289    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541292    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:44.556912 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541294    5450 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541297    5450 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541300    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541302    5450 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541305    5450 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541307    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541309    5450 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541312    5450 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541314    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541317    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541319    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541323    5450 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541327    5450 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541331    5450 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541334    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541336    5450 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541339    5450 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541341    5450 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541344    5450 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:44.557537 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541346    5450 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541348    5450 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541351    5450 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541353    5450 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541356    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541358    5450 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541366    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541369    5450 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541372    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541374    5450 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541379    5450 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541382    5450 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541384    5450 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541387    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541389    5450 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541393    5450 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541396    5450 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541398    5450 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541401    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541403    5450 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:44.558449 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541405    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541408    5450 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541411    5450 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541414    5450 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541425    5450 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541429    5450 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541432    5450 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541435    5450 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541437    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541440    5450 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541442    5450 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541445    5450 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541448    5450 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541450    5450 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541453    5450 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541455    5450 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541458    5450 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541460    5450 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541462    5450 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:44.558990 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541471    5450 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541474    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541478    5450 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541482    5450 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541485    5450 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541487    5450 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541490    5450 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541492    5450 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541495    5450 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:44.541497    5450 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.541552    5450 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.542552    5450 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.542634    5450 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.542830    5450 server.go:1014] "Starting client certificate rotation"
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.542977    5450 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.543052    5450 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 02:10:30 +0000 UTC" deadline="2028-05-09 00:58:18.63063731 +0000 UTC"
Nov 04 02:16:44.559439 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.543091    5450 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13246h41m34.087549592s"
Nov 04 02:16:44.559880 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.543342    5450 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 02:16:44.559880 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.544472    5450 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 02:16:44.559880 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.545953    5450 log.go:25] "Validated CRI v1 runtime API"
Nov 04 02:16:44.559880 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.548236    5450 log.go:25] "Validated CRI v1 image API"
Nov 04 02:16:44.559880 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.548945    5450 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 02:16:44.559880 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.551123    5450 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 81455663-25c4-44d9-adf0-c91a694138cf:/dev/nvme0n1p3 cf823ccc-8f6a-4574-87db-73aa322c05e5:/dev/nvme0n1p4]
Nov 04 02:16:44.560066 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.551139    5450 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/07366ed31c7c2c5c6219bbdd53f4011474c530c801bd00e62e5299d25fede82e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/07366ed31c7c2c5c6219bbdd53f4011474c530c801bd00e62e5299d25fede82e/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0cf71b24d678ded93aaa490836053fbb19b9a46ed384e64a9550d2a1e698ceea/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0cf71b24d678ded93aaa490836053fbb19b9a46ed384e64a9550d2a1e698ceea/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/12b5708e7b013073998cf09ee262746798c0b566be1b06469233a0b3da804cc0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/12b5708e7b013073998cf09ee262746798c0b566be1b06469233a0b3da804cc0/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/135cc9a3e61287d30c813de29bf70a5fdc8d7ec126884bc23a66a741a2c6af8a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/135cc9a3e61287d30c813de29bf70a5fdc8d7ec126884bc23a66a741a2c6af8a/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/29a625a7cb60a606bb848ca30edc00d07a72230392f4d4c4399af7e8f4f33a75/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/29a625a7cb60a606bb848ca30edc00d07a72230392f4d4c4399af7e8f4f33a75/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/30f036cec01c80d095a3f33b16f7c47eaee6b55b9d8eff816baf8eef7498907d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/30f036cec01c80d095a3f33b16f7c47eaee6b55b9d8eff816baf8eef7498907d/userdata/shm major:0 minor:267 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3b750e5d4566332669cfd0ae382e0d4b1a0b302ff342cb3cb0b6a3d06e47a45d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3b750e5d4566332669cfd0ae382e0d4b1a0b302ff342cb3cb0b6a3d06e47a45d/userdata/shm major:0 minor:323 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/49c2eeb3d0b106c38a447cb969c3bbfb9e8326d7acd0519cc47617ca8c141ade/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/49c2eeb3d0b106c38a447cb969c3bbfb9e8326d7acd0519cc47617ca8c141ade/userdata/shm major:0 minor:287 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/64d451f8dac4b84a39c95c060239390585f3990fa17b2c68646cfebbfc6d8c12/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/64d451f8dac4b84a39c95c060239390585f3990fa17b2c68646cfebbfc6d8c12/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/66c4eddb3ebc8dd5e6b4eb9c6623ffdb31b3fe7f79a07222012bf55ddc8f40d9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/66c4eddb3ebc8dd5e6b4eb9c6623ffdb31b3fe7f79a07222012bf55ddc8f40d9/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/66c9caeb9a86e1175a21f98028f593989e7a1f83e255ebdc89466303af191ff4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/66c9caeb9a86e1175a21f98028f593989e7a1f83e255ebdc89466303af191ff4/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/73040b14fb366a8b4be94fdb439ae5414300f54f1dcd34099fc886eb337803d1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/73040b14fb366a8b4be94fdb439ae5414300f54f1dcd34099fc886eb337803d1/userdata/shm major:0 minor:410 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7c205fe8f4c88b574b14a6e4deb15326e680c8524420bec357d681952615c394/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7c205fe8f4c88b574b14a6e4deb15326e680c8524420bec357d681952615c394/userdata/shm major:0 minor:262 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7d51e8686bef1c87e1f41374916ddbd896996446df9b04948dabd417788ecfe5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7d51e8686bef1c87e1f41374916ddbd896996446df9b04948dabd417788ecfe5/userdata/shm major:0 minor:291 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/87732c27cff64440370d8dc697d4c6e32becdd69402dc36ff3dbc2b64672e951/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/87732c27cff64440370d8dc697d4c6e32becdd69402dc36ff3dbc2b64672e951/userdata/shm major:0 minor:321 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8e0fda1747e862fc167653b7502767229cb2982fb8b5bd6569c24b46c28b8f85/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8e0fda1747e862fc167653b7502767229cb2982fb8b5bd6569c24b46c28b8f85/userdata/shm major:0 minor:396 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9b798169d6d688d13f7c1b0156655306ac7c034ab1e914daded6649af0791f88/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9b798169d6d688d13f7c1b0156655306ac7c034ab1e914daded6649af0791f88/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b028decfb32c3d5780b789bdffd5da787661aa51f3d77712282d50cecfb37612/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b028decfb32c3d5780b789bdffd5da787661aa51f3d77712282d50cecfb37612/userdata/shm major:0 minor:344 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b634db14fce15759a5ce404a81cb61a3063f74b81f05ef30044f40c9294c9ee7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b634db14fce15759a5ce404a81cb61a3063f74b81f05ef30044f40c9294c9ee7/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bf4cc57d3ca4656b96c7f216764af99da489fb9f2454e37a8d0477799561d7e3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bf4cc57d3ca4656b96c7f216764af99da489fb9f2454e37a8d0477799561d7e3/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bfbc9be40a84196258f25527d271e2b54144b6e7a9191d48158b17f3a781952d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bfbc9be40a84196258f25527d271e2b54144b6e7a9191d48158b17f3a781952d/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c758780f59d829812e8f0d525c5be027151a8549d580f1bb5d27aab7ccddb402/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c758780f59d829812e8f0d525c5be027151a8549d580f1bb5d27aab7ccddb402/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c7a760bcd4881f8bf9bf1453c6ebf69beef396e21624d4276a2f2396150b7914/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c7a760bcd4881f8bf9bf1453c6ebf69beef396e21624d4276a2f2396150b7914/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d159da075ec537d69ac51f7a2808576275da4b5917e55d31a4f68e5e01c46bef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d159da075ec537d69ac51f7a2808576275da4b5917e55d31a4f68e5e01c46bef/userdata/shm major:0 minor:289 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/db8442a311d92d802af5cd615c6528d4d4589e750c8d167f048aec25c421ac85/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/db8442a311d92d802af5cd615c6528d4d4589e750c8d167f048aec25c421ac85/userdata/shm major:0 minor:315 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04d1e991-8105-4b6e-b079-242cfbb2ece8/volumes/kubernetes.io~projected/kube-api-access-ghph7:{mountpoint:/var/lib/kubelet/pods/04d1e991-8105-4b6e-b079-242cfbb2ece8/volumes/kubernetes.io~projected/kube-api-access-ghph7 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04d1e991-8105-4b6e-b079-242cfbb2ece8/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/04d1e991-8105-4b6e-b079-242cfbb2ece8/volumes/kubernetes.io~secret/metrics-tls major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0627c0af-c804-48a6-87bf-a9e9d27c0d48/volumes/kubernetes.io~projected/kube-api-access-xhnmh:{mountpoint:/var/lib/kubelet/pods/0627c0af-c804-48a6-87bf-a9e9d27c0d48/volumes/kubernetes.io~projected/kube-api-access-xhnmh major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0627c0af-c804-48a6-87bf-a9e9d27c0d48/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/0627c0af-c804-48a6-87bf-a9e9d27c0d48/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:196 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07e5822b-f9ff-4da7-9b1b-691bed7af623/volumes/kubernetes.io~projected/kube-api-access-zrrsx:{mountpoint:/var/lib/kubelet/pods/07e5822b-f9ff-4da7-9b1b-691bed7af623/volumes/kubernetes.io~projected/kube-api-access-zrrsx major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/090eb434-52cf-4ada-86a3-dedbd7814699/volumes/kubernetes.io~projected/kube-api-access-lt7n4:{mountpoint:/var/lib/kubelet/pods/090eb434-52cf-4ada-86a3-dedbd7814699/volumes/kubernetes.io~projected/kube-api-access-lt7n4 major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/090eb434-52cf-4ada-86a3-dedbd7814699/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/090eb434-52cf-4ada-86a3-dedbd7814699/volumes/kubernetes.io~secret/cert major:0 minor:200 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~empty-dir/config-out major:0 minor:350 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~projected/kube-api-access-8gxrn:{mountpoint:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~projected/kube-api-access-8gxrn major:0 minor:362 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~projected/tls-assets major:0 minor:360 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:354 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/config-volume major:0 minor:359 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:356 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:357 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:355 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/web-config major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/301d3a33-8043-4c7e-b2b6-af4c830ee21f/volumes/kubernetes.io~projected/kube-api-access-2p445:{mountpoint:/var/lib/kubelet/pods/301d3a33-8043-4c7e-b2b6-af4c830ee21f/volumes/kubernetes.io~projected/kube-api-access-2p445 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e6dcb66-ce72-40ee-86fd-96d07dc4960f/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/3e6dcb66-ce72-40ee-86fd-96d07dc4960f/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:281 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3ea825ae-6a0c-4858-89f7-4b992e555347/volumes/kubernetes.io~projected/kube-api-access-x8wxq:{mountpoint:/var/lib/kubelet/pods/3ea825ae-6a0c-4858-89f7-4b992e555347/volumes/kubernetes.io~projected/kube-api-access-x8wxq major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4473b042-87a2-4397-a283-2ac777fc838e/volumes/kubernetes.io~projected/kube-api-access-ztlt2:{mountpoint:/var/lib/kubelet/pods/4473b042-87a2-4397-a283-2ac777fc838e/volumes/kubernetes.io~projected/kube-api-access-ztlt2 major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4473b042-87a2-4397-a283-2ac777fc838e/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/4473b042-87a2-4397-a283-2ac777fc838e/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4473b042-87a2-4397-a283-2ac777fc838e/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/4473b042-87a2-4397-a283-2ac777fc838e/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:307 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a7f9252-6cad-4558-beb5-d30528b7be82/volumes/kubernetes.io~projected/kube-api-access-99qgd:{mountpoint:/var/lib/kubelet/pods/4a7f9252-6cad-4558-beb5-d30528b7be82/volumes/kubernetes.io~projected/kube-api-access-99qgd major:0 minor:257 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/539faf35-0294-46b3-847c-c8e33464ba7b/volumes/kubernetes.io~projected/kube-api-access-6l8wf:{mountpoint:/var/lib/kubelet/pods/539faf35-0294-46b3-847c-c8e33464ba7b/volumes/kubernetes.io~projected/kube-api-access-6l8wf major:0 minor:403 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/539faf35-0294-46b3-847c-c8e33464ba7b/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/539faf35-0294-46b3-847c-c8e33464ba7b/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:402 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5401a6e8-141f-4823-b57f-aca208b89c7a/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/5401a6e8-141f-4823-b57f-aca208b89c7a/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5401a6e8-141f-4823-b57f-aca208b89c7a/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/5401a6e8-141f-4823-b57f-aca208b89c7a/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5401a6e8-141f-4823-b57f-aca208b89c7a/volumes/kubernetes.io~projected/kube-api-access-58ngg:{mountpoint:/var/lib/kubelet/pods/5401a6e8-141f-4823-b57f-aca208b89c7a/volumes/kubernetes.io~projected/kube-api-access-58ngg major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5819bbef-1a67-4bb3-b35c-2b8409d463a1/volumes/kubernetes.io~projected/kube-api-access-5ls7h:{mountpoint:/var/lib/kubelet/pods/5819bbef-1a67-4bb3-b35c-2b8409d463a1/volumes/kubernetes.io~projected/kube-api-access-5ls7h major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5fdaac0b-352b-4199-a772-a7013fab3fe7/volumes/kubernetes.io~secret/tls-certificates:{mountpoint:/var/lib/kubelet/pods/5fdaac0b-352b-4199-a772-a7013fab3fe7/volumes/kubernetes.io~secret/tls-certificates major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/638f2276-6417-4b5f-a0d1-5d3d0e85d63a/volumes/kubernetes.io~projected/kube-api-access-lfkqh:{mountpoint:/var/lib/kubelet/pods/638f2276-6417-4b5f-a0d1-5d3d0e85d63a/volumes/kubernetes.io~projected/kube-api-access-lfkqh major:0 minor:266 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/638f2276-6417-4b5f-a0d1-5d3d0e85d63a/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/638f2276-6417-4b5f-a0d1-5d3d0e85d63a/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/638f2276-6417-4b5f-a0d1-5d3d0e85d63a/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/638f2276-6417-4b5f-a0d1-5d3d0e85d63a/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:264 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64552c37-114a-47cf-8c71-cbab012174d0/volumes/kubernetes.io~projected/kube-api-access-nq2rp:{mountpoint:/var/lib/kubelet/pods/64552c37-114a-47cf-8c71-cbab012174d0/volumes/kubernetes.io~projected/kube-api-access-nq2rp major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64552c37-114a-47cf-8c71-cbab012174d0/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/64552c37-114a-47cf-8c71-cbab012174d0/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/64552c37-114a-47cf-8c71-cbab012174d0/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/64552c37-114a-47cf-8c71-cbab012174d0/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/91cad462-1ef8-4bf5-aeca-92005dbf5393/volumes/kubernetes.io~projected/kube-api-access-vn89t:{mountpoint:/var/lib/kubelet/pods/91cad462-1ef8-4bf5-aeca-92005dbf5393/volumes/kubernetes.io~projected/kube-api-access-vn89t major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a1cc2630-7b85-40fb-9594-56865adf9eba/volumes/kubernetes.io~projected/kube-api-access-4vpxs:{mountpoint:/var/lib/kubelet/pods/a1cc2630-7b85-40fb-9594-56865adf9eba/volumes/kubernetes.io~projected/kube-api-access-4vpxs major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a1cc2630-7b85-40fb-9594-56865adf9eba/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/a1cc2630-7b85-40fb-9594-56865adf9eba/volumes/kubernetes.io~secret/metrics-certs major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a222092c-b379-4b4b-a857-de3236571886/volumes/kubernetes.io~projected/kube-api-access-xmshk:{mountpoint:/var/lib/kubelet/pods/a222092c-b379-4b4b-a857-de3236571886/volumes/kubernetes.io~projected/kube-api-access-xmshk major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a222092c-b379-4b4b-a857-de3236571886/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/a222092c-b379-4b4b-a857-de3236571886/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a222092c-b379-4b4b-a857-de3236571886/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/a222092c-b379-4b4b-a857-de3236571886/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c0855012-4612-4411-ba60-ef2a3139231b/volumes/kubernetes.io~projected/kube-api-access-vp6hd:{mountpoint:/var/lib/kubelet/pods/c0855012-4612-4411-ba60-ef2a3139231b/volumes/kubernetes.io~projected/kube-api-access-vp6hd major:0 minor:395 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c0855012-4612-4411-ba60-ef2a3139231b/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/c0855012-4612-4411-ba60-ef2a3139231b/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:387 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c0855012-4612-4411-ba60-ef2a3139231b/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/c0855012-4612-4411-ba60-ef2a3139231b/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:388 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cb687fe1-110e-4a6b-a552-9a9ed8445eb0/volumes/kubernetes.io~projected/kube-api-access-cl2xj:{mountpoint:/var/lib/kubelet/pods/cb687fe1-110e-4a6b-a552-9a9ed8445eb0/volumes/kubernetes.io~projected/kube-api-access-cl2xj major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/volumes/kubernetes.io~projected/kube-api-access-pth8s:{mountpoint:/var/lib/kubelet/pods/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/volumes/kubernetes.io~projected/kube-api-access-pth8s major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d501b5d8-6030-4871-a7f9-a352f96a4d2f/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/d501b5d8-6030-4871-a7f9-a352f96a4d2f/volumes/kubernetes.io~secret/agent-certs major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f54eb55a-276b-4d34-8190-ec19c6fe20fc/volumes/kubernetes.io~projected/kube-api-access-mvfgz:{mountpoint:/var/lib/kubelet/pods/f54eb55a-276b-4d34-8190-ec19c6fe20fc/volumes/kubernetes.io~projected/kube-api-access-mvfgz major:0 minor:286 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/7c4738ae6e9c553e577edcce829b7bb5624c1f73174ddcbe515d989da0fa85c9/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/bbddea17ba8a672ad2a244b2773844fd4533dacc4f6cf5a57f129f9951c93ebc/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/fe1ed4b008f4fc662092e75bc4a9fc01b13e0bcea4224cf2e53b3f8fcd3aade4/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-107:{mountpoint:/var/lib/containers/storage/overlay/ab5525bdda59020d867d06030784f95e9ba680ee07fe3a0bdc8f2114f6a2f102/merged major:0 minor:107 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/23e7088b771e7ef11875462415955f5bee5f72ee3e00ccbb8db5d30ed1cf8385/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/a09b916e9ac5d9fa96c77c394a37a20ac36e8bd4c1244b8851859048c582b9e9/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/bcfa7fae66ee39c61b5827e5462262c23130bd8f8472fdf738c863528c552abf/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/8d192f236fb1dca5e54a6e1b45e7b47cfa620b09486202661fcd5003c0b069f6/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/b24fa5f81faf2732c0e87af8825c5c4ade3620ebd9dec1065808b0f9c48e89b7/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/4cd6ee608152c80745efa541afce40ae962857e01cbd41593b39f1ed554927a1/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/983354624ec923ed8f187f2809bf2e122118c08523a8a1f90b50439e0ef2223f/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/537206217b0c7d4d0f9c6050fd81836a8a282f5084be0ddd78e5d60f7f3b7eab/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/0c2015c481c64f2c0f6de7895473adab8f3c1129f9702085b82b78dbc6d128ff/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/bb1389343d422eff3535e5bc25dc4e92bcce7a58957377b3de965ab4fb38c529/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/a5eee57fe2a80a4cb15244ba006eb7f4fcc1aea6a31f4b25953ebe5f26c92b89/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/cb3c9cc74c362b3cdcd03fcbba39695cbb11414c6aef5329509fb041e14899f6/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/9f3629cc594e2fcfc43cad13929782722844416138cb3df70f63e46679eafc54/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/0bb20fb7dd93e3dfffadc7e4139b6147b05f9e4e8cdca25efed5851789f114dd/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/3393dba23267607c5a67b56f6fbe678f98c152ff63ac6f0fcd8df5c86547fd5c/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-191:{mountpoint:/var/lib/containers/storage/overlay/9ba93d95d90785ebe733139c08174cefce38f0d6ef1902df23edb1c1655084cd/merged major:0 minor:191 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/f2641b14e06cc00b4721ea1df5edb4e01d1fd7ec1c31f30726cce79e833c3878/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/7207e90550c7c2d22eb3b519e3b6ccc43ddb07688feef41f0c414e7a05f5b4d9/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/6b4b58fb738557377c308dab7d046cb6292b03398d32667afde4b89a976af1c2/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/4f4e0d972ca34321bd5aa5d156b09065bb0f8bf9a6997d8906cb3506d79776fd/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-226:{mountpoint:/var/lib/containers/storage/overlay/459ba6afefd2af67a3ca8bfdaece6905d95c104e8caee87d1fabd6779d27aca0/merged major:0 minor:226 fsType:overlay blockSize:0} overlay_0-228:{mountpoint:/var/lib/containers/storage/overlay/aa91e7cab08168d448a46e2370b22189ae6ad170462c337c03fbe561ef771e8f/merged major:0 minor:228 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/d37363a6fbc10dcaab7469d7121bdc6489bd07e92b412b456e83133f204e4787/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/60916ecf0998c0c08e21aa264a3889af085fb4484b28584e6621037e7cb04e7d/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/e32a107a3e133055c48c4f4f223c296d99c0912893c90211e1f974a9cb519b62/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/851bb73c72542b927d9bacad90e303f306f1635c864ade158723acca34740fcb/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/9973be26ebab3af719459b710cbd516dacc3940b8a3f810d6906b3a3564c925b/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-269:{mountpoint:/var/lib/containers/storage/overlay/5af9ecefec438cbc958e633dbb1a20e8876a21f0c9a30b0955dd96e9a51142af/merged major:0 minor:269 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/a1ec7a8548249dc138a6fc3d82c168959a61ba9b5ae1ca3b880b365408c19b80/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/e56ab54dc9064b1ce2b43defab207b27a78a4d2333d003f60cc118a107c4cbc6/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/6a24a730ac8a5a6ab7ab132937512092abe51adc07b00a8530f944add2d8f05a/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-293:{mountpoint:/var/lib/containers/storage/overlay/4514bb2d1f892e6639e58528ef513f5b84be2b9912454d84c9113f036ab40af2/merged major:0 minor:293 fsType:overlay blockSize:0} overlay_0-295:{mountpoint:/var/lib/containers/storage/overlay/b196fc7a8bf9fdb8735e508983453baabd6bd63262e527212002d56df85235b5/merged major:0 minor:295 fsType:overlay blockSize:0} overlay_0-297:{mountpoint:/var/lib/containers/storage/overlay/a2be2c00f48d4269069aa6fdb702479ca7e84267fe63c24338d6d12b37d072d1/merged major:0 minor:297 fsType:overlay blockSize:0} overlay_0-299:{mountpoint:/var/lib/containers/storage/overlay/a1153d0b21e5d03d736e059ab0f073c0d8d5f6b7c2bfb7c1965cd57cffdc0748/merged major:0 minor:299 fsType:overlay blockSize:0} overlay_0-301:{mountpoint:/var/lib/containers/storage/overlay/d34dad553acac3f27c2165baf7cc8fe7f7c8d06a8372e8b48dbcec2b98da7c6f/merged major:0 minor:301 fsType:overlay blockSize:0} overlay_0-325:{mountpoint:/var/lib/containers/storage/overlay/38172660745e599d8357f989292969541a2a1dc77f1fa27858161a43300e79be/merged major:0 minor:325 fsType:overlay blockSize:0} overlay_0-327:{mountpoint:/var/lib/containers/storage/overlay/0cfb8dc6202e4288d119a3c19d98bd9633f0b850c3e9e1c613c0cd4b8cc27613/merged major:0 minor:327 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/811a58ae86605cb11e2418f4f616864072e6923dec77de32851a79544cec71fa/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-331:{mountpoint:/var/lib/containers/storage/overlay/c2ef6768fec542d7a53e37ae1b56993bff79d81a1804531d02a1045764361ea2/merged major:0 minor:331 fsType:overlay blockSize:0} overlay_0-337:{mountpoint:/var/lib/containers/storage/overlay/26444fbb5ee63822022cc776046b385603df01c5818dba2a637b4aa6096950ac/merged major:0 minor:337 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/73b1792dcaabaa8588b1dcb739c20876ee39147461dff952653c73e5a731798d/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-351:{mountpoint:/var/lib/containers/storage/overlay/ca59b72f088fcee4cb5c9659dc3d67a75e7a11bf906e6fa9512965f0fdb4fd8d/merged major:0 minor:351 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/260b7a7d9fff563874f6d97c0c5c6385aaf9858348f9be2d4226f8830b54e17a/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-367:{mountpoint:/var/lib/containers/storage/overlay/fab3058dc40ae3d73ed653390eb2f9f231830fd56a0483baa6d5aa3bd234db66/merged major:0 minor:367 fsType:overlay blockSize:0} overlay_0-369:{mountpoint:/var/lib/containers/storage/overlay/82c6ee2ef72b9b7a9f960bff34eb54aff4103a635d0f2bcc6dbcc6d00228c1d7/merged major:0 minor:369 fsType:overlay blockSize:0} overlay_0-375:{mountpoint:/var/lib/containers/storage/overlay/fed6f1ef06b67a80b03611b99afbffddfa6e976a5519bc7fd6a2bc7f18f8fe25/merged major:0 minor:375 fsType:overlay blockSize:0} overlay_0-377:{mountpoint:/var/lib/containers/storage/overlay/fa7c9cbd7b022fc9a25c2176d0de1ad20adce7d3c403a39dda012d56ee95d403/merged major:0 minor:377 fsType:overlay blockSize:0} overlay_0-385:{mountpoint:/var/lib/containers/storage/overlay/d3bd2c732860340ae20c725a9d85bfc75e1781dee6b6c853b0b5d2a11c8d91e9/merged major:0 minor:385 fsType:overlay blockSize:0} overlay_0-398:{mountpoint:/var/lib/containers/storage/overlay/2255181ac71aca30585f2a837b9987b2bb569d9c0f3d5e18785f2337a30ef8e4/merged major:0 minor:398 fsType:overlay blockSize:0} overlay_0-400:{mountpoint:/var/lib/containers/storage/overlay/ff990564796559721ff19cb5d706dad287a76077ed5dc7e14d4d2e4c0b7309ca/merged major:0 minor:400 fsType:overlay blockSize:0} overlay_0-45:{mountpoint:/var/lib/containers/storage/overlay/cc0eb5f1ca1b845087b35b5c75afece29d4b6abf99a03203539e0bd77992e063/merged major:0 minor:45 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/9957fe17482b56e5203fd9a79e256c986dff58a09ce54681d682d0ed8b542b92/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/906d5eb37aa34c9956a566ecc6146ed596cfb14a48562e107d56b69979b8aa71/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/de9e3d0576a6a949d137f5c57f070252a40c8300ec7b8ade2237561a3ed92948/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/34924a2ba226b331cddbc6fb15cbb6e6c34c3c58eda817a841e920e9b2249a3f/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/e9be8f75ef56805ef36195a0d25b380fac1174cd40fd48ae61fb1d71769b6796/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/00e3e8e02a3e2ac004a760eb41976e0d0dd7bb814557f6c7b1e7b642b125cf35/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/4c6d91bb2d4cff108eda90fa30b4319fbdc131a9d06ebdfa342f36bc47499b07/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/c8cbe7cf59027dabf36a2badb99176b0ad882da47e0789119c6ddfc976e8aca8/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/5b6af76d11aa1ec47d4e6550c863afb372b961a2551cdc62fd250aaea5c16d87/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/6de36862ef09715e58f6e9919db5dfd4c0424a2292c8363a381de8ebf5155121/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 04 02:16:44.560829 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.560458    5450 manager.go:217] Machine: {Timestamp:2026-11-04 02:16:44.56000522 +0000 UTC m=+0.063945705 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200382 MemoryCapacity:33164328960 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20bba444c13354a26fc8a076ea5081 SystemUUID:ec20bba4-44c1-3354-a26f-c8a076ea5081 BootID:be23f68d-728e-41ae-b560-1ff73e249624 Filesystems:[{Device:overlay_0-375 DeviceMajor:0 DeviceMinor:375 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c0855012-4612-4411-ba60-ef2a3139231b/volumes/kubernetes.io~projected/kube-api-access-vp6hd DeviceMajor:0 DeviceMinor:395 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/539faf35-0294-46b3-847c-c8e33464ba7b/volumes/kubernetes.io~projected/kube-api-access-6l8wf DeviceMajor:0 DeviceMinor:403 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/5819bbef-1a67-4bb3-b35c-2b8409d463a1/volumes/kubernetes.io~projected/kube-api-access-5ls7h DeviceMajor:0 DeviceMinor:59 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/3ea825ae-6a0c-4858-89f7-4b992e555347/volumes/kubernetes.io~projected/kube-api-access-x8wxq DeviceMajor:0 DeviceMinor:62 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9b798169d6d688d13f7c1b0156655306ac7c034ab1e914daded6649af0791f88/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/04d1e991-8105-4b6e-b079-242cfbb2ece8/volumes/kubernetes.io~projected/kube-api-access-ghph7 DeviceMajor:0 DeviceMinor:202 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-228 DeviceMajor:0 DeviceMinor:228 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4473b042-87a2-4397-a283-2ac777fc838e/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:311 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-331 DeviceMajor:0 DeviceMinor:331 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-377 DeviceMajor:0 DeviceMinor:377 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-293 DeviceMajor:0 DeviceMinor:293 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b028decfb32c3d5780b789bdffd5da787661aa51f3d77712282d50cecfb37612/userdata/shm DeviceMajor:0 DeviceMinor:344 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/66c9caeb9a86e1175a21f98028f593989e7a1f83e255ebdc89466303af191ff4/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c0855012-4612-4411-ba60-ef2a3139231b/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:387 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-107 DeviceMajor:0 DeviceMinor:107 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/301d3a33-8043-4c7e-b2b6-af4c830ee21f/volumes/kubernetes.io~projected/kube-api-access-2p445 DeviceMajor:0 DeviceMinor:67 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/64d451f8dac4b84a39c95c060239390585f3990fa17b2c68646cfebbfc6d8c12/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/07e5822b-f9ff-4da7-9b1b-691bed7af623/volumes/kubernetes.io~projected/kube-api-access-zrrsx DeviceMajor:0 DeviceMinor:61 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a1cc2630-7b85-40fb-9594-56865adf9eba/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:285 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/4473b042-87a2-4397-a283-2ac777fc838e/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:307 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/29a625a7cb60a606bb848ca30edc00d07a72230392f4d4c4399af7e8f4f33a75/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/a222092c-b379-4b4b-a857-de3236571886/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:316 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3b750e5d4566332669cfd0ae382e0d4b1a0b302ff342cb3cb0b6a3d06e47a45d/userdata/shm DeviceMajor:0 DeviceMinor:323 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c0855012-4612-4411-ba60-ef2a3139231b/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:388 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c758780f59d829812e8f0d525c5be027151a8549d580f1bb5d27aab7ccddb402/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/638f2276-6417-4b5f-a0d1-5d3d0e85d63a/volumes/kubernetes.io~projected/kube-api-access-lfkqh DeviceMajor:0 DeviceMinor:266 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/30f036cec01c80d095a3f33b16f7c47eaee6b55b9d8eff816baf8eef7498907d/userdata/shm DeviceMajor:0 DeviceMinor:267 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/a222092c-b379-4b4b-a857-de3236571886/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:313 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:361 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/3e6dcb66-ce72-40ee-86fd-96d07dc4960f/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:281 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/4473b042-87a2-4397-a283-2ac777fc838e/volumes/kubernetes.io~projected/kube-api-access-ztlt2 DeviceMajor:0 DeviceMinor:312 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/64552c37-114a-47cf-8c71-cbab012174d0/volumes/kubernetes.io~projected/kube-api-access-nq2rp DeviceMajor:0 DeviceMinor:319 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/a222092c-b379-4b4b-a857-de3236571886/volumes/kubernetes.io~projected/kube-api-access-xmshk DeviceMajor:0 DeviceMinor:320 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-226 DeviceMajor:0 DeviceMinor:226 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/db8442a311d92d802af5cd615c6528d4d4589e750c8d167f048aec25c421ac85/userdata/shm DeviceMajor:0 DeviceMinor:315 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-351 DeviceMajor:0 DeviceMinor:351 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:358 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/73040b14fb366a8b4be94fdb439ae5414300f54f1dcd34099fc886eb337803d1/userdata/shm DeviceMajor:0 DeviceMinor:410 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-45 DeviceMajor:0 DeviceMinor:45 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:354 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-297 DeviceMajor:0 DeviceMinor:297 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/638f2276-6417-4b5f-a0d1-5d3d0e85d63a/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:264 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-301 DeviceMajor:0 DeviceMinor:301 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c7a760bcd4881f8bf9bf1453c6ebf69beef396e21624d4276a2f2396150b7914/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/5401a6e8-141f-4823-b57f-aca208b89c7a/volumes/kubernetes.io~projected/kube-api-access-58ngg DeviceMajor:0 DeviceMinor:60 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/87732c27cff64440370d8dc697d4c6e32becdd69402dc36ff3dbc2b64672e951/userdata/shm DeviceMajor:0 DeviceMinor:321 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-369 DeviceMajor:0 DeviceMinor:369 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d501b5d8-6030-4871-a7f9-a352f96a4d2f/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:63 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0627c0af-c804-48a6-87bf-a9e9d27c0d48/volumes/kubernetes.io~projected/kube-api-access-xhnmh DeviceMajor:0 DeviceMinor:203 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-269 DeviceMajor:0 DeviceMinor:269 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d159da075ec537d69ac51f7a2808576275da4b5917e55d31a4f68e5e01c46bef/userdata/shm DeviceMajor:0 DeviceMinor:289 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/135cc9a3e61287d30c813de29bf70a5fdc8d7ec126884bc23a66a741a2c6af8a/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/090eb434-52cf-4ada-86a3-dedbd7814699/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:200 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-325 DeviceMajor:0 DeviceMinor:325 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:360 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8e0fda1747e862fc167653b7502767229cb2982fb8b5bd6569c24b46c28b8f85/userdata/shm DeviceMajor:0 DeviceMinor:396 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5401a6e8-141f-4823-b57f-aca208b89c7a/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/638f2276-6417-4b5f-a0d1-5d3d0e85d63a/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:265 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:355 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:359 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-385 DeviceMajor:0 DeviceMinor:385 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7c205fe8f4c88b574b14a6e4deb15326e680c8524420bec357d681952615c394/userdata/shm DeviceMajor:0 DeviceMinor:262 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f54eb55a-276b-4d34-8190-ec19c6fe20fc/volumes/kubernetes.io~projected/kube-api-access-mvfgz DeviceMajor:0 DeviceMinor:286 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-295 DeviceMajor:0 DeviceMinor:295 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/volumes/kubernetes.io~projected/kube-api-access-pth8s DeviceMajor:0 DeviceMinor:58 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/04d1e991-8105-4b6e-b079-242cfbb2ece8/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:201 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0627c0af-c804-48a6-87bf-a9e9d27c0d48/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:196 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:356 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/64552c37-114a-47cf-8c71-cbab012174d0/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:314 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/a1cc2630-7b85-40fb-9594-56865adf9eba/volumes/kubernetes.io~projected/kube-api-access-4vpxs DeviceMajor:0 DeviceMinor:66 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-191 DeviceMajor:0 DeviceMinor:191 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b634db14fce15759a5ce404a81cb61a3063f74b81f05ef30044f40c9294c9ee7/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/49c2eeb3d0b106c38a447cb969c3bbfb9e8326d7acd0519cc47617ca8c141ade/userdata/shm DeviceMajor:0 DeviceMinor:287 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:357 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:358 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-327 DeviceMajor:0 DeviceMinor:327 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-367 DeviceMajor:0 DeviceMinor:367 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5401a6e8-141f-4823-b57f-aca208b89c7a/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/64552c37-114a-47cf-8c71-cbab012174d0/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:318 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-398 DeviceMajor:0 DeviceMinor:398 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/12b5708e7b013073998cf09ee262746798c0b566be1b06469233a0b3da804cc0/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/090eb434-52cf-4ada-86a3-dedbd7814699/volumes/kubernetes.io~projected/kube-api-access-lt7n4 DeviceMajor:0 DeviceMinor:204 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-337 DeviceMajor:0 DeviceMinor:337 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7d51e8686bef1c87e1f41374916ddbd896996446df9b04948dabd417788ecfe5/userdata/shm DeviceMajor:0 DeviceMinor:291 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:350 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bfbc9be40a84196258f25527d271e2b54144b6e7a9191d48158b17f3a781952d/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/91cad462-1ef8-4bf5-aeca-92005dbf5393/volumes/kubernetes.io~projected/kube-api-access-vn89t DeviceMajor:0 DeviceMinor:65 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0cf71b24d678ded93aaa490836053fbb19b9a46ed384e64a9550d2a1e698ceea/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bf4cc57d3ca4656b96c7f216764af99da489fb9f2454e37a8d0477799561d7e3/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/539faf35-0294-46b3-847c-c8e33464ba7b/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:402 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/07366ed31c7c2c5c6219bbdd53f4011474c530c801bd00e62e5299d25fede82e/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes/kubernetes.io~projected/kube-api-access-8gxrn DeviceMajor:0 DeviceMinor:362 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-299 DeviceMajor:0 DeviceMinor:299 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5fdaac0b-352b-4199-a772-a7013fab3fe7/volumes/kubernetes.io~secret/tls-certificates DeviceMajor:0 DeviceMinor:217 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4a7f9252-6cad-4558-beb5-d30528b7be82/volumes/kubernetes.io~projected/kube-api-access-99qgd DeviceMajor:0 DeviceMinor:257 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-400 DeviceMajor:0 DeviceMinor:400 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cb687fe1-110e-4a6b-a552-9a9ed8445eb0/volumes/kubernetes.io~projected/kube-api-access-cl2xj DeviceMajor:0 DeviceMinor:64 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/66c4eddb3ebc8dd5e6b4eb9c6623ffdb31b3fe7f79a07222012bf55ddc8f40d9/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:30f036cec01c80d MacAddress:ce:47:92:cb:35:da Speed:10000 Mtu:8901} {Name:49c2eeb3d0b106c MacAddress:6a:e7:87:ae:d3:ff Speed:10000 Mtu:8901} {Name:66c4eddb3ebc8dd MacAddress:02:39:25:e7:f6:f4 Speed:10000 Mtu:8901} {Name:66c9caeb9a86e11 MacAddress:e2:42:7d:d9:51:52 Speed:10000 Mtu:8901} {Name:73040b14fb366a8 MacAddress:c6:52:aa:25:7d:55 Speed:10000 Mtu:8901} {Name:7c205fe8f4c88b5 MacAddress:9e:49:8d:54:96:bf Speed:10000 Mtu:8901} {Name:7d51e8686bef1c8 MacAddress:ee:7c:00:0f:28:80 Speed:10000 Mtu:8901} {Name:87732c27cff6444 MacAddress:da:19:ee:8d:07:95 Speed:10000 Mtu:8901} {Name:8e0fda1747e862f MacAddress:6e:64:b1:87:dd:7f Speed:10000 Mtu:8901} {Name:b028decfb32c3d5 MacAddress:ce:37:34:b2:25:3b Speed:10000 Mtu:8901} {Name:b634db14fce1575 MacAddress:c2:83:c4:c6:9a:f3 Speed:10000 Mtu:8901} {Name:bf4cc57d3ca4656 MacAddress:fe:fc:db:dc:71:2b Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:d3:de:98:eb Speed:0 Mtu:9001} {Name:br-int MacAddress:fa:0d:9d:76:68:8b Speed:0 Mtu:8901} {Name:d159da075ec537d MacAddress:de:d3:fa:f5:57:10 Speed:10000 Mtu:8901} {Name:db8442a311d92d8 MacAddress:6e:31:9d:7c:bf:6f Speed:10000 Mtu:8901} {Name:ens5 MacAddress:06:ff:d3:de:98:eb Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:ce:88:0d:a5:06:e5 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ee:61:1d:1d:7e:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164328960 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 02:16:44.561030 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.560833    5450 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 02:16:44.561030 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.560880    5450 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 02:16:44.561182 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561158    5450 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 02:16:44.561307 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561183    5450 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-226.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 02:16:44.561350 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561309    5450 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 02:16:44.561350 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561317    5450 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 02:16:44.561350 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561327    5450 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 02:16:44.561350 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561346    5450 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 02:16:44.561457 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561444    5450 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 02:16:44.561639 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561629    5450 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 02:16:44.561744 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561736    5450 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 02:16:44.561778 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561770    5450 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 02:16:44.561861 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561782    5450 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 02:16:44.561861 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561792    5450 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 02:16:44.561861 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561801    5450 kubelet.go:405] "Adding apiserver pod source"
Nov 04 02:16:44.561861 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.561809    5450 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 02:16:44.562573 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.562556    5450 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 02:16:44.562573 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.562567    5450 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 02:16:44.563177 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.563153    5450 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 02:16:44.578640 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.578620    5450 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 02:16:44.578640 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.578632    5450 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 02:16:44.578772 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.578736    5450 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 04 02:16:44.578951 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.578940    5450 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 02:16:44.578991 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.578969    5450 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 02:16:44.579074 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579065    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 02:16:44.579105 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579079    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 02:16:44.579105 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579085    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 02:16:44.579105 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579091    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 02:16:44.579105 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579099    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 02:16:44.579217 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579108    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 02:16:44.579217 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579116    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 02:16:44.579217 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579126    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 02:16:44.579217 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579137    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 02:16:44.579217 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579146    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 02:16:44.579217 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579175    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 02:16:44.579217 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579196    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 02:16:44.579404 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579224    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 02:16:44.579404 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.579231    5450 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 02:16:44.585147 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.585129    5450 server.go:1263] "Started kubelet"
Nov 04 02:16:44.585801 ip-10-0-131-226 systemd[1]: Started Kubernetes Kubelet.
Nov 04 02:16:44.586010 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.585932    5450 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 02:16:44.586624 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.585577    5450 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 02:16:44.586624 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.586395    5450 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 02:16:44.587036 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.586933    5450 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 02:16:44.590387 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.588783    5450 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 02:16:44.596080 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.596055    5450 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 02:16:44.596670 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.596589    5450 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 02:16:44.596766 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.596706    5450 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 02:10:32 +0000 UTC" deadline="2028-04-05 04:39:42.683891454 +0000 UTC"
Nov 04 02:16:44.596766 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.596730    5450 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12434h22m58.087164976s"
Nov 04 02:16:44.596867 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:16:44.596721    5450 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:16:44.596867 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.596782    5450 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 02:16:44.596867 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.596794    5450 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 02:16:44.596994 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.596916    5450 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 02:16:44.599166 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599135    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="91cad462-1ef8-4bf5-aeca-92005dbf5393" volumeName="kubernetes.io/projected/91cad462-1ef8-4bf5-aeca-92005dbf5393-kube-api-access-vn89t" seLinuxMountContext=""
Nov 04 02:16:44.599249 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599168    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a222092c-b379-4b4b-a857-de3236571886" volumeName="kubernetes.io/empty-dir/a222092c-b379-4b4b-a857-de3236571886-node-exporter-textfile" seLinuxMountContext=""
Nov 04 02:16:44.599249 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599185    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4473b042-87a2-4397-a283-2ac777fc838e" volumeName="kubernetes.io/secret/4473b042-87a2-4397-a283-2ac777fc838e-openshift-state-metrics-tls" seLinuxMountContext=""
Nov 04 02:16:44.599249 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599196    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" volumeName="kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Nov 04 02:16:44.599249 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599209    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04d1e991-8105-4b6e-b079-242cfbb2ece8" volumeName="kubernetes.io/secret/04d1e991-8105-4b6e-b079-242cfbb2ece8-metrics-tls" seLinuxMountContext=""
Nov 04 02:16:44.599249 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599220    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07e5822b-f9ff-4da7-9b1b-691bed7af623" volumeName="kubernetes.io/projected/07e5822b-f9ff-4da7-9b1b-691bed7af623-kube-api-access-zrrsx" seLinuxMountContext=""
Nov 04 02:16:44.599249 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599231    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a222092c-b379-4b4b-a857-de3236571886" volumeName="kubernetes.io/secret/a222092c-b379-4b4b-a857-de3236571886-node-exporter-tls" seLinuxMountContext=""
Nov 04 02:16:44.599249 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599243    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d501b5d8-6030-4871-a7f9-a352f96a4d2f" volumeName="kubernetes.io/secret/d501b5d8-6030-4871-a7f9-a352f96a4d2f-agent-certs" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599256    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f54eb55a-276b-4d34-8190-ec19c6fe20fc" volumeName="kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599278    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" volumeName="kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-kube-api-access-8gxrn" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599289    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="638f2276-6417-4b5f-a0d1-5d3d0e85d63a" volumeName="kubernetes.io/secret/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-prometheus-operator-tls" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599300    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1cc2630-7b85-40fb-9594-56865adf9eba" volumeName="kubernetes.io/projected/a1cc2630-7b85-40fb-9594-56865adf9eba-kube-api-access-4vpxs" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599310    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b" volumeName="kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovnkube-script-lib" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599323    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04d1e991-8105-4b6e-b079-242cfbb2ece8" volumeName="kubernetes.io/empty-dir/04d1e991-8105-4b6e-b079-242cfbb2ece8-tmp-dir" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599338    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0627c0af-c804-48a6-87bf-a9e9d27c0d48" volumeName="kubernetes.io/secret/0627c0af-c804-48a6-87bf-a9e9d27c0d48-insights-runtime-extractor-tls" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599350    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" volumeName="kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-out" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599361    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" volumeName="kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-volume" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599372    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a7f9252-6cad-4558-beb5-d30528b7be82" volumeName="kubernetes.io/empty-dir/4a7f9252-6cad-4558-beb5-d30528b7be82-tmp" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599386    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64552c37-114a-47cf-8c71-cbab012174d0" volumeName="kubernetes.io/configmap/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599398    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0855012-4612-4411-ba60-ef2a3139231b" volumeName="kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-oauth-config" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599409    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" volumeName="kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-tls-assets" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599419    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" volumeName="kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599434    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ea825ae-6a0c-4858-89f7-4b992e555347" volumeName="kubernetes.io/projected/3ea825ae-6a0c-4858-89f7-4b992e555347-kube-api-access-x8wxq" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599444    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64552c37-114a-47cf-8c71-cbab012174d0" volumeName="kubernetes.io/configmap/64552c37-114a-47cf-8c71-cbab012174d0-metrics-client-ca" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599466    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" volumeName="kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-metrics-client-ca" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599494    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e6dcb66-ce72-40ee-86fd-96d07dc4960f" volumeName="kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599506    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64552c37-114a-47cf-8c71-cbab012174d0" volumeName="kubernetes.io/projected/64552c37-114a-47cf-8c71-cbab012174d0-kube-api-access-nq2rp" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599517    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0855012-4612-4411-ba60-ef2a3139231b" volumeName="kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-oauth-serving-cert" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599541    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b" volumeName="kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovnkube-config" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599559    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="090eb434-52cf-4ada-86a3-dedbd7814699" volumeName="kubernetes.io/projected/090eb434-52cf-4ada-86a3-dedbd7814699-kube-api-access-lt7n4" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599572    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="539faf35-0294-46b3-847c-c8e33464ba7b" volumeName="kubernetes.io/secret/539faf35-0294-46b3-847c-c8e33464ba7b-monitoring-plugin-cert" seLinuxMountContext=""
Nov 04 02:16:44.599587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599584    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5819bbef-1a67-4bb3-b35c-2b8409d463a1" volumeName="kubernetes.io/empty-dir/5819bbef-1a67-4bb3-b35c-2b8409d463a1-tmp-dir" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599620    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5fdaac0b-352b-4199-a772-a7013fab3fe7" volumeName="kubernetes.io/secret/5fdaac0b-352b-4199-a772-a7013fab3fe7-tls-certificates" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599632    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="638f2276-6417-4b5f-a0d1-5d3d0e85d63a" volumeName="kubernetes.io/secret/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599644    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64552c37-114a-47cf-8c71-cbab012174d0" volumeName="kubernetes.io/secret/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599655    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07e5822b-f9ff-4da7-9b1b-691bed7af623" volumeName="kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-cni-binary-copy" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599667    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ea825ae-6a0c-4858-89f7-4b992e555347" volumeName="kubernetes.io/configmap/3ea825ae-6a0c-4858-89f7-4b992e555347-serviceca" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599680    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4473b042-87a2-4397-a283-2ac777fc838e" volumeName="kubernetes.io/secret/4473b042-87a2-4397-a283-2ac777fc838e-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599692    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a7f9252-6cad-4558-beb5-d30528b7be82" volumeName="kubernetes.io/projected/4a7f9252-6cad-4558-beb5-d30528b7be82-kube-api-access-99qgd" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599705    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5401a6e8-141f-4823-b57f-aca208b89c7a" volumeName="kubernetes.io/projected/5401a6e8-141f-4823-b57f-aca208b89c7a-kube-api-access-58ngg" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599716    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a222092c-b379-4b4b-a857-de3236571886" volumeName="kubernetes.io/configmap/a222092c-b379-4b4b-a857-de3236571886-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599729    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04d1e991-8105-4b6e-b079-242cfbb2ece8" volumeName="kubernetes.io/configmap/04d1e991-8105-4b6e-b079-242cfbb2ece8-config-volume" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599740    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07e5822b-f9ff-4da7-9b1b-691bed7af623" volumeName="kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599752    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="301d3a33-8043-4c7e-b2b6-af4c830ee21f" volumeName="kubernetes.io/configmap/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-daemon-config" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599763    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4473b042-87a2-4397-a283-2ac777fc838e" volumeName="kubernetes.io/configmap/4473b042-87a2-4397-a283-2ac777fc838e-metrics-client-ca" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599774    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1cc2630-7b85-40fb-9594-56865adf9eba" volumeName="kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599791    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0855012-4612-4411-ba60-ef2a3139231b" volumeName="kubernetes.io/projected/c0855012-4612-4411-ba60-ef2a3139231b-kube-api-access-vp6hd" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599802    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="539faf35-0294-46b3-847c-c8e33464ba7b" volumeName="kubernetes.io/projected/539faf35-0294-46b3-847c-c8e33464ba7b-kube-api-access-6l8wf" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599814    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="301d3a33-8043-4c7e-b2b6-af4c830ee21f" volumeName="kubernetes.io/configmap/301d3a33-8043-4c7e-b2b6-af4c830ee21f-cni-binary-copy" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599829    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07e5822b-f9ff-4da7-9b1b-691bed7af623" volumeName="kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599841    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" volumeName="kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-main-db" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599852    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" volumeName="kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-cluster-tls-config" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599867    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" volumeName="kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-main-tls" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599878    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a222092c-b379-4b4b-a857-de3236571886" volumeName="kubernetes.io/projected/a222092c-b379-4b4b-a857-de3236571886-kube-api-access-xmshk" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599890    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0855012-4612-4411-ba60-ef2a3139231b" volumeName="kubernetes.io/empty-dir/c0855012-4612-4411-ba60-ef2a3139231b-tmp" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599902    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5819bbef-1a67-4bb3-b35c-2b8409d463a1" volumeName="kubernetes.io/projected/5819bbef-1a67-4bb3-b35c-2b8409d463a1-kube-api-access-5ls7h" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599922    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b" volumeName="kubernetes.io/secret/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599934    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d501b5d8-6030-4871-a7f9-a352f96a4d2f" volumeName="kubernetes.io/configmap/d501b5d8-6030-4871-a7f9-a352f96a4d2f-konnectivity-ca" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599945    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0855012-4612-4411-ba60-ef2a3139231b" volumeName="kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-serving-cert" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599955    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b" volumeName="kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-env-overrides" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599967    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" volumeName="kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-web-config" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599979    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0627c0af-c804-48a6-87bf-a9e9d27c0d48" volumeName="kubernetes.io/empty-dir/0627c0af-c804-48a6-87bf-a9e9d27c0d48-data-volume" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.599990    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0627c0af-c804-48a6-87bf-a9e9d27c0d48" volumeName="kubernetes.io/projected/0627c0af-c804-48a6-87bf-a9e9d27c0d48-kube-api-access-xhnmh" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600000    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4473b042-87a2-4397-a283-2ac777fc838e" volumeName="kubernetes.io/projected/4473b042-87a2-4397-a283-2ac777fc838e-kube-api-access-ztlt2" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600012    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="638f2276-6417-4b5f-a0d1-5d3d0e85d63a" volumeName="kubernetes.io/configmap/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-metrics-client-ca" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600024    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" volumeName="kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600036    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" volumeName="kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600069    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a222092c-b379-4b4b-a857-de3236571886" volumeName="kubernetes.io/configmap/a222092c-b379-4b4b-a857-de3236571886-metrics-client-ca" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600083    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a222092c-b379-4b4b-a857-de3236571886" volumeName="kubernetes.io/secret/a222092c-b379-4b4b-a857-de3236571886-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600095    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0855012-4612-4411-ba60-ef2a3139231b" volumeName="kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-console-config" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600107    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cb687fe1-110e-4a6b-a552-9a9ed8445eb0" volumeName="kubernetes.io/projected/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-kube-api-access-cl2xj" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600119    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="090eb434-52cf-4ada-86a3-dedbd7814699" volumeName="kubernetes.io/secret/090eb434-52cf-4ada-86a3-dedbd7814699-cert" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600131    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5401a6e8-141f-4823-b57f-aca208b89c7a" volumeName="kubernetes.io/empty-dir/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-tuned" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600144    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="91cad462-1ef8-4bf5-aeca-92005dbf5393" volumeName="kubernetes.io/configmap/91cad462-1ef8-4bf5-aeca-92005dbf5393-iptables-alerter-script" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600157    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c0855012-4612-4411-ba60-ef2a3139231b" volumeName="kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-service-ca" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600169    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b" volumeName="kubernetes.io/projected/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-kube-api-access-pth8s" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600181    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="301d3a33-8043-4c7e-b2b6-af4c830ee21f" volumeName="kubernetes.io/projected/301d3a33-8043-4c7e-b2b6-af4c830ee21f-kube-api-access-2p445" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600194    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5401a6e8-141f-4823-b57f-aca208b89c7a" volumeName="kubernetes.io/empty-dir/5401a6e8-141f-4823-b57f-aca208b89c7a-tmp" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600207    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="638f2276-6417-4b5f-a0d1-5d3d0e85d63a" volumeName="kubernetes.io/projected/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-kube-api-access-lfkqh" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600218    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64552c37-114a-47cf-8c71-cbab012174d0" volumeName="kubernetes.io/secret/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-tls" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600231    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04d1e991-8105-4b6e-b079-242cfbb2ece8" volumeName="kubernetes.io/projected/04d1e991-8105-4b6e-b079-242cfbb2ece8-kube-api-access-ghph7" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600243    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0627c0af-c804-48a6-87bf-a9e9d27c0d48" volumeName="kubernetes.io/configmap/0627c0af-c804-48a6-87bf-a9e9d27c0d48-kube-rbac-proxy-cm" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600255    5450 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="64552c37-114a-47cf-8c71-cbab012174d0" volumeName="kubernetes.io/empty-dir/64552c37-114a-47cf-8c71-cbab012174d0-volume-directive-shadow" seLinuxMountContext=""
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600265    5450 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 02:16:44.600619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.600273    5450 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 02:16:44.602943 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.602928    5450 factory.go:55] Registering systemd factory
Nov 04 02:16:44.603012 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.602945    5450 factory.go:223] Registration of the systemd container factory successfully
Nov 04 02:16:44.603225 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.603210    5450 factory.go:153] Registering CRI-O factory
Nov 04 02:16:44.603300 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.603226    5450 factory.go:223] Registration of the crio container factory successfully
Nov 04 02:16:44.603357 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.603305    5450 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 02:16:44.603357 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.603326    5450 factory.go:103] Registering Raw factory
Nov 04 02:16:44.603357 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.603339    5450 manager.go:1199] Started watching for new ooms in manager
Nov 04 02:16:44.609715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.603784    5450 manager.go:319] Starting recovery of all containers
Nov 04 02:16:44.617260 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.617234    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:16:44.620655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.620631    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:16:44.623313 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.623280    5450 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 02:16:44.625046 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.624838    5450 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 02:16:44.625046 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.624861    5450 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 02:16:44.625046 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.624881    5450 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 02:16:44.625046 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:16:44.624923    5450 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 04 02:16:44.649892 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.649840    5450 generic.go:356] "Generic (PLEG): container finished" podID="07e5822b-f9ff-4da7-9b1b-691bed7af623" containerID="875da786609a51e807ab41ac45b4b7e2c60157144bcb7c67c54f9cb6d4d909cd" exitCode=0
Nov 04 02:16:44.649892 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.649889    5450 generic.go:356] "Generic (PLEG): container finished" podID="07e5822b-f9ff-4da7-9b1b-691bed7af623" containerID="f27818bdba90880dc0d14e79c995a0e255cf58b1f77baa9f30bc090be1c9d745" exitCode=0
Nov 04 02:16:44.650078 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.649900    5450 generic.go:356] "Generic (PLEG): container finished" podID="07e5822b-f9ff-4da7-9b1b-691bed7af623" containerID="e16d6cf75aef5066baf67161888845cfb3e8492e6b2ebe2efc7f7a9de0ba396b" exitCode=0
Nov 04 02:16:44.650078 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.649909    5450 generic.go:356] "Generic (PLEG): container finished" podID="07e5822b-f9ff-4da7-9b1b-691bed7af623" containerID="d346546fa98df493d75cef93ff59d1dee7ad758192a44a80d23c0e7540387f87" exitCode=0
Nov 04 02:16:44.650078 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.649916    5450 generic.go:356] "Generic (PLEG): container finished" podID="07e5822b-f9ff-4da7-9b1b-691bed7af623" containerID="8ec8fea516d34513c7e91a5770c6a5ad39b546aebbe888dd87831037bae9afca" exitCode=0
Nov 04 02:16:44.650078 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.649927    5450 generic.go:356] "Generic (PLEG): container finished" podID="07e5822b-f9ff-4da7-9b1b-691bed7af623" containerID="a7751d238699d36311f17d20bafd42ef7ebf4a6cb40258f5957dc270690e8fc2" exitCode=0
Nov 04 02:16:44.652260 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.652230    5450 generic.go:356] "Generic (PLEG): container finished" podID="a222092c-b379-4b4b-a857-de3236571886" containerID="b83a5af2ee729173a71f934cffb3cbd494fd79e828b45ea9c5c8fc1df8cf64ed" exitCode=0
Nov 04 02:16:44.663722 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.663694    5450 generic.go:356] "Generic (PLEG): container finished" podID="e10f4f4a83a7a5f20f55bc800c3b250b" containerID="ac6a65c738e8b65cebdb126c66d6ed1a9a7155fd85a066709dffc5af7010b235" exitCode=0
Nov 04 02:16:44.665757 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.665736    5450 generic.go:356] "Generic (PLEG): container finished" podID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerID="3d43875b82a609b9a572d1c1ceb6a1a5ba4244e9eeb6cfc7f5982a864ff8bc66" exitCode=0
Nov 04 02:16:44.673720 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.673697    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:16:44.674105 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.674083    5450 generic.go:356] "Generic (PLEG): container finished" podID="cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b" containerID="4fe4b73161bc83039d6c37b39c0f2f07d21c9657b49c510c87cf7df51f0268a7" exitCode=1
Nov 04 02:16:44.696846 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:16:44.696823    5450 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:16:44.701788 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.701767    5450 manager.go:324] Recovery completed
Nov 04 02:16:44.722549 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.722530    5450 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:16:44.724462 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.724437    5450 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:16:44.724568 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.724470    5450 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:16:44.724568 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.724482    5450 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:16:44.725053 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:16:44.725033    5450 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Nov 04 02:16:44.726945 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.726919    5450 cpu_manager.go:226] "Starting" policy="none"
Nov 04 02:16:44.726945 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.726942    5450 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:16:44.727054 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.726943    5450 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 02:16:44.727054 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.727038    5450 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 02:16:44.727173 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.727160    5450 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 04 02:16:44.727214 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.727173    5450 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 04 02:16:44.727214 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.727188    5450 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 04 02:16:44.727214 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.727193    5450 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 04 02:16:44.727214 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.727199    5450 policy_none.go:50] "Start"
Nov 04 02:16:44.727214 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.727207    5450 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 02:16:44.727356 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.727217    5450 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 02:16:44.727884 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.727868    5450 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:16:44.727935 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.727895    5450 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:16:44.727935 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.727905    5450 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:16:44.728538 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.728523    5450 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 04 02:16:44.728569 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.728542    5450 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 04 02:16:44.728569 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.728548    5450 policy_none.go:44] "Start"
Nov 04 02:16:44.733197 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.733170    5450 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 02:16:44.735571 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.735558    5450 manager.go:341] "Starting Device Plugin manager"
Nov 04 02:16:44.735662 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:16:44.735580    5450 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 02:16:44.735662 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.735590    5450 server.go:87] "Starting device plugin registration server"
Nov 04 02:16:44.735869 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.735858    5450 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 02:16:44.735902 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.735869    5450 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 02:16:44.736000 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.735975    5450 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 02:16:44.736167 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.736123    5450 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 02:16:44.736167 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.736165    5450 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 02:16:44.736264 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.736173    5450 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 02:16:44.737032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.736231    5450 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T02:16:44.736151204Z","UUID":"3d435a74-8a3e-4ceb-90da-269b81a894e7","Handler":null,"Name":"","Endpoint":""}
Nov 04 02:16:44.737897 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:16:44.737875    5450 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 02:16:44.737979 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:16:44.737919    5450 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-226.us-west-2.compute.internal\" not found"
Nov 04 02:16:44.738190 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.738177    5450 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 02:16:44.738262 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.738199    5450 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 02:16:44.770538 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.770511    5450 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 04 02:16:44.772364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.772293    5450 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:16:44.772364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.772295    5450 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:16:44.772572 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.772411    5450 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:16:44.836591 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.836503    5450 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:16:44.838963 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.838941    5450 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:16:44.839076 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.838977    5450 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:16:44.839076 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.838992    5450 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-226.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:16:44.839076 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.839047    5450 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:44.864815 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.864781    5450 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:16:44.925815 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.925760    5450 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"]
Nov 04 02:16:44.926453 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.926413    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal" event={"ID":"e10f4f4a83a7a5f20f55bc800c3b250b","Type":"ContainerStarted","Data":"eecd6d6828dc14da9f3204e1fdd1e5e79c233bf33eeafdb075a9ecccd93a86ed"}
Nov 04 02:16:44.926568 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.926457    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal" event={"ID":"e10f4f4a83a7a5f20f55bc800c3b250b","Type":"ContainerDied","Data":"ac6a65c738e8b65cebdb126c66d6ed1a9a7155fd85a066709dffc5af7010b235"}
Nov 04 02:16:44.926568 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.926476    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal" event={"ID":"e10f4f4a83a7a5f20f55bc800c3b250b","Type":"ContainerStarted","Data":"c7a760bcd4881f8bf9bf1453c6ebf69beef396e21624d4276a2f2396150b7914"}
Nov 04 02:16:44.926568 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.926483    5450 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:44.926568 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.926521    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal" event={"ID":"68f285f0cd89b6c329b3b82af5b728f4","Type":"ContainerStarted","Data":"e0854c25777e046587cd6605d2c9db9708dec88103a645dfa57cb060f6109921"}
Nov 04 02:16:44.926568 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.926539    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal" event={"ID":"68f285f0cd89b6c329b3b82af5b728f4","Type":"ContainerStarted","Data":"bfbc9be40a84196258f25527d271e2b54144b6e7a9191d48158b17f3a781952d"}
Nov 04 02:16:44.926784 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.926640    5450 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:44.958992 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.958964    5450 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:44.959106 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.959030    5450 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:44.990673 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.990649    5450 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:16:44.990807 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:16:44.990712    5450 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:44.991728 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:44.991702    5450 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:16:44.991818 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:16:44.991744    5450 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.072741 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.072710    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e10f4f4a83a7a5f20f55bc800c3b250b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"e10f4f4a83a7a5f20f55bc800c3b250b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.072883 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.072744    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e10f4f4a83a7a5f20f55bc800c3b250b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"e10f4f4a83a7a5f20f55bc800c3b250b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.072883 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.072810    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68f285f0cd89b6c329b3b82af5b728f4-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"68f285f0cd89b6c329b3b82af5b728f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.173650 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.173553    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e10f4f4a83a7a5f20f55bc800c3b250b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"e10f4f4a83a7a5f20f55bc800c3b250b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.173650 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.173573    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e10f4f4a83a7a5f20f55bc800c3b250b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"e10f4f4a83a7a5f20f55bc800c3b250b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.173816 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.173648    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68f285f0cd89b6c329b3b82af5b728f4-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"68f285f0cd89b6c329b3b82af5b728f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.173816 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.173670    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e10f4f4a83a7a5f20f55bc800c3b250b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"e10f4f4a83a7a5f20f55bc800c3b250b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.173816 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.173707    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e10f4f4a83a7a5f20f55bc800c3b250b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"e10f4f4a83a7a5f20f55bc800c3b250b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.173816 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.173734    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68f285f0cd89b6c329b3b82af5b728f4-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal\" (UID: \"68f285f0cd89b6c329b3b82af5b728f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.562472 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.562440    5450 apiserver.go:52] "Watching apiserver"
Nov 04 02:16:45.689441 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.689403    5450 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.689639 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.689520    5450 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.710901 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.710877    5450 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 02:16:45.711714 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.711688    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7hk2x","kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal","openshift-dns/node-resolver-42xbt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal","openshift-multus/multus-additional-cni-plugins-qchvs","openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh","openshift-ovn-kubernetes/ovnkube-node-2cfx8","openshift-console/console-6cc795fcf6-5wtjm","openshift-ingress-canary/ingress-canary-29hdm","openshift-monitoring/metrics-server-66b6494b5d-lk428","openshift-cluster-node-tuning-operator/tuned-c72gg","openshift-monitoring/node-exporter-xt6nc","openshift-multus/network-metrics-daemon-4fs2v","openshift-network-operator/iptables-alerter-96gx5","openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc","kube-system/global-pull-secret-syncer-msgpp","openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c","openshift-multus/multus-cq8lx","openshift-network-diagnostics/network-check-target-qnrfj","openshift-monitoring/alertmanager-main-0","kube-system/konnectivity-agent-n9lpj","openshift-image-registry/node-ca-4628r","openshift-monitoring/monitoring-plugin-77f4f76594-75ztr","openshift-insights/insights-runtime-extractor-xq8jl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk","openshift-console/downloads-6dd789c8b7-pl5st","openshift-monitoring/telemeter-client-db9dc59b6-fbdkd","openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"]
Nov 04 02:16:45.724256 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.724236    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:45.724842 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.724823    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.728103 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.728085    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.749298 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.749269    5450 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:16:45.749405 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:16:45.749320    5450 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.756117 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.756097    5450 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:16:45.756175 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:16:45.756139    5450 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.us-west-2.compute.internal"
Nov 04 02:16:45.764104 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.764068    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 02:16:45.764104 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.764079    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 02:16:45.764104 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.764093    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:16:45.764271 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.764144    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 02:16:45.764271 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.764144    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 02:16:45.764963 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.764948    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 02:16:45.764963 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.764954    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 02:16:45.765357 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.765343    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 02:16:45.767535 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.767519    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 02:16:45.767607 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.767531    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 02:16:45.767607 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.767552    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 02:16:45.767779 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.767760    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 02:16:45.767906 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.767837    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-275xk\""
Nov 04 02:16:45.767906 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.767896    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 02:16:45.768019 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.767908    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h2f9b\""
Nov 04 02:16:45.768019 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.767950    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-n8x9d\""
Nov 04 02:16:45.768019 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.767955    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k925t\""
Nov 04 02:16:45.768019 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.767973    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 02:16:45.768019 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.767983    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 02:16:45.768019 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.767991    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zjj5c\""
Nov 04 02:16:45.768682 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.768660    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6q9ld\""
Nov 04 02:16:45.768756 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.768736    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 02:16:45.769045 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.769028    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 02:16:45.769116 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.769044    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 02:16:45.769167 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.769140    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 02:16:45.769167 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.769156    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 02:16:45.769262 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.769251    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 02:16:45.769342 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.769329    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 02:16:45.795725 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.795682    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 02:16:45.795725 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.795706    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 02:16:45.795725 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.795720    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 02:16:45.795896 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.795682    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 02:16:45.795896 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.795713    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:16:45.795896 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.795706    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 02:16:45.795896 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.795748    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 02:16:45.795896 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.795806    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 02:16:45.800899 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.800871    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 02:16:45.801063 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.801046    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Nov 04 02:16:45.801239 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.801221    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 02:16:45.801394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.801379    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 04 02:16:45.801515 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.801498    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 04 02:16:45.801609 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.801585    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 04 02:16:45.804226 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.804200    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 02:16:45.804301 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.804241    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 04 02:16:45.804393 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.804379    5450 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 02:16:45.810962 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.810945    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 04 02:16:45.811001 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.810949    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 02:16:45.811001 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.810985    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Nov 04 02:16:45.811001 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.810998    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 04 02:16:45.812030 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.812013    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 02:16:45.812087 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.812042    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 04 02:16:45.812087 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.812049    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 04 02:16:45.812087 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.812064    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 02:16:45.812087 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.812045    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 04 02:16:45.812792 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.812746    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Nov 04 02:16:45.812792 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.812775    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 02:16:45.820801 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.820779    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Nov 04 02:16:45.869378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.869345    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 04 02:16:45.869552 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.869475    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Nov 04 02:16:45.869552 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.869522    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Nov 04 02:16:45.869654 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.869641    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Nov 04 02:16:45.870015 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.869998    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 04 02:16:45.870130 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870041    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Nov 04 02:16:45.870189 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870136    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 04 02:16:45.870189 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870147    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fp959\""
Nov 04 02:16:45.870357 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870308    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Nov 04 02:16:45.870405 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870359    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-789pm\""
Nov 04 02:16:45.870437 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870403    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fgw9c\""
Nov 04 02:16:45.870510 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870495    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zrn9f\""
Nov 04 02:16:45.870589 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870513    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 02:16:45.870589 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870526    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m589d\""
Nov 04 02:16:45.870589 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870526    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wpmk6\""
Nov 04 02:16:45.870737 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870619    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 04 02:16:45.870737 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870638    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Nov 04 02:16:45.870737 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870674    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 04 02:16:45.870737 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870674    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 04 02:16:45.870977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870783    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Nov 04 02:16:45.870977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870811    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 04 02:16:45.870977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870855    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-v7b9k\""
Nov 04 02:16:45.870977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870896    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 04 02:16:45.870977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870904    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bl9b9\""
Nov 04 02:16:45.870977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870857    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 04 02:16:45.870977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870925    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Nov 04 02:16:45.870977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870937    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Nov 04 02:16:45.870977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.870945    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 02:16:45.871208 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871016    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 02:16:45.871208 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871016    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-nw2cx\""
Nov 04 02:16:45.871208 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871181    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 02:16:45.871285 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871213    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Nov 04 02:16:45.871407 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871391    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l84rh\""
Nov 04 02:16:45.871482 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871414    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qzhl8\""
Nov 04 02:16:45.871482 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871422    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-xp28c\""
Nov 04 02:16:45.871482 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871455    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fhxh5\""
Nov 04 02:16:45.871482 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871418    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cdqxv\""
Nov 04 02:16:45.871482 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871474    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Nov 04 02:16:45.871482 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871478    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Nov 04 02:16:45.871715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871454    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Nov 04 02:16:45.871715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871483    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n2j4c\""
Nov 04 02:16:45.871715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871500    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pszzf\""
Nov 04 02:16:45.871715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871528    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 04 02:16:45.871715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871540    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-gsgrb\""
Nov 04 02:16:45.871715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871548    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kddl5\""
Nov 04 02:16:45.871715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871571    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 04 02:16:45.871715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871581    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-px2wd\""
Nov 04 02:16:45.871715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871609    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 04 02:16:45.871715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871572    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 02:16:45.871715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871631    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Nov 04 02:16:45.871715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.871722    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hgns4\""
Nov 04 02:16:45.872149 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.872131    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9kbhsp1bpvo1i\""
Nov 04 02:16:45.879025 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.878978    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-registration-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.879025 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879018    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5819bbef-1a67-4bb3-b35c-2b8409d463a1-hosts-file\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:16:45.879238 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879049    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.879238 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879074    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db573293-5d41-4d1c-8f00-c15dec39eb51-serving-certs-ca-bundle\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.879238 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879105    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovnkube-config\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.879238 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879134    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-system-cni-dir\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.879238 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879160    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0627c0af-c804-48a6-87bf-a9e9d27c0d48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:45.879238 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879176    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfkqh\" (UniqueName: \"kubernetes.io/projected/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-kube-api-access-lfkqh\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:45.879238 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879194    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/301d3a33-8043-4c7e-b2b6-af4c830ee21f-cni-binary-copy\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.879238 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879209    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-modprobe-d\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.879238 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879223    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zz52\" (UniqueName: \"kubernetes.io/projected/db573293-5d41-4d1c-8f00-c15dec39eb51-kube-api-access-5zz52\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879248    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-system-cni-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879261    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-conf-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879277    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5401a6e8-141f-4823-b57f-aca208b89c7a-tmp\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879292    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l8wf\" (UniqueName: \"kubernetes.io/projected/539faf35-0294-46b3-847c-c8e33464ba7b-kube-api-access-6l8wf\") pod \"monitoring-plugin-77f4f76594-75ztr\" (UID: \"539faf35-0294-46b3-847c-c8e33464ba7b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879306    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-cni-netd\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879327    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ef999918-fa31-440e-ba39-f20feca4f4ab-metrics-server-audit-profiles\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879349    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysctl-d\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879362    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-sys\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879375    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-slash\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879390    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879411    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef999918-fa31-440e-ba39-f20feca4f4ab-client-ca-bundle\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879430    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-out\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879444    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/090eb434-52cf-4ada-86a3-dedbd7814699-cert\") pod \"ingress-canary-29hdm\" (UID: \"090eb434-52cf-4ada-86a3-dedbd7814699\") " pod="openshift-ingress-canary/ingress-canary-29hdm"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879458    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879479    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879493    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879507    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ea825ae-6a0c-4858-89f7-4b992e555347-serviceca\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879522    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-kubelet\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879536    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879554    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-ovn\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879574    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879607    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879623    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhnmh\" (UniqueName: \"kubernetes.io/projected/0627c0af-c804-48a6-87bf-a9e9d27c0d48-kube-api-access-xhnmh\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879641    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-cni-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879655    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-cni-bin\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879669    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ef999918-fa31-440e-ba39-f20feca4f4ab-audit-log\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879687    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879717    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-service-ca\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879734    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-run-netns\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879749    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovn-node-metrics-cert\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879764    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879778    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-hostroot\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879795    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4473b042-87a2-4397-a283-2ac777fc838e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879812    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ef999918-fa31-440e-ba39-f20feca4f4ab-secret-metrics-server-client-certs\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879828    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5819bbef-1a67-4bb3-b35c-2b8409d463a1-tmp-dir\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:16:45.879838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879843    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5fdaac0b-352b-4199-a772-a7013fab3fe7-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-xsflh\" (UID: \"5fdaac0b-352b-4199-a772-a7013fab3fe7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879866    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-root\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879889    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a222092c-b379-4b4b-a857-de3236571886-metrics-client-ca\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879908    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp6hd\" (UniqueName: \"kubernetes.io/projected/c0855012-4612-4411-ba60-ef2a3139231b-kube-api-access-vp6hd\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879923    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/04d1e991-8105-4b6e-b079-242cfbb2ece8-config-volume\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879940    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztlt2\" (UniqueName: \"kubernetes.io/projected/4473b042-87a2-4397-a283-2ac777fc838e-kube-api-access-ztlt2\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879962    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ls7h\" (UniqueName: \"kubernetes.io/projected/5819bbef-1a67-4bb3-b35c-2b8409d463a1-kube-api-access-5ls7h\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879980    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a222092c-b379-4b4b-a857-de3236571886-node-exporter-accelerators-collector-config\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.879998    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db573293-5d41-4d1c-8f00-c15dec39eb51-telemeter-trusted-ca-bundle\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880012    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0627c0af-c804-48a6-87bf-a9e9d27c0d48-crio-socket\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880028    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880049    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880084    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-socket-dir-parent\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880102    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d501b5d8-6030-4871-a7f9-a352f96a4d2f-konnectivity-ca\") pod \"konnectivity-agent-n9lpj\" (UID: \"d501b5d8-6030-4871-a7f9-a352f96a4d2f\") " pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880119    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64552c37-114a-47cf-8c71-cbab012174d0-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880139    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-etc-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880156    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a222092c-b379-4b4b-a857-de3236571886-node-exporter-textfile\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880172    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d501b5d8-6030-4871-a7f9-a352f96a4d2f-agent-certs\") pod \"konnectivity-agent-n9lpj\" (UID: \"d501b5d8-6030-4871-a7f9-a352f96a4d2f\") " pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880189    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58ngg\" (UniqueName: \"kubernetes.io/projected/5401a6e8-141f-4823-b57f-aca208b89c7a-kube-api-access-58ngg\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880205    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-oauth-serving-cert\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880221    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/db573293-5d41-4d1c-8f00-c15dec39eb51-secret-telemeter-client\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880238    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vpxs\" (UniqueName: \"kubernetes.io/projected/a1cc2630-7b85-40fb-9594-56865adf9eba-kube-api-access-4vpxs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880259    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrsx\" (UniqueName: \"kubernetes.io/projected/07e5822b-f9ff-4da7-9b1b-691bed7af623-kube-api-access-zrrsx\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880276    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef999918-fa31-440e-ba39-f20feca4f4ab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880293    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gxrn\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-kube-api-access-8gxrn\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880308    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0855012-4612-4411-ba60-ef2a3139231b-tmp\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880323    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-cnibin\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880340    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880355    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvfgz\" (UniqueName: \"kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz\") pod \"network-check-target-qnrfj\" (UID: \"f54eb55a-276b-4d34-8190-ec19c6fe20fc\") " pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880373    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl2xj\" (UniqueName: \"kubernetes.io/projected/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-kube-api-access-cl2xj\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880387    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysconfig\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880405    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880422    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-console-config\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880438    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-multus-certs\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880454    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-kubelet-config\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880469    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db573293-5d41-4d1c-8f00-c15dec39eb51-metrics-client-ca\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880486    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pth8s\" (UniqueName: \"kubernetes.io/projected/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-kube-api-access-pth8s\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880502    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4473b042-87a2-4397-a283-2ac777fc838e-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880518    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-etc-selinux\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880536    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a222092c-b379-4b4b-a857-de3236571886-node-exporter-tls\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880553    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880570    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-env-overrides\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880587    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-socket-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880625    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99qgd\" (UniqueName: \"kubernetes.io/projected/4a7f9252-6cad-4558-beb5-d30528b7be82-kube-api-access-99qgd\") pod \"downloads-6dd789c8b7-pl5st\" (UID: \"4a7f9252-6cad-4558-beb5-d30528b7be82\") " pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880653    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539faf35-0294-46b3-847c-c8e33464ba7b-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-75ztr\" (UID: \"539faf35-0294-46b3-847c-c8e33464ba7b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880719    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-systemd\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880755    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt7n4\" (UniqueName: \"kubernetes.io/projected/090eb434-52cf-4ada-86a3-dedbd7814699-kube-api-access-lt7n4\") pod \"ingress-canary-29hdm\" (UID: \"090eb434-52cf-4ada-86a3-dedbd7814699\") " pod="openshift-ingress-canary/ingress-canary-29hdm"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880784    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880814    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p445\" (UniqueName: \"kubernetes.io/projected/301d3a33-8043-4c7e-b2b6-af4c830ee21f-kube-api-access-2p445\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880823    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0855012-4612-4411-ba60-ef2a3139231b-tmp\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880840    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ea825ae-6a0c-4858-89f7-4b992e555347-host\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.880866    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-host\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.881027    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5fdaac0b-352b-4199-a772-a7013fab3fe7-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-xsflh\" (UID: \"5fdaac0b-352b-4199-a772-a7013fab3fe7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.881079    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.881361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.881312    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.881538    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.881633    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.881728    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a222092c-b379-4b4b-a857-de3236571886-metrics-client-ca\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.881758    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-console-config\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.881804    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-service-ca\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.881920    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/04d1e991-8105-4b6e-b079-242cfbb2ece8-config-volume\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.882042    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovn-node-metrics-cert\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.882250    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.882260    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4473b042-87a2-4397-a283-2ac777fc838e-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.882443    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4473b042-87a2-4397-a283-2ac777fc838e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.882502    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.882684    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/539faf35-0294-46b3-847c-c8e33464ba7b-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-75ztr\" (UID: \"539faf35-0294-46b3-847c-c8e33464ba7b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.882712    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-oauth-serving-cert\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.882739    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5819bbef-1a67-4bb3-b35c-2b8409d463a1-tmp-dir\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.882984    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883071    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883154    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1cc2630-7b85-40fb-9594-56865adf9eba-metrics-certs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883163    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovnkube-config\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.883347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883204    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-out\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.884032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883359    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0627c0af-c804-48a6-87bf-a9e9d27c0d48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:45.884032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883396    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/090eb434-52cf-4ada-86a3-dedbd7814699-cert\") pod \"ingress-canary-29hdm\" (UID: \"090eb434-52cf-4ada-86a3-dedbd7814699\") " pod="openshift-ingress-canary/ingress-canary-29hdm"
Nov 04 02:16:45.884032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883438    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a222092c-b379-4b4b-a857-de3236571886-node-exporter-tls\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.884032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883580    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-env-overrides\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.884032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883712    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-original-pull-secret\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:45.884032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883733    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5401a6e8-141f-4823-b57f-aca208b89c7a-tmp\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.884032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883756    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/301d3a33-8043-4c7e-b2b6-af4c830ee21f-cni-binary-copy\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.884032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883792    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.884032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883828    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-serving-cert\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.884032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883867    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-node-log\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.884032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883897    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-cni-binary-copy\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.884032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883928    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.884032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.883945    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884111    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d501b5d8-6030-4871-a7f9-a352f96a4d2f-konnectivity-ca\") pod \"konnectivity-agent-n9lpj\" (UID: \"d501b5d8-6030-4871-a7f9-a352f96a4d2f\") " pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884142    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmshk\" (UniqueName: \"kubernetes.io/projected/a222092c-b379-4b4b-a857-de3236571886-kube-api-access-xmshk\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884143    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64552c37-114a-47cf-8c71-cbab012174d0-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884182    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/db573293-5d41-4d1c-8f00-c15dec39eb51-federate-client-tls\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884202    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a222092c-b379-4b4b-a857-de3236571886-node-exporter-textfile\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884205    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a222092c-b379-4b4b-a857-de3236571886-node-exporter-accelerators-collector-config\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884215    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-var-lib-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884137    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884283    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884390    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d501b5d8-6030-4871-a7f9-a352f96a4d2f-agent-certs\") pod \"konnectivity-agent-n9lpj\" (UID: \"d501b5d8-6030-4871-a7f9-a352f96a4d2f\") " pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884469    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884503    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-cni-binary-copy\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884508    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-cni-bin\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884556    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/64552c37-114a-47cf-8c71-cbab012174d0-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884643    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-run\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.884655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884651    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/64552c37-114a-47cf-8c71-cbab012174d0-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:45.885291 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884700    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-sys\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.885291 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884719    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-serving-cert\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.885291 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884731    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-dbus\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:45.885291 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884805    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn89t\" (UniqueName: \"kubernetes.io/projected/91cad462-1ef8-4bf5-aeca-92005dbf5393-kube-api-access-vn89t\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:16:45.885291 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884871    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ea825ae-6a0c-4858-89f7-4b992e555347-serviceca\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:16:45.885291 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.884874    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:45.885291 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885012    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.885291 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885120    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a7f9252-6cad-4558-beb5-d30528b7be82-tmp\") pod \"downloads-6dd789c8b7-pl5st\" (UID: \"4a7f9252-6cad-4558-beb5-d30528b7be82\") " pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:16:45.885291 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885162    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4473b042-87a2-4397-a283-2ac777fc838e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:45.885291 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885227    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ef999918-fa31-440e-ba39-f20feca4f4ab-secret-metrics-server-tls\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.885291 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885248    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.885291 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885265    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-systemd\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.885856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885292    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64552c37-114a-47cf-8c71-cbab012174d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:45.885856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885375    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a7f9252-6cad-4558-beb5-d30528b7be82-tmp\") pod \"downloads-6dd789c8b7-pl5st\" (UID: \"4a7f9252-6cad-4558-beb5-d30528b7be82\") " pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:16:45.885856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885298    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/db573293-5d41-4d1c-8f00-c15dec39eb51-telemeter-client-tls\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.885856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885714    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-etc-kubernetes\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.885856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885754    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-cnibin\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.885856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885780    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bkm4\" (UniqueName: \"kubernetes.io/projected/ef999918-fa31-440e-ba39-f20feca4f4ab-kube-api-access-7bkm4\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.885856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885778    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4473b042-87a2-4397-a283-2ac777fc838e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:45.885856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885802    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/07e5822b-f9ff-4da7-9b1b-691bed7af623-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.885856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885821    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-lib-modules\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.885856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885852    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-tuned\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.886141 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885901    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.886141 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885935    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-tuned\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.886141 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.885967    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghph7\" (UniqueName: \"kubernetes.io/projected/04d1e991-8105-4b6e-b079-242cfbb2ece8-kube-api-access-ghph7\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:45.886141 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886002    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq2rp\" (UniqueName: \"kubernetes.io/projected/64552c37-114a-47cf-8c71-cbab012174d0-kube-api-access-nq2rp\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:45.886141 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886090    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8wxq\" (UniqueName: \"kubernetes.io/projected/3ea825ae-6a0c-4858-89f7-4b992e555347-kube-api-access-x8wxq\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:16:45.886141 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886121    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.886370 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886145    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d1e991-8105-4b6e-b079-242cfbb2ece8-tmp-dir\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:45.886370 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886253    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.886370 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886301    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db573293-5d41-4d1c-8f00-c15dec39eb51-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.886370 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886305    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.886370 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886325    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04d1e991-8105-4b6e-b079-242cfbb2ece8-tmp-dir\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:45.886574 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886386    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91cad462-1ef8-4bf5-aeca-92005dbf5393-iptables-alerter-script\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:16:45.886574 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886453    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-sys-fs\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.886574 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886522    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.886574 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886563    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovnkube-script-lib\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.886771 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886668    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91cad462-1ef8-4bf5-aeca-92005dbf5393-iptables-alerter-script\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:16:45.886771 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886691    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-daemon-config\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.886858 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886837    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.886909 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886848    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-ovnkube-script-lib\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.886964 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886908    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-device-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.886964 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886937    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-var-lib-kubelet\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.887054 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886982    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a222092c-b379-4b4b-a857-de3236571886-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.887054 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.886995    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-daemon-config\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.887054 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887013    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-oauth-config\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.887198 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887056    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91cad462-1ef8-4bf5-aeca-92005dbf5393-host-slash\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:16:45.887198 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887088    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0627c0af-c804-48a6-87bf-a9e9d27c0d48-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:45.887198 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887127    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-kubelet\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.887198 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887152    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-systemd-units\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.887198 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887179    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-node-exporter-wtmp\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.887376 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887204    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysctl-conf\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.887376 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887205    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-oauth-config\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.887376 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887277    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.887492 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887410    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0627c0af-c804-48a6-87bf-a9e9d27c0d48-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:45.887492 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887452    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.887492 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887464    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/04d1e991-8105-4b6e-b079-242cfbb2ece8-metrics-tls\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:45.887665 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887493    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a222092c-b379-4b4b-a857-de3236571886-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.887665 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887495    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-cni-multus\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.887665 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887630    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-kubernetes\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.887795 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887715    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0627c0af-c804-48a6-87bf-a9e9d27c0d48-data-volume\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:45.887795 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887745    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-k8s-cni-cncf-io\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.887795 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887778    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-netns\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.887939 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887818    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/04d1e991-8105-4b6e-b079-242cfbb2ece8-metrics-tls\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:45.887939 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887824    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-web-config\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.887939 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887837    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0627c0af-c804-48a6-87bf-a9e9d27c0d48-data-volume\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:45.887939 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.887921    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-log-socket\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.888100 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.888019    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-web-config\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.940119 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.940091    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztlt2\" (UniqueName: \"kubernetes.io/projected/4473b042-87a2-4397-a283-2ac777fc838e-kube-api-access-ztlt2\") pod \"openshift-state-metrics-7bd7489957-9czt7\" (UID: \"4473b042-87a2-4397-a283-2ac777fc838e\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-9czt7"
Nov 04 02:16:45.940306 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.940289    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp6hd\" (UniqueName: \"kubernetes.io/projected/c0855012-4612-4411-ba60-ef2a3139231b-kube-api-access-vp6hd\") pod \"console-6cc795fcf6-5wtjm\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") " pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:45.943051 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.943030    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vpxs\" (UniqueName: \"kubernetes.io/projected/a1cc2630-7b85-40fb-9594-56865adf9eba-kube-api-access-4vpxs\") pod \"network-metrics-daemon-4fs2v\" (UID: \"a1cc2630-7b85-40fb-9594-56865adf9eba\") " pod="openshift-multus/network-metrics-daemon-4fs2v"
Nov 04 02:16:45.943251 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.943236    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pth8s\" (UniqueName: \"kubernetes.io/projected/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-kube-api-access-pth8s\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.950414 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.950385    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ls7h\" (UniqueName: \"kubernetes.io/projected/5819bbef-1a67-4bb3-b35c-2b8409d463a1-kube-api-access-5ls7h\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:16:45.950529 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.950400    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl2xj\" (UniqueName: \"kubernetes.io/projected/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-kube-api-access-cl2xj\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.950529 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.950471    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvfgz\" (UniqueName: \"kubernetes.io/projected/f54eb55a-276b-4d34-8190-ec19c6fe20fc-kube-api-access-mvfgz\") pod \"network-check-target-qnrfj\" (UID: \"f54eb55a-276b-4d34-8190-ec19c6fe20fc\") " pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:45.950868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.950847    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhnmh\" (UniqueName: \"kubernetes.io/projected/0627c0af-c804-48a6-87bf-a9e9d27c0d48-kube-api-access-xhnmh\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:45.957146 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.957126    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99qgd\" (UniqueName: \"kubernetes.io/projected/4a7f9252-6cad-4558-beb5-d30528b7be82-kube-api-access-99qgd\") pod \"downloads-6dd789c8b7-pl5st\" (UID: \"4a7f9252-6cad-4558-beb5-d30528b7be82\") " pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:16:45.960469 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.960449    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn89t\" (UniqueName: \"kubernetes.io/projected/91cad462-1ef8-4bf5-aeca-92005dbf5393-kube-api-access-vn89t\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:16:45.962734 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.962716    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8wxq\" (UniqueName: \"kubernetes.io/projected/3ea825ae-6a0c-4858-89f7-4b992e555347-kube-api-access-x8wxq\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:16:45.962817 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.962767    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq2rp\" (UniqueName: \"kubernetes.io/projected/64552c37-114a-47cf-8c71-cbab012174d0-kube-api-access-nq2rp\") pod \"kube-state-metrics-5dc8d7d89b-dvc9c\" (UID: \"64552c37-114a-47cf-8c71-cbab012174d0\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dvc9c"
Nov 04 02:16:45.962817 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.962797    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghph7\" (UniqueName: \"kubernetes.io/projected/04d1e991-8105-4b6e-b079-242cfbb2ece8-kube-api-access-ghph7\") pod \"dns-default-7hk2x\" (UID: \"04d1e991-8105-4b6e-b079-242cfbb2ece8\") " pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:45.963202 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.963186    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l8wf\" (UniqueName: \"kubernetes.io/projected/539faf35-0294-46b3-847c-c8e33464ba7b-kube-api-access-6l8wf\") pod \"monitoring-plugin-77f4f76594-75ztr\" (UID: \"539faf35-0294-46b3-847c-c8e33464ba7b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:45.965254 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.965229    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrsx\" (UniqueName: \"kubernetes.io/projected/07e5822b-f9ff-4da7-9b1b-691bed7af623-kube-api-access-zrrsx\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.966111 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.966096    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfkqh\" (UniqueName: \"kubernetes.io/projected/638f2276-6417-4b5f-a0d1-5d3d0e85d63a-kube-api-access-lfkqh\") pod \"prometheus-operator-9cd89b74c-8gfqc\" (UID: \"638f2276-6417-4b5f-a0d1-5d3d0e85d63a\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-8gfqc"
Nov 04 02:16:45.967888 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.967867    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt7n4\" (UniqueName: \"kubernetes.io/projected/090eb434-52cf-4ada-86a3-dedbd7814699-kube-api-access-lt7n4\") pod \"ingress-canary-29hdm\" (UID: \"090eb434-52cf-4ada-86a3-dedbd7814699\") " pod="openshift-ingress-canary/ingress-canary-29hdm"
Nov 04 02:16:45.972239 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.972221    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p445\" (UniqueName: \"kubernetes.io/projected/301d3a33-8043-4c7e-b2b6-af4c830ee21f-kube-api-access-2p445\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.972239 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.972230    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmshk\" (UniqueName: \"kubernetes.io/projected/a222092c-b379-4b4b-a857-de3236571886-kube-api-access-xmshk\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.972377 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.972358    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58ngg\" (UniqueName: \"kubernetes.io/projected/5401a6e8-141f-4823-b57f-aca208b89c7a-kube-api-access-58ngg\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.972670 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.972651    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gxrn\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-kube-api-access-8gxrn\") pod \"alertmanager-main-0\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:16:45.988353 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988328    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ef999918-fa31-440e-ba39-f20feca4f4ab-audit-log\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.988478 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988362    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-run-netns\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.988478 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988385    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-hostroot\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.988478 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988439    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-run-netns\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.988478 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988439    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-hostroot\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.988657 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988489    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ef999918-fa31-440e-ba39-f20feca4f4ab-secret-metrics-server-client-certs\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.988657 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988527    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-root\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.988657 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988565    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db573293-5d41-4d1c-8f00-c15dec39eb51-telemeter-trusted-ca-bundle\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.988657 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988590    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0627c0af-c804-48a6-87bf-a9e9d27c0d48-crio-socket\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:45.988657 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988633    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-socket-dir-parent\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.988657 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988644    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-root\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.988930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988678    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-etc-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.988930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988696    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0627c0af-c804-48a6-87bf-a9e9d27c0d48-crio-socket\") pod \"insights-runtime-extractor-xq8jl\" (UID: \"0627c0af-c804-48a6-87bf-a9e9d27c0d48\") " pod="openshift-insights/insights-runtime-extractor-xq8jl"
Nov 04 02:16:45.988930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988717    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/db573293-5d41-4d1c-8f00-c15dec39eb51-secret-telemeter-client\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.988930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988699    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-socket-dir-parent\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.988930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988736    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-etc-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.988930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988757    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef999918-fa31-440e-ba39-f20feca4f4ab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.988930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988777    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ef999918-fa31-440e-ba39-f20feca4f4ab-audit-log\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.988930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988790    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-cnibin\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.988930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988834    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysconfig\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.988930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988846    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-cnibin\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.988930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988901    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-multus-certs\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.988930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988915    5450 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988936    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-kubelet-config\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988944    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-multus-certs\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.988904    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysconfig\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989052    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db573293-5d41-4d1c-8f00-c15dec39eb51-metrics-client-ca\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989096    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-etc-selinux\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989048    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-kubelet-config\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989131    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989215    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-etc-selinux\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989222    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-socket-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989290    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-systemd\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989336    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ea825ae-6a0c-4858-89f7-4b992e555347-host\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989359    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-socket-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989360    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-host\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989397    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-node-log\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989428    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/db573293-5d41-4d1c-8f00-c15dec39eb51-federate-client-tls\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989430    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ea825ae-6a0c-4858-89f7-4b992e555347-host\") pod \"node-ca-4628r\" (UID: \"3ea825ae-6a0c-4858-89f7-4b992e555347\") " pod="openshift-image-registry/node-ca-4628r"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989453    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-var-lib-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989477    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-cni-bin\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.989506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989504    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-run\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989543    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-sys\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989559    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-var-lib-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989587    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-dbus\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989477    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-systemd\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989516    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef999918-fa31-440e-ba39-f20feca4f4ab-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989637    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-host\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989699    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-cni-bin\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989704    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-run\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989772    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-node-log\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989779    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-sys\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989807    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ef999918-fa31-440e-ba39-f20feca4f4ab-secret-metrics-server-tls\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989837    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989845    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e6dcb66-ce72-40ee-86fd-96d07dc4960f-dbus\") pod \"global-pull-secret-syncer-msgpp\" (UID: \"3e6dcb66-ce72-40ee-86fd-96d07dc4960f\") " pod="kube-system/global-pull-secret-syncer-msgpp"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989893    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.989950    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-systemd\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990021    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db573293-5d41-4d1c-8f00-c15dec39eb51-metrics-client-ca\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990104    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/db573293-5d41-4d1c-8f00-c15dec39eb51-telemeter-client-tls\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990130    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-etc-kubernetes\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990188    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-cnibin\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990152    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-systemd\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990250    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-cnibin\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990261    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bkm4\" (UniqueName: \"kubernetes.io/projected/ef999918-fa31-440e-ba39-f20feca4f4ab-kube-api-access-7bkm4\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990283    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-etc-kubernetes\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.990378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990320    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-lib-modules\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990426    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-lib-modules\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990454    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990479    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db573293-5d41-4d1c-8f00-c15dec39eb51-telemeter-trusted-ca-bundle\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990542    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990542    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db573293-5d41-4d1c-8f00-c15dec39eb51-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990624    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-sys-fs\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990680    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-sys-fs\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990696    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990728    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-device-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990776    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990808    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-var-lib-kubelet\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990819    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-device-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990869    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-var-lib-kubelet\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990885    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91cad462-1ef8-4bf5-aeca-92005dbf5393-host-slash\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990927    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91cad462-1ef8-4bf5-aeca-92005dbf5393-host-slash\") pod \"iptables-alerter-96gx5\" (UID: \"91cad462-1ef8-4bf5-aeca-92005dbf5393\") " pod="openshift-network-operator/iptables-alerter-96gx5"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990964    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-kubelet\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.990991    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.991012    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-systemd-units\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.991033    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-node-exporter-wtmp\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.991063    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysctl-conf\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.991094    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-cni-multus\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.991130    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-kubernetes\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.991152    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-k8s-cni-cncf-io\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.991199    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-netns\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.991222    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-log-socket\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.991260    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-registration-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.991483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.991293    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5819bbef-1a67-4bb3-b35c-2b8409d463a1-hosts-file\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:16:45.992743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.991675    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-netns\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.992743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.991318    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db573293-5d41-4d1c-8f00-c15dec39eb51-serving-certs-ca-bundle\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.992743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.992571    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/db573293-5d41-4d1c-8f00-c15dec39eb51-secret-telemeter-client\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.992743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.992468    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-kubernetes\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.992743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.992379    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysctl-conf\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.992743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.992511    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-run-k8s-cni-cncf-io\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.992743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.992666    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-log-socket\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.992743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.992669    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-cni-multus\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.992743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.992717    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-kubelet\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.992743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.992719    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-node-exporter-wtmp\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.993203 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.992751    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-systemd-units\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.993203 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.992847    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb687fe1-110e-4a6b-a552-9a9ed8445eb0-registration-dir\") pod \"aws-ebs-csi-driver-node-5fvpk\" (UID: \"cb687fe1-110e-4a6b-a552-9a9ed8445eb0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5fvpk"
Nov 04 02:16:45.993203 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993147    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/db573293-5d41-4d1c-8f00-c15dec39eb51-federate-client-tls\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.993347 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993225    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5819bbef-1a67-4bb3-b35c-2b8409d463a1-hosts-file\") pod \"node-resolver-42xbt\" (UID: \"5819bbef-1a67-4bb3-b35c-2b8409d463a1\") " pod="openshift-dns/node-resolver-42xbt"
Nov 04 02:16:45.993403 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993353    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ef999918-fa31-440e-ba39-f20feca4f4ab-secret-metrics-server-client-certs\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.993403 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993363    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ef999918-fa31-440e-ba39-f20feca4f4ab-secret-metrics-server-tls\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.993505 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993486    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db573293-5d41-4d1c-8f00-c15dec39eb51-serving-certs-ca-bundle\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993567    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-system-cni-dir\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993635    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07e5822b-f9ff-4da7-9b1b-691bed7af623-system-cni-dir\") pod \"multus-additional-cni-plugins-qchvs\" (UID: \"07e5822b-f9ff-4da7-9b1b-691bed7af623\") " pod="openshift-multus/multus-additional-cni-plugins-qchvs"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993647    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-modprobe-d\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993696    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zz52\" (UniqueName: \"kubernetes.io/projected/db573293-5d41-4d1c-8f00-c15dec39eb51-kube-api-access-5zz52\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993726    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-system-cni-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993764    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-conf-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993794    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-cni-netd\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993810    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-modprobe-d\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993883    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-cni-netd\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993890    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-conf-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993948    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-system-cni-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.993817    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ef999918-fa31-440e-ba39-f20feca4f4ab-metrics-server-audit-profiles\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.994053    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db573293-5d41-4d1c-8f00-c15dec39eb51-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.994082    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysctl-d\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.994128    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-sys\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.994163    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-slash\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.994196    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef999918-fa31-440e-ba39-f20feca4f4ab-client-ca-bundle\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.994237    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-kubelet\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.994268    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5401a6e8-141f-4823-b57f-aca208b89c7a-etc-sysctl-d\") pod \"tuned-c72gg\" (UID: \"5401a6e8-141f-4823-b57f-aca208b89c7a\") " pod="openshift-cluster-node-tuning-operator/tuned-c72gg"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.994295    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.994336    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-slash\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.994341    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-ovn\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.994380    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a222092c-b379-4b4b-a857-de3236571886-sys\") pod \"node-exporter-xt6nc\" (UID: \"a222092c-b379-4b4b-a857-de3236571886\") " pod="openshift-monitoring/node-exporter-xt6nc"
Nov 04 02:16:45.993590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.994373    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-cni-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.997975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.996874    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-cni-bin\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.997975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.996894    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-multus-cni-dir\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.997975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.996933    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-host-kubelet\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.997975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.996952    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-openvswitch\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.997975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.997047    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/301d3a33-8043-4c7e-b2b6-af4c830ee21f-host-var-lib-cni-bin\") pod \"multus-cq8lx\" (UID: \"301d3a33-8043-4c7e-b2b6-af4c830ee21f\") " pod="openshift-multus/multus-cq8lx"
Nov 04 02:16:45.997975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.997102    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b-run-ovn\") pod \"ovnkube-node-2cfx8\" (UID: \"cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:45.997975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.997948    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ef999918-fa31-440e-ba39-f20feca4f4ab-metrics-server-audit-profiles\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:45.998814 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.998788    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/db573293-5d41-4d1c-8f00-c15dec39eb51-telemeter-client-tls\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:45.999501 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:45.999483    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef999918-fa31-440e-ba39-f20feca4f4ab-client-ca-bundle\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:46.022868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:46.022846    5450 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:16:46.024482 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:46.024458    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:46.049645 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:46.049616    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bkm4\" (UniqueName: \"kubernetes.io/projected/ef999918-fa31-440e-ba39-f20feca4f4ab-kube-api-access-7bkm4\") pod \"metrics-server-66b6494b5d-lk428\" (UID: \"ef999918-fa31-440e-ba39-f20feca4f4ab\") " pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:46.052293 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:46.052265    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zz52\" (UniqueName: \"kubernetes.io/projected/db573293-5d41-4d1c-8f00-c15dec39eb51-kube-api-access-5zz52\") pod \"telemeter-client-db9dc59b6-fbdkd\" (UID: \"db573293-5d41-4d1c-8f00-c15dec39eb51\") " pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:46.325646 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:46.325616    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:46.341187 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:46.341164    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"
Nov 04 02:16:46.694838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:46.694764    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr" event={"ID":"539faf35-0294-46b3-847c-c8e33464ba7b","Type":"ContainerStarted","Data":"73040b14fb366a8b4be94fdb439ae5414300f54f1dcd34099fc886eb337803d1"}
Nov 04 02:16:46.715152 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:46.715126    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66b6494b5d-lk428"]
Nov 04 02:16:46.721784 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:46.721760    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef999918_fa31_440e_ba39_f20feca4f4ab.slice/crio-b2f3e946b187cff36a12a5799cc2d580ef3fcd1cd9e702f7808c24bf4579e016 WatchSource:0}: Error finding container b2f3e946b187cff36a12a5799cc2d580ef3fcd1cd9e702f7808c24bf4579e016: Status 404 returned error can't find the container with id b2f3e946b187cff36a12a5799cc2d580ef3fcd1cd9e702f7808c24bf4579e016
Nov 04 02:16:46.799629 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:46.799586    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-db9dc59b6-fbdkd"]
Nov 04 02:16:46.805822 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:46.805798    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb573293_5d41_4d1c_8f00_c15dec39eb51.slice/crio-6648ae832fbbb13ed718897c29654ace388a2950e6998a7cc5dcf3b19eaf88b6 WatchSource:0}: Error finding container 6648ae832fbbb13ed718897c29654ace388a2950e6998a7cc5dcf3b19eaf88b6: Status 404 returned error can't find the container with id 6648ae832fbbb13ed718897c29654ace388a2950e6998a7cc5dcf3b19eaf88b6
Nov 04 02:16:47.700768 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:47.700728    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66b6494b5d-lk428" event={"ID":"ef999918-fa31-440e-ba39-f20feca4f4ab","Type":"ContainerStarted","Data":"b2f3e946b187cff36a12a5799cc2d580ef3fcd1cd9e702f7808c24bf4579e016"}
Nov 04 02:16:47.702864 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:47.702802    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd" event={"ID":"db573293-5d41-4d1c-8f00-c15dec39eb51","Type":"ContainerStarted","Data":"6648ae832fbbb13ed718897c29654ace388a2950e6998a7cc5dcf3b19eaf88b6"}
Nov 04 02:16:47.744341 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:47.744310    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:47.773190 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:16:47.773055    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:16:48.313503 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.312743    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7hk2x"
Nov 04 02:16:48.561233 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.561202    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:48.709494 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.709401    5450 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 02:16:48.710346 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.710320    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr" event={"ID":"539faf35-0294-46b3-847c-c8e33464ba7b","Type":"ContainerStarted","Data":"935158b0e69aeb5ad1c0f2edc621e6f40632cca35bcc0cfda96607b1989d1ffe"}
Nov 04 02:16:48.710434 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.710374    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:48.716538 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.716519    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-75ztr"
Nov 04 02:16:48.821463 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.820093    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 02:16:48.824758 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.824732    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.879747 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.879715    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 04 02:16:48.879747 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.879753    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 04 02:16:48.879963 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.879806    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 04 02:16:48.923637 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.923577    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.923637 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.923638    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.923857 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.923663    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.923857 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.923816    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.923857 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.923848    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-web-config\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924019 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.923875    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924019 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.923923    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924118 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.924088    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924172 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.924121    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924221 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.924179    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924268 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.924209    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924268 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.924244    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwhfj\" (UniqueName: \"kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-kube-api-access-pwhfj\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.924319    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.924346    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924434 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.924393    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924434 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.924425    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924490 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.924459    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-config\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924490 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.924481    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924559 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.924514    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-config-out\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.924559 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.924545    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:48.929646 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.929591    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 04 02:16:48.976172 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.976087    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sqxgb\""
Nov 04 02:16:48.976172 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.976087    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 04 02:16:48.976391 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.976267    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 04 02:16:48.976391 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.976270    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 04 02:16:48.976391 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.976270    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 04 02:16:48.976391 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.976298    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 04 02:16:48.976391 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.976313    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 04 02:16:48.976391 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.976371    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-pcp779l7m90v\""
Nov 04 02:16:48.976712 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.976504    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 04 02:16:48.976712 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.976670    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 04 02:16:48.976810 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.976729    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 04 02:16:48.976994 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.976977    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 04 02:16:48.977637 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:48.977590    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 02:16:49.005690 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.005659    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xsflh"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.025848    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.025897    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-web-config\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.025927    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.025953    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.025989    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026028    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026051    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026075    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026097    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwhfj\" (UniqueName: \"kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-kube-api-access-pwhfj\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026134    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026170    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026195    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026223    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026257    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-config\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026278    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026310    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-config-out\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026335    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026380    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026409    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.026655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.026436    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.028393 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.028062    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.028393 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.028211    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.028744 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.028713    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.029165 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.029140    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.030393 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.030365    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.030584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.030566    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.030865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.030838    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.031733 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.031705    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.032063 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.032004    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.032997 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.032974    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.033323 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.033295    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.033398 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.033373    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-config\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.033899 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.033871    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.033976 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.033882    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.036042 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.036017    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.036203 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.036183    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-config-out\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.036402 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.036377    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-web-config\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.037518 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.037455    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.037518 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.037498    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.090629 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.087139    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwhfj\" (UniqueName: \"kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-kube-api-access-pwhfj\") pod \"prometheus-k8s-0\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.154425 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.154385    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:16:49.600589 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.600552    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 02:16:49.624627 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:16:49.624568    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode777a6a4_21ab_4c5a_9760_47ac58139479.slice/crio-e130f958812fa4bade3d2181c9216fb72330955b697dd8c7de5c29cea2b4600c WatchSource:0}: Error finding container e130f958812fa4bade3d2181c9216fb72330955b697dd8c7de5c29cea2b4600c: Status 404 returned error can't find the container with id e130f958812fa4bade3d2181c9216fb72330955b697dd8c7de5c29cea2b4600c
Nov 04 02:16:49.723556 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.719487    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerStarted","Data":"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"}
Nov 04 02:16:49.723556 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.719555    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerStarted","Data":"e130f958812fa4bade3d2181c9216fb72330955b697dd8c7de5c29cea2b4600c"}
Nov 04 02:16:49.800001 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:49.799971    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2cfx8"
Nov 04 02:16:50.733769 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:50.732418    5450 generic.go:356] "Generic (PLEG): container finished" podID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerID="da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952" exitCode=0
Nov 04 02:16:50.733769 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:50.732506    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerDied","Data":"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"}
Nov 04 02:16:50.739788 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:50.739710    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerStarted","Data":"8168123f3abb3e2d4cba61b4a136682608ae06e55ab504d231c26a7242044486"}
Nov 04 02:16:50.739788 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:50.739784    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerStarted","Data":"00fbe3addcbd66c7461dc502c22d8b0cfb6eff4d2eb05c33883351dbda239a74"}
Nov 04 02:16:50.739942 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:50.739822    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerStarted","Data":"64afe68227f78e633d21c32144a4f7d325d8c425999a45b97ef18d150ddcbba4"}
Nov 04 02:16:50.739942 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:50.739859    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerStarted","Data":"e7fc6170dfd5ec02210835a9eb8fc9ec1a05d7f1f84c7ed51c18f37829b5a5c0"}
Nov 04 02:16:50.739942 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:50.739896    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerStarted","Data":"32dc24dc6c74cab47494c3a2a22ebfaf094f0227f0b0121be914eb9d14ce0c30"}
Nov 04 02:16:51.746405 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:51.746358    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd" event={"ID":"db573293-5d41-4d1c-8f00-c15dec39eb51","Type":"ContainerStarted","Data":"9d3b19156c1889440d097ecd4a6d1fa30496c9a03fda40dd6cf6e4ede403a40b"}
Nov 04 02:16:51.746824 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:51.746441    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd" event={"ID":"db573293-5d41-4d1c-8f00-c15dec39eb51","Type":"ContainerStarted","Data":"248ef4bdf3c18aee3b6b97e480154ad64b83774add99560c1100ba20c04e49f5"}
Nov 04 02:16:51.746824 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:51.746475    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd" event={"ID":"db573293-5d41-4d1c-8f00-c15dec39eb51","Type":"ContainerStarted","Data":"bbc0daebd8648f192da35efe905125b56459bdba826cf092dfafd6fba3955fcd"}
Nov 04 02:16:51.748523 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:51.748490    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66b6494b5d-lk428" event={"ID":"ef999918-fa31-440e-ba39-f20feca4f4ab","Type":"ContainerStarted","Data":"97ea3319479c2ff857e7f343b7053bbb49fb7d86fedd254210da6c45964f32b3"}
Nov 04 02:16:51.865642 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:51.865559    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-db9dc59b6-fbdkd" podStartSLOduration=2.633915611 podStartE2EDuration="6.865542936s" totalImagesPullingTime="4.231627325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:51.864916883 +0000 UTC m=+7.368857376" watchObservedRunningTime="2026-11-04 02:16:51.865542936 +0000 UTC m=+7.369483429"
Nov 04 02:16:52.568672 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:52.568641    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:16:52.760338 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:52.760252    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerStarted","Data":"00a8bc412276869bbc4d84aee213e7b221af2466b13135e45bf0089092dd7186"}
Nov 04 02:16:52.763557 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:52.763431    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc795fcf6-5wtjm" event={"ID":"c0855012-4612-4411-ba60-ef2a3139231b","Type":"ContainerStarted","Data":"0837294469a2e602c1aae2a0686d2201c182b45e49cb9fa19161691133412394"}
Nov 04 02:16:55.776355 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:55.776318    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerStarted","Data":"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"}
Nov 04 02:16:55.776733 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:55.776410    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerStarted","Data":"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"}
Nov 04 02:16:56.005344 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:56.005309    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:56.562507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:56.562468    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:57.202698 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:57.202659    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:57.208281 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:57.208247    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:57.635193 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:57.635156    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:16:57.789651 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:57.789621    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:16:58.795178 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:58.795137    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerStarted","Data":"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"}
Nov 04 02:16:58.795647 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:58.795223    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerStarted","Data":"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"}
Nov 04 02:16:58.795647 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:58.795270    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerStarted","Data":"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"}
Nov 04 02:16:58.795647 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:58.795309    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerStarted","Data":"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"}
Nov 04 02:16:58.925373 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:16:58.925312    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.653816613 podStartE2EDuration="10.925293512s" totalImagesPullingTime="7.241734663s" totalInitContainerRuntime="29.742236ms" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:58.9242149 +0000 UTC m=+14.428155428" watchObservedRunningTime="2026-11-04 02:16:58.925293512 +0000 UTC m=+14.429234007"
Nov 04 02:17:01.053029 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:01.052997    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:17:03.958351 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:03.958317    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc795fcf6-5wtjm"]
Nov 04 02:17:08.023905 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:08.023877    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n9lpj"
Nov 04 02:17:12.571734 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:12.571696    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qnrfj"
Nov 04 02:17:17.642240 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:17.642208    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:17:17.647373 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:17.647348    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66b6494b5d-lk428"
Nov 04 02:17:17.769701 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:17:17.769627    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:17:17.877791 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:17.877735    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-pl5st" event={"ID":"4a7f9252-6cad-4558-beb5-d30528b7be82","Type":"ContainerStarted","Data":"ee918deaa52311344c8f54d2b4990da9762d21735d9c9a8a545df9406da5fa42"}
Nov 04 02:17:17.879120 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:17.879098    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:17:17.891015 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:17.890913    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-pl5st"
Nov 04 02:17:28.980971 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:28.980907    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6cc795fcf6-5wtjm" podUID="c0855012-4612-4411-ba60-ef2a3139231b" containerName="console" containerID="cri-o://0837294469a2e602c1aae2a0686d2201c182b45e49cb9fa19161691133412394" gracePeriod=15
Nov 04 02:17:29.267972 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.267945    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:17:29.329163 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.329136    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-serving-cert\") pod \"c0855012-4612-4411-ba60-ef2a3139231b\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") "
Nov 04 02:17:29.329393 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.329188    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-oauth-config\") pod \"c0855012-4612-4411-ba60-ef2a3139231b\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") "
Nov 04 02:17:29.329393 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.329210    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0855012-4612-4411-ba60-ef2a3139231b-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0855012-4612-4411-ba60-ef2a3139231b-tmp\") pod \"c0855012-4612-4411-ba60-ef2a3139231b\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") "
Nov 04 02:17:29.329393 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.329242    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-service-ca\") pod \"c0855012-4612-4411-ba60-ef2a3139231b\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") "
Nov 04 02:17:29.329393 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.329266    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0855012-4612-4411-ba60-ef2a3139231b-kube-api-access-vp6hd\" (UniqueName: \"kubernetes.io/projected/c0855012-4612-4411-ba60-ef2a3139231b-kube-api-access-vp6hd\") pod \"c0855012-4612-4411-ba60-ef2a3139231b\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") "
Nov 04 02:17:29.329393 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.329334    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-console-config\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-console-config\") pod \"c0855012-4612-4411-ba60-ef2a3139231b\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") "
Nov 04 02:17:29.329393 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.329365    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-oauth-serving-cert\") pod \"c0855012-4612-4411-ba60-ef2a3139231b\" (UID: \"c0855012-4612-4411-ba60-ef2a3139231b\") "
Nov 04 02:17:29.329752 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.329621    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0855012-4612-4411-ba60-ef2a3139231b-tmp" pod "c0855012-4612-4411-ba60-ef2a3139231b" (UID: "c0855012-4612-4411-ba60-ef2a3139231b"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:17:29.329869 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.329841    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-service-ca" pod "c0855012-4612-4411-ba60-ef2a3139231b" (UID: "c0855012-4612-4411-ba60-ef2a3139231b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:17:29.329985 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.329961    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-oauth-serving-cert" pod "c0855012-4612-4411-ba60-ef2a3139231b" (UID: "c0855012-4612-4411-ba60-ef2a3139231b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:17:29.329985 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.329959    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-console-config" pod "c0855012-4612-4411-ba60-ef2a3139231b" (UID: "c0855012-4612-4411-ba60-ef2a3139231b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:17:29.331635 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.331608    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-serving-cert" pod "c0855012-4612-4411-ba60-ef2a3139231b" (UID: "c0855012-4612-4411-ba60-ef2a3139231b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:17:29.331740 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.331607    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0855012-4612-4411-ba60-ef2a3139231b-kube-api-access-vp6hd" pod "c0855012-4612-4411-ba60-ef2a3139231b" (UID: "c0855012-4612-4411-ba60-ef2a3139231b"). InnerVolumeSpecName "kube-api-access-vp6hd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:17:29.331740 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.331686    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-oauth-config" pod "c0855012-4612-4411-ba60-ef2a3139231b" (UID: "c0855012-4612-4411-ba60-ef2a3139231b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:17:29.430901 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.430870    5450 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-serving-cert\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:29.430901 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.430897    5450 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0855012-4612-4411-ba60-ef2a3139231b-console-oauth-config\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:29.430901 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.430907    5450 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0855012-4612-4411-ba60-ef2a3139231b-tmp\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:29.431159 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.430916    5450 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-service-ca\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:29.431159 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.430927    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp6hd\" (UniqueName: \"kubernetes.io/projected/c0855012-4612-4411-ba60-ef2a3139231b-kube-api-access-vp6hd\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:29.431159 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.430937    5450 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-console-config\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:29.431159 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.430945    5450 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0855012-4612-4411-ba60-ef2a3139231b-oauth-serving-cert\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:29.933650 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.933614    5450 generic.go:356] "Generic (PLEG): container finished" podID="c0855012-4612-4411-ba60-ef2a3139231b" containerID="0837294469a2e602c1aae2a0686d2201c182b45e49cb9fa19161691133412394" exitCode=0
Nov 04 02:17:29.933935 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.933664    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc795fcf6-5wtjm" event={"ID":"c0855012-4612-4411-ba60-ef2a3139231b","Type":"ContainerDied","Data":"0837294469a2e602c1aae2a0686d2201c182b45e49cb9fa19161691133412394"}
Nov 04 02:17:29.933935 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.933671    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc795fcf6-5wtjm"
Nov 04 02:17:29.933935 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.933704    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc795fcf6-5wtjm" event={"ID":"c0855012-4612-4411-ba60-ef2a3139231b","Type":"ContainerDied","Data":"8e0fda1747e862fc167653b7502767229cb2982fb8b5bd6569c24b46c28b8f85"}
Nov 04 02:17:29.933935 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.933722    5450 scope.go:122] "RemoveContainer" containerID="0837294469a2e602c1aae2a0686d2201c182b45e49cb9fa19161691133412394"
Nov 04 02:17:29.942645 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.942628    5450 scope.go:122] "RemoveContainer" containerID="0837294469a2e602c1aae2a0686d2201c182b45e49cb9fa19161691133412394"
Nov 04 02:17:29.942873 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:17:29.942857    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0837294469a2e602c1aae2a0686d2201c182b45e49cb9fa19161691133412394\": container with ID starting with 0837294469a2e602c1aae2a0686d2201c182b45e49cb9fa19161691133412394 not found: ID does not exist" containerID="0837294469a2e602c1aae2a0686d2201c182b45e49cb9fa19161691133412394"
Nov 04 02:17:29.942924 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:29.942881    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0837294469a2e602c1aae2a0686d2201c182b45e49cb9fa19161691133412394"} err="failed to get container status \"0837294469a2e602c1aae2a0686d2201c182b45e49cb9fa19161691133412394\": rpc error: code = NotFound desc = could not find container \"0837294469a2e602c1aae2a0686d2201c182b45e49cb9fa19161691133412394\": container with ID starting with 0837294469a2e602c1aae2a0686d2201c182b45e49cb9fa19161691133412394 not found: ID does not exist"
Nov 04 02:17:30.093136 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:30.093105    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc795fcf6-5wtjm"]
Nov 04 02:17:30.141011 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:30.140980    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cc795fcf6-5wtjm"]
Nov 04 02:17:30.630534 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:30.630492    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c0855012-4612-4411-ba60-ef2a3139231b" path="/var/lib/kubelet/pods/c0855012-4612-4411-ba60-ef2a3139231b/volumes"
Nov 04 02:17:47.762799 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:17:47.762755    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:17:53.053636 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:53.053583    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:17:53.101806 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:53.101778    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:17:54.033580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:17:54.033553    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:06.263203 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:06.263155    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 02:18:06.263660 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:06.263487    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="alertmanager" containerID="cri-o://32dc24dc6c74cab47494c3a2a22ebfaf094f0227f0b0121be914eb9d14ce0c30" gracePeriod=120
Nov 04 02:18:06.263660 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:06.263570    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="kube-rbac-proxy-metric" containerID="cri-o://8168123f3abb3e2d4cba61b4a136682608ae06e55ab504d231c26a7242044486" gracePeriod=120
Nov 04 02:18:06.263660 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:06.263580    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="config-reloader" containerID="cri-o://e7fc6170dfd5ec02210835a9eb8fc9ec1a05d7f1f84c7ed51c18f37829b5a5c0" gracePeriod=120
Nov 04 02:18:06.263660 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:06.263638    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="kube-rbac-proxy" containerID="cri-o://00fbe3addcbd66c7461dc502c22d8b0cfb6eff4d2eb05c33883351dbda239a74" gracePeriod=120
Nov 04 02:18:06.263931 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:06.263563    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="kube-rbac-proxy-web" containerID="cri-o://64afe68227f78e633d21c32144a4f7d325d8c425999a45b97ef18d150ddcbba4" gracePeriod=120
Nov 04 02:18:06.263931 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:06.263710    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="prom-label-proxy" containerID="cri-o://00a8bc412276869bbc4d84aee213e7b221af2466b13135e45bf0089092dd7186" gracePeriod=120
Nov 04 02:18:07.065387 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.065351    5450 generic.go:356] "Generic (PLEG): container finished" podID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerID="00a8bc412276869bbc4d84aee213e7b221af2466b13135e45bf0089092dd7186" exitCode=0
Nov 04 02:18:07.065387 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.065382    5450 generic.go:356] "Generic (PLEG): container finished" podID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerID="8168123f3abb3e2d4cba61b4a136682608ae06e55ab504d231c26a7242044486" exitCode=0
Nov 04 02:18:07.065387 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.065389    5450 generic.go:356] "Generic (PLEG): container finished" podID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerID="00fbe3addcbd66c7461dc502c22d8b0cfb6eff4d2eb05c33883351dbda239a74" exitCode=0
Nov 04 02:18:07.065387 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.065394    5450 generic.go:356] "Generic (PLEG): container finished" podID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerID="e7fc6170dfd5ec02210835a9eb8fc9ec1a05d7f1f84c7ed51c18f37829b5a5c0" exitCode=0
Nov 04 02:18:07.065387 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.065399    5450 generic.go:356] "Generic (PLEG): container finished" podID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerID="32dc24dc6c74cab47494c3a2a22ebfaf094f0227f0b0121be914eb9d14ce0c30" exitCode=0
Nov 04 02:18:07.065729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.065427    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerDied","Data":"00a8bc412276869bbc4d84aee213e7b221af2466b13135e45bf0089092dd7186"}
Nov 04 02:18:07.065729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.065497    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerDied","Data":"8168123f3abb3e2d4cba61b4a136682608ae06e55ab504d231c26a7242044486"}
Nov 04 02:18:07.065729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.065525    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerDied","Data":"00fbe3addcbd66c7461dc502c22d8b0cfb6eff4d2eb05c33883351dbda239a74"}
Nov 04 02:18:07.065729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.065556    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerDied","Data":"e7fc6170dfd5ec02210835a9eb8fc9ec1a05d7f1f84c7ed51c18f37829b5a5c0"}
Nov 04 02:18:07.065729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.065580    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerDied","Data":"32dc24dc6c74cab47494c3a2a22ebfaf094f0227f0b0121be914eb9d14ce0c30"}
Nov 04 02:18:07.500727 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.500697    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:07.567796 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.567761    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") "
Nov 04 02:18:07.567796 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.567798    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-metrics-client-ca\") pod \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") "
Nov 04 02:18:07.568048 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.567820    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-web-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-web-config\") pod \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") "
Nov 04 02:18:07.568048 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.567846    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-web\") pod \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") "
Nov 04 02:18:07.568048 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.567978    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-trusted-ca-bundle\") pod \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") "
Nov 04 02:18:07.568048 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.568038    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-volume\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-volume\") pod \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") "
Nov 04 02:18:07.568264 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.568082    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-kube-api-access-8gxrn\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-kube-api-access-8gxrn\") pod \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") "
Nov 04 02:18:07.568264 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.568110    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-tls-assets\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-tls-assets\") pod \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") "
Nov 04 02:18:07.568264 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.568140    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-main-db\") pod \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") "
Nov 04 02:18:07.568264 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.568194    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-main-tls\") pod \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") "
Nov 04 02:18:07.568264 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.568226    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-cluster-tls-config\") pod \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") "
Nov 04 02:18:07.568264 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.568250    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-metrics-client-ca" pod "0a84a40d-70f6-4504-8e0b-6933cc89bbfa" (UID: "0a84a40d-70f6-4504-8e0b-6933cc89bbfa"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:18:07.568543 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.568258    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy\") pod \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") "
Nov 04 02:18:07.568543 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.568329    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-trusted-ca-bundle" pod "0a84a40d-70f6-4504-8e0b-6933cc89bbfa" (UID: "0a84a40d-70f6-4504-8e0b-6933cc89bbfa"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:18:07.568543 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.568350    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-out\") pod \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\" (UID: \"0a84a40d-70f6-4504-8e0b-6933cc89bbfa\") "
Nov 04 02:18:07.568718 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.568672    5450 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-metrics-client-ca\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:07.568718 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.568694    5450 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:07.569174 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.569145    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-main-db" pod "0a84a40d-70f6-4504-8e0b-6933cc89bbfa" (UID: "0a84a40d-70f6-4504-8e0b-6933cc89bbfa"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:18:07.571248 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.571186    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-web" pod "0a84a40d-70f6-4504-8e0b-6933cc89bbfa" (UID: "0a84a40d-70f6-4504-8e0b-6933cc89bbfa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:07.571575 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.571505    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-metric" pod "0a84a40d-70f6-4504-8e0b-6933cc89bbfa" (UID: "0a84a40d-70f6-4504-8e0b-6933cc89bbfa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:07.571741 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.571719    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-out" pod "0a84a40d-70f6-4504-8e0b-6933cc89bbfa" (UID: "0a84a40d-70f6-4504-8e0b-6933cc89bbfa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:18:07.571813 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.571747    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy" pod "0a84a40d-70f6-4504-8e0b-6933cc89bbfa" (UID: "0a84a40d-70f6-4504-8e0b-6933cc89bbfa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:07.571927 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.571904    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-volume" pod "0a84a40d-70f6-4504-8e0b-6933cc89bbfa" (UID: "0a84a40d-70f6-4504-8e0b-6933cc89bbfa"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:07.572062 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.572040    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-tls-assets" pod "0a84a40d-70f6-4504-8e0b-6933cc89bbfa" (UID: "0a84a40d-70f6-4504-8e0b-6933cc89bbfa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:18:07.572146 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.572121    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-kube-api-access-8gxrn" pod "0a84a40d-70f6-4504-8e0b-6933cc89bbfa" (UID: "0a84a40d-70f6-4504-8e0b-6933cc89bbfa"). InnerVolumeSpecName "kube-api-access-8gxrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:18:07.572497 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.572481    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-main-tls" pod "0a84a40d-70f6-4504-8e0b-6933cc89bbfa" (UID: "0a84a40d-70f6-4504-8e0b-6933cc89bbfa"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:07.575581 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.575560    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-cluster-tls-config" pod "0a84a40d-70f6-4504-8e0b-6933cc89bbfa" (UID: "0a84a40d-70f6-4504-8e0b-6933cc89bbfa"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:07.582187 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.582163    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-web-config" pod "0a84a40d-70f6-4504-8e0b-6933cc89bbfa" (UID: "0a84a40d-70f6-4504-8e0b-6933cc89bbfa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:07.669246 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.669211    5450 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:07.669246 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.669240    5450 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-web-config\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:07.669246 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.669250    5450 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:07.669580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.669261    5450 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:07.669580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.669270    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gxrn\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-kube-api-access-8gxrn\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:07.669580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.669280    5450 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-tls-assets\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:07.669580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.669290    5450 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-alertmanager-main-db\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:07.669580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.669299    5450 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-main-tls\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:07.669580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.669308    5450 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-cluster-tls-config\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:07.669580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.669316    5450 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:07.669580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:07.669326    5450 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a84a40d-70f6-4504-8e0b-6933cc89bbfa-config-out\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:08.072324 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.072280    5450 generic.go:356] "Generic (PLEG): container finished" podID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerID="64afe68227f78e633d21c32144a4f7d325d8c425999a45b97ef18d150ddcbba4" exitCode=0
Nov 04 02:18:08.072490 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.072354    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerDied","Data":"64afe68227f78e633d21c32144a4f7d325d8c425999a45b97ef18d150ddcbba4"}
Nov 04 02:18:08.072490 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.072369    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.072490 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.072427    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a84a40d-70f6-4504-8e0b-6933cc89bbfa","Type":"ContainerDied","Data":"b028decfb32c3d5780b789bdffd5da787661aa51f3d77712282d50cecfb37612"}
Nov 04 02:18:08.072490 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.072459    5450 scope.go:122] "RemoveContainer" containerID="00a8bc412276869bbc4d84aee213e7b221af2466b13135e45bf0089092dd7186"
Nov 04 02:18:08.080045 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.079946    5450 scope.go:122] "RemoveContainer" containerID="8168123f3abb3e2d4cba61b4a136682608ae06e55ab504d231c26a7242044486"
Nov 04 02:18:08.087108 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.087085    5450 scope.go:122] "RemoveContainer" containerID="00fbe3addcbd66c7461dc502c22d8b0cfb6eff4d2eb05c33883351dbda239a74"
Nov 04 02:18:08.093860 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.093841    5450 scope.go:122] "RemoveContainer" containerID="64afe68227f78e633d21c32144a4f7d325d8c425999a45b97ef18d150ddcbba4"
Nov 04 02:18:08.100588 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.100568    5450 scope.go:122] "RemoveContainer" containerID="e7fc6170dfd5ec02210835a9eb8fc9ec1a05d7f1f84c7ed51c18f37829b5a5c0"
Nov 04 02:18:08.109435 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.109414    5450 scope.go:122] "RemoveContainer" containerID="32dc24dc6c74cab47494c3a2a22ebfaf094f0227f0b0121be914eb9d14ce0c30"
Nov 04 02:18:08.116863 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.116839    5450 scope.go:122] "RemoveContainer" containerID="3d43875b82a609b9a572d1c1ceb6a1a5ba4244e9eeb6cfc7f5982a864ff8bc66"
Nov 04 02:18:08.124119 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.124099    5450 scope.go:122] "RemoveContainer" containerID="00a8bc412276869bbc4d84aee213e7b221af2466b13135e45bf0089092dd7186"
Nov 04 02:18:08.124397 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:08.124377    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00a8bc412276869bbc4d84aee213e7b221af2466b13135e45bf0089092dd7186\": container with ID starting with 00a8bc412276869bbc4d84aee213e7b221af2466b13135e45bf0089092dd7186 not found: ID does not exist" containerID="00a8bc412276869bbc4d84aee213e7b221af2466b13135e45bf0089092dd7186"
Nov 04 02:18:08.124460 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.124406    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a8bc412276869bbc4d84aee213e7b221af2466b13135e45bf0089092dd7186"} err="failed to get container status \"00a8bc412276869bbc4d84aee213e7b221af2466b13135e45bf0089092dd7186\": rpc error: code = NotFound desc = could not find container \"00a8bc412276869bbc4d84aee213e7b221af2466b13135e45bf0089092dd7186\": container with ID starting with 00a8bc412276869bbc4d84aee213e7b221af2466b13135e45bf0089092dd7186 not found: ID does not exist"
Nov 04 02:18:08.124460 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.124424    5450 scope.go:122] "RemoveContainer" containerID="8168123f3abb3e2d4cba61b4a136682608ae06e55ab504d231c26a7242044486"
Nov 04 02:18:08.124698 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:08.124681    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8168123f3abb3e2d4cba61b4a136682608ae06e55ab504d231c26a7242044486\": container with ID starting with 8168123f3abb3e2d4cba61b4a136682608ae06e55ab504d231c26a7242044486 not found: ID does not exist" containerID="8168123f3abb3e2d4cba61b4a136682608ae06e55ab504d231c26a7242044486"
Nov 04 02:18:08.124774 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.124707    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8168123f3abb3e2d4cba61b4a136682608ae06e55ab504d231c26a7242044486"} err="failed to get container status \"8168123f3abb3e2d4cba61b4a136682608ae06e55ab504d231c26a7242044486\": rpc error: code = NotFound desc = could not find container \"8168123f3abb3e2d4cba61b4a136682608ae06e55ab504d231c26a7242044486\": container with ID starting with 8168123f3abb3e2d4cba61b4a136682608ae06e55ab504d231c26a7242044486 not found: ID does not exist"
Nov 04 02:18:08.124774 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.124728    5450 scope.go:122] "RemoveContainer" containerID="00fbe3addcbd66c7461dc502c22d8b0cfb6eff4d2eb05c33883351dbda239a74"
Nov 04 02:18:08.125005 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:08.124972    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00fbe3addcbd66c7461dc502c22d8b0cfb6eff4d2eb05c33883351dbda239a74\": container with ID starting with 00fbe3addcbd66c7461dc502c22d8b0cfb6eff4d2eb05c33883351dbda239a74 not found: ID does not exist" containerID="00fbe3addcbd66c7461dc502c22d8b0cfb6eff4d2eb05c33883351dbda239a74"
Nov 04 02:18:08.125053 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.125000    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00fbe3addcbd66c7461dc502c22d8b0cfb6eff4d2eb05c33883351dbda239a74"} err="failed to get container status \"00fbe3addcbd66c7461dc502c22d8b0cfb6eff4d2eb05c33883351dbda239a74\": rpc error: code = NotFound desc = could not find container \"00fbe3addcbd66c7461dc502c22d8b0cfb6eff4d2eb05c33883351dbda239a74\": container with ID starting with 00fbe3addcbd66c7461dc502c22d8b0cfb6eff4d2eb05c33883351dbda239a74 not found: ID does not exist"
Nov 04 02:18:08.125053 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.125014    5450 scope.go:122] "RemoveContainer" containerID="64afe68227f78e633d21c32144a4f7d325d8c425999a45b97ef18d150ddcbba4"
Nov 04 02:18:08.125264 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:08.125245    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64afe68227f78e633d21c32144a4f7d325d8c425999a45b97ef18d150ddcbba4\": container with ID starting with 64afe68227f78e633d21c32144a4f7d325d8c425999a45b97ef18d150ddcbba4 not found: ID does not exist" containerID="64afe68227f78e633d21c32144a4f7d325d8c425999a45b97ef18d150ddcbba4"
Nov 04 02:18:08.125310 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.125267    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64afe68227f78e633d21c32144a4f7d325d8c425999a45b97ef18d150ddcbba4"} err="failed to get container status \"64afe68227f78e633d21c32144a4f7d325d8c425999a45b97ef18d150ddcbba4\": rpc error: code = NotFound desc = could not find container \"64afe68227f78e633d21c32144a4f7d325d8c425999a45b97ef18d150ddcbba4\": container with ID starting with 64afe68227f78e633d21c32144a4f7d325d8c425999a45b97ef18d150ddcbba4 not found: ID does not exist"
Nov 04 02:18:08.125310 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.125280    5450 scope.go:122] "RemoveContainer" containerID="e7fc6170dfd5ec02210835a9eb8fc9ec1a05d7f1f84c7ed51c18f37829b5a5c0"
Nov 04 02:18:08.125492 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:08.125470    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7fc6170dfd5ec02210835a9eb8fc9ec1a05d7f1f84c7ed51c18f37829b5a5c0\": container with ID starting with e7fc6170dfd5ec02210835a9eb8fc9ec1a05d7f1f84c7ed51c18f37829b5a5c0 not found: ID does not exist" containerID="e7fc6170dfd5ec02210835a9eb8fc9ec1a05d7f1f84c7ed51c18f37829b5a5c0"
Nov 04 02:18:08.125527 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.125498    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7fc6170dfd5ec02210835a9eb8fc9ec1a05d7f1f84c7ed51c18f37829b5a5c0"} err="failed to get container status \"e7fc6170dfd5ec02210835a9eb8fc9ec1a05d7f1f84c7ed51c18f37829b5a5c0\": rpc error: code = NotFound desc = could not find container \"e7fc6170dfd5ec02210835a9eb8fc9ec1a05d7f1f84c7ed51c18f37829b5a5c0\": container with ID starting with e7fc6170dfd5ec02210835a9eb8fc9ec1a05d7f1f84c7ed51c18f37829b5a5c0 not found: ID does not exist"
Nov 04 02:18:08.125527 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.125512    5450 scope.go:122] "RemoveContainer" containerID="32dc24dc6c74cab47494c3a2a22ebfaf094f0227f0b0121be914eb9d14ce0c30"
Nov 04 02:18:08.125785 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:08.125768    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32dc24dc6c74cab47494c3a2a22ebfaf094f0227f0b0121be914eb9d14ce0c30\": container with ID starting with 32dc24dc6c74cab47494c3a2a22ebfaf094f0227f0b0121be914eb9d14ce0c30 not found: ID does not exist" containerID="32dc24dc6c74cab47494c3a2a22ebfaf094f0227f0b0121be914eb9d14ce0c30"
Nov 04 02:18:08.125856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.125792    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32dc24dc6c74cab47494c3a2a22ebfaf094f0227f0b0121be914eb9d14ce0c30"} err="failed to get container status \"32dc24dc6c74cab47494c3a2a22ebfaf094f0227f0b0121be914eb9d14ce0c30\": rpc error: code = NotFound desc = could not find container \"32dc24dc6c74cab47494c3a2a22ebfaf094f0227f0b0121be914eb9d14ce0c30\": container with ID starting with 32dc24dc6c74cab47494c3a2a22ebfaf094f0227f0b0121be914eb9d14ce0c30 not found: ID does not exist"
Nov 04 02:18:08.125856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.125814    5450 scope.go:122] "RemoveContainer" containerID="3d43875b82a609b9a572d1c1ceb6a1a5ba4244e9eeb6cfc7f5982a864ff8bc66"
Nov 04 02:18:08.126063 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:08.126048    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d43875b82a609b9a572d1c1ceb6a1a5ba4244e9eeb6cfc7f5982a864ff8bc66\": container with ID starting with 3d43875b82a609b9a572d1c1ceb6a1a5ba4244e9eeb6cfc7f5982a864ff8bc66 not found: ID does not exist" containerID="3d43875b82a609b9a572d1c1ceb6a1a5ba4244e9eeb6cfc7f5982a864ff8bc66"
Nov 04 02:18:08.126113 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.126070    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d43875b82a609b9a572d1c1ceb6a1a5ba4244e9eeb6cfc7f5982a864ff8bc66"} err="failed to get container status \"3d43875b82a609b9a572d1c1ceb6a1a5ba4244e9eeb6cfc7f5982a864ff8bc66\": rpc error: code = NotFound desc = could not find container \"3d43875b82a609b9a572d1c1ceb6a1a5ba4244e9eeb6cfc7f5982a864ff8bc66\": container with ID starting with 3d43875b82a609b9a572d1c1ceb6a1a5ba4244e9eeb6cfc7f5982a864ff8bc66 not found: ID does not exist"
Nov 04 02:18:08.235076 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.235045    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 02:18:08.282975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.282934    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 02:18:08.283388 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283368    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 02:18:08.283720 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283701    5450 cpu_manager.go:414] "containerMap: removing container" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="alertmanager"
Nov 04 02:18:08.283720 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283717    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="alertmanager"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283734    5450 cpu_manager.go:414] "containerMap: removing container" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="kube-rbac-proxy-web"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283739    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="kube-rbac-proxy-web"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283747    5450 cpu_manager.go:414] "containerMap: removing container" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="kube-rbac-proxy"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283752    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="kube-rbac-proxy"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283758    5450 cpu_manager.go:414] "containerMap: removing container" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="config-reloader"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283762    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="config-reloader"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283771    5450 cpu_manager.go:414] "containerMap: removing container" podUID="c0855012-4612-4411-ba60-ef2a3139231b" containerName="console"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283775    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0855012-4612-4411-ba60-ef2a3139231b" containerName="console"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283785    5450 cpu_manager.go:414] "containerMap: removing container" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="init-config-reloader"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283789    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="init-config-reloader"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283798    5450 cpu_manager.go:414] "containerMap: removing container" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="prom-label-proxy"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283802    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="prom-label-proxy"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283812    5450 cpu_manager.go:414] "containerMap: removing container" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="kube-rbac-proxy-metric"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283817    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="kube-rbac-proxy-metric"
Nov 04 02:18:08.283868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283865    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="alertmanager"
Nov 04 02:18:08.284278 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283874    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="kube-rbac-proxy-web"
Nov 04 02:18:08.284278 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283887    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="kube-rbac-proxy"
Nov 04 02:18:08.284278 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283894    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="config-reloader"
Nov 04 02:18:08.284278 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283899    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0855012-4612-4411-ba60-ef2a3139231b" containerName="console"
Nov 04 02:18:08.284278 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283906    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="prom-label-proxy"
Nov 04 02:18:08.284278 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.283912    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" containerName="kube-rbac-proxy-metric"
Nov 04 02:18:08.287181 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.287163    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.374164 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.374118    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr2mn\" (UniqueName: \"kubernetes.io/projected/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-kube-api-access-lr2mn\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.374164 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.374164    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.374377 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.374233    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-web-config\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.374377 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.374310    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.374377 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.374340    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.374496 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.374379    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-config-out\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.374496 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.374398    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.374496 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.374424    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.374583 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.374507    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-config-volume\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.374583 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.374529    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.374583 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.374548    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.374583 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.374567    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.374747 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.374591    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.386903 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.386876    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 04 02:18:08.395453 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.395422    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 04 02:18:08.395453 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.395422    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 04 02:18:08.395453 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.395425    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 04 02:18:08.395716 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.395485    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 04 02:18:08.395716 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.395520    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 04 02:18:08.395716 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.395533    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 04 02:18:08.395716 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.395554    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 04 02:18:08.395716 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.395533    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bl9b9\""
Nov 04 02:18:08.395716 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.395487    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 04 02:18:08.398827 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.398804    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 02:18:08.475789 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.475751    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.475952 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.475808    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-config-volume\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.475952 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.475832    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.475952 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.475857    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.475952 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.475885    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.475952 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.475908    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.476207 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.476059    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr2mn\" (UniqueName: \"kubernetes.io/projected/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-kube-api-access-lr2mn\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.476207 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.476111    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.476207 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.476144    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-web-config\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.476207 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.476173    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.476207 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.476197    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.476463 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.476220    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-config-out\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.476463 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.476241    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.476916 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.476887    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.477741 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.477694    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.477903 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.477876    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.479105 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.479080    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.479262 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.479135    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-config-volume\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.479545 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.479477    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-config-out\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.479737 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.479715    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.479818 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.479779    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.479881 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.479854    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.479920 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.479893    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.480063 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.480049    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.480996 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.480972    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-web-config\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.537045 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.537003    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr2mn\" (UniqueName: \"kubernetes.io/projected/8a7228a5-f340-4a34-ab5b-a89ddd9832ea-kube-api-access-lr2mn\") pod \"alertmanager-main-0\" (UID: \"8a7228a5-f340-4a34-ab5b-a89ddd9832ea\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.611167 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.611077    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 04 02:18:08.630892 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:08.630857    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0a84a40d-70f6-4504-8e0b-6933cc89bbfa" path="/var/lib/kubelet/pods/0a84a40d-70f6-4504-8e0b-6933cc89bbfa/volumes"
Nov 04 02:18:09.039772 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:09.039743    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 02:18:09.046056 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:18:09.046031    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7228a5_f340_4a34_ab5b_a89ddd9832ea.slice/crio-1d21400f2ff879cbbdad65e3602e5e537c3507055d496c9fd23ef1fe5fa17329 WatchSource:0}: Error finding container 1d21400f2ff879cbbdad65e3602e5e537c3507055d496c9fd23ef1fe5fa17329: Status 404 returned error can't find the container with id 1d21400f2ff879cbbdad65e3602e5e537c3507055d496c9fd23ef1fe5fa17329
Nov 04 02:18:09.077642 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:09.077587    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a7228a5-f340-4a34-ab5b-a89ddd9832ea","Type":"ContainerStarted","Data":"1d21400f2ff879cbbdad65e3602e5e537c3507055d496c9fd23ef1fe5fa17329"}
Nov 04 02:18:10.082721 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:10.082684    5450 generic.go:356] "Generic (PLEG): container finished" podID="8a7228a5-f340-4a34-ab5b-a89ddd9832ea" containerID="51b3a809813a76ca9e5d38a9f477094882083bbd375360ab38a1afbe810c5fba" exitCode=0
Nov 04 02:18:10.083193 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:10.082751    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a7228a5-f340-4a34-ab5b-a89ddd9832ea","Type":"ContainerDied","Data":"51b3a809813a76ca9e5d38a9f477094882083bbd375360ab38a1afbe810c5fba"}
Nov 04 02:18:11.096415 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:11.096378    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a7228a5-f340-4a34-ab5b-a89ddd9832ea","Type":"ContainerStarted","Data":"c550e437f82446b0368712b79485fcbbeb3f3ce80f499ab5e654588267a8815a"}
Nov 04 02:18:11.096870 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:11.096488    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a7228a5-f340-4a34-ab5b-a89ddd9832ea","Type":"ContainerStarted","Data":"d1a881c0df1f91dc03a5c9e88639648ec4bce810ac5e37686f9a9c41e2be15ff"}
Nov 04 02:18:11.096870 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:11.096529    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a7228a5-f340-4a34-ab5b-a89ddd9832ea","Type":"ContainerStarted","Data":"f0cc57bd0c1d3fb9eadd35bc8f90f5611c01353c90f2d1b4a5b7069dcca2d2d0"}
Nov 04 02:18:11.096870 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:11.096563    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a7228a5-f340-4a34-ab5b-a89ddd9832ea","Type":"ContainerStarted","Data":"566c66e794ad49794fa68a9583adadaaf3e9a28f81776715ac2674dd95cea8f5"}
Nov 04 02:18:11.096870 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:11.096613    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a7228a5-f340-4a34-ab5b-a89ddd9832ea","Type":"ContainerStarted","Data":"9f41113ba51263f0d7c6ca81e3f84f6d29fc04f4e6fea795daa72507d4270bfa"}
Nov 04 02:18:11.096870 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:11.096649    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8a7228a5-f340-4a34-ab5b-a89ddd9832ea","Type":"ContainerStarted","Data":"50193a3d5b1d4e6b763a4daec77455781ef98d245a80fae89e94e47111729dab"}
Nov 04 02:18:11.223410 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:11.223359    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.211762828 podStartE2EDuration="3.223346543s" totalImagesPullingTime="0s" totalInitContainerRuntime="11.583715ms" isStatefulPod=false podCreationTimestamp="2026-11-04 02:18:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:18:11.222827505 +0000 UTC m=+86.726768025" watchObservedRunningTime="2026-11-04 02:18:11.223346543 +0000 UTC m=+86.727287027"
Nov 04 02:18:12.062965 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.062931    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 02:18:12.063501 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.063259    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="prometheus" containerID="cri-o://a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9" gracePeriod=600
Nov 04 02:18:12.063501 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.063324    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="kube-rbac-proxy-web" containerID="cri-o://17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6" gracePeriod=600
Nov 04 02:18:12.063501 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.063352    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="config-reloader" containerID="cri-o://8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147" gracePeriod=600
Nov 04 02:18:12.063501 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.063324    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c" gracePeriod=600
Nov 04 02:18:12.063501 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.063267    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="kube-rbac-proxy" containerID="cri-o://0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f" gracePeriod=600
Nov 04 02:18:12.063501 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.063330    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="thanos-sidecar" containerID="cri-o://076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf" gracePeriod=600
Nov 04 02:18:12.326748 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.326720    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:12.413144 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413108    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-kubelet-serving-ca-bundle\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413144 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413147    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-tls-assets\" (UniqueName: \"kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-tls-assets\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413173    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-web-config\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-web-config\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413196    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-1\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413215    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-metrics-client-certs\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413233    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-db\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413254    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-config-out\" (UniqueName: \"kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-config-out\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413304    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-kube-rbac-proxy\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413344    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-2\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413377    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-thanos-prometheus-http-client-file\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413395    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-config\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-config\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413836 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413429    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-tls\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413836 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413457    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413836 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413490    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-0\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413836 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413520    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-metrics-client-ca\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413836 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413555    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-kube-api-access-pwhfj\" (UniqueName: \"kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-kube-api-access-pwhfj\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413836 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413587    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-serving-certs-ca-bundle\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413836 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413644    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413836 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413693    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-grpc-tls\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413836 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413689    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-kubelet-serving-ca-bundle" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:18:12.413836 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413750    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-trusted-ca-bundle\") pod \"e777a6a4-21ab-4c5a-9760-47ac58139479\" (UID: \"e777a6a4-21ab-4c5a-9760-47ac58139479\") "
Nov 04 02:18:12.413836 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.413758    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-1" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:18:12.414365 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.414050    5450 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.415734 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.414579    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-2" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:18:12.415855 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.415777    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-db" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:18:12.415855 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.415784    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-tls-assets" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:18:12.416204 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.416163    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-metrics-client-ca" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:18:12.416288 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.416265    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-metrics-client-certs" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:12.416396 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.416367    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-kube-rbac-proxy" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:12.416688 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.416659    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-trusted-ca-bundle" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:18:12.416761 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.416742    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-serving-certs-ca-bundle" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:18:12.416761 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.416754    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-config-out" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:18:12.416965 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.416936    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-config" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:12.417625 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.417584    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-0" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:18:12.417942 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.417900    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-kube-api-access-pwhfj" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "kube-api-access-pwhfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:18:12.417942 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.417920    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-tls" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:12.418092 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.418007    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-thanos-prometheus-http-client-file" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:12.418135 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.418089    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-grpc-tls" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:12.419008 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.418982    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-thanos-sidecar-tls" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:12.419239 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.419209    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-kube-rbac-proxy-web" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:12.426782 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.426760    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-web-config" pod "e777a6a4-21ab-4c5a-9760-47ac58139479" (UID: "e777a6a4-21ab-4c5a-9760-47ac58139479"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:12.515231 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515194    5450 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515231 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515225    5450 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-metrics-client-ca\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515231 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515239    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwhfj\" (UniqueName: \"kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-kube-api-access-pwhfj\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515252    5450 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515265    5450 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515278    5450 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-grpc-tls\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515290    5450 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515302    5450 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515314    5450 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e777a6a4-21ab-4c5a-9760-47ac58139479-tls-assets\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515326    5450 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-web-config\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515338    5450 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-metrics-client-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515352    5450 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-db\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515365    5450 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e777a6a4-21ab-4c5a-9760-47ac58139479-config-out\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515378    5450 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-kube-rbac-proxy\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515392    5450 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e777a6a4-21ab-4c5a-9760-47ac58139479-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515406    5450 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515418    5450 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-config\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515433    5450 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:12.515495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:12.515448    5450 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e777a6a4-21ab-4c5a-9760-47ac58139479-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:13.109642 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109608    5450 generic.go:356] "Generic (PLEG): container finished" podID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerID="8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c" exitCode=0
Nov 04 02:18:13.109642 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109637    5450 generic.go:356] "Generic (PLEG): container finished" podID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerID="0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f" exitCode=0
Nov 04 02:18:13.109642 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109645    5450 generic.go:356] "Generic (PLEG): container finished" podID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerID="17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6" exitCode=0
Nov 04 02:18:13.109912 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109651    5450 generic.go:356] "Generic (PLEG): container finished" podID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerID="076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf" exitCode=0
Nov 04 02:18:13.109912 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109642    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerDied","Data":"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"}
Nov 04 02:18:13.109912 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109721    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.109912 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109658    5450 generic.go:356] "Generic (PLEG): container finished" podID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerID="8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147" exitCode=0
Nov 04 02:18:13.109912 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109740    5450 scope.go:122] "RemoveContainer" containerID="8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"
Nov 04 02:18:13.109912 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109750    5450 generic.go:356] "Generic (PLEG): container finished" podID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerID="a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9" exitCode=0
Nov 04 02:18:13.109912 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109726    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerDied","Data":"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"}
Nov 04 02:18:13.109912 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109854    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerDied","Data":"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"}
Nov 04 02:18:13.109912 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109898    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerDied","Data":"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"}
Nov 04 02:18:13.110243 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109940    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerDied","Data":"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"}
Nov 04 02:18:13.110243 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.109979    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerDied","Data":"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"}
Nov 04 02:18:13.110243 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.110016    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e777a6a4-21ab-4c5a-9760-47ac58139479","Type":"ContainerDied","Data":"e130f958812fa4bade3d2181c9216fb72330955b697dd8c7de5c29cea2b4600c"}
Nov 04 02:18:13.120570 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.119407    5450 scope.go:122] "RemoveContainer" containerID="0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"
Nov 04 02:18:13.126669 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.126650    5450 scope.go:122] "RemoveContainer" containerID="17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"
Nov 04 02:18:13.132993 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.132973    5450 scope.go:122] "RemoveContainer" containerID="076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"
Nov 04 02:18:13.139328 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.139307    5450 scope.go:122] "RemoveContainer" containerID="8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"
Nov 04 02:18:13.145656 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.145642    5450 scope.go:122] "RemoveContainer" containerID="a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"
Nov 04 02:18:13.151973 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.151954    5450 scope.go:122] "RemoveContainer" containerID="da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"
Nov 04 02:18:13.158187 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.158171    5450 scope.go:122] "RemoveContainer" containerID="8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"
Nov 04 02:18:13.158473 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:13.158426    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c\": container with ID starting with 8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c not found: ID does not exist" containerID="8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"
Nov 04 02:18:13.158521 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.158481    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"} err="failed to get container status \"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c\": rpc error: code = NotFound desc = could not find container \"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c\": container with ID starting with 8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c not found: ID does not exist"
Nov 04 02:18:13.158521 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.158498    5450 scope.go:122] "RemoveContainer" containerID="0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"
Nov 04 02:18:13.158740 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:13.158725    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f\": container with ID starting with 0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f not found: ID does not exist" containerID="0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"
Nov 04 02:18:13.158788 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.158747    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"} err="failed to get container status \"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f\": rpc error: code = NotFound desc = could not find container \"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f\": container with ID starting with 0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f not found: ID does not exist"
Nov 04 02:18:13.158788 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.158762    5450 scope.go:122] "RemoveContainer" containerID="17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"
Nov 04 02:18:13.159029 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:13.159000    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6\": container with ID starting with 17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6 not found: ID does not exist" containerID="17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"
Nov 04 02:18:13.159109 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.159038    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"} err="failed to get container status \"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6\": rpc error: code = NotFound desc = could not find container \"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6\": container with ID starting with 17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6 not found: ID does not exist"
Nov 04 02:18:13.159109 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.159061    5450 scope.go:122] "RemoveContainer" containerID="076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"
Nov 04 02:18:13.159521 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:13.159497    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf\": container with ID starting with 076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf not found: ID does not exist" containerID="076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"
Nov 04 02:18:13.159625 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.159525    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"} err="failed to get container status \"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf\": rpc error: code = NotFound desc = could not find container \"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf\": container with ID starting with 076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf not found: ID does not exist"
Nov 04 02:18:13.159625 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.159541    5450 scope.go:122] "RemoveContainer" containerID="8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"
Nov 04 02:18:13.159840 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:13.159823    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147\": container with ID starting with 8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147 not found: ID does not exist" containerID="8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"
Nov 04 02:18:13.159876 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.159845    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"} err="failed to get container status \"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147\": rpc error: code = NotFound desc = could not find container \"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147\": container with ID starting with 8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147 not found: ID does not exist"
Nov 04 02:18:13.159876 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.159859    5450 scope.go:122] "RemoveContainer" containerID="a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"
Nov 04 02:18:13.160104 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:13.160089    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9\": container with ID starting with a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9 not found: ID does not exist" containerID="a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"
Nov 04 02:18:13.160147 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.160106    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"} err="failed to get container status \"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9\": rpc error: code = NotFound desc = could not find container \"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9\": container with ID starting with a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9 not found: ID does not exist"
Nov 04 02:18:13.160147 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.160118    5450 scope.go:122] "RemoveContainer" containerID="da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"
Nov 04 02:18:13.160390 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:13.160367    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952\": container with ID starting with da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952 not found: ID does not exist" containerID="da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"
Nov 04 02:18:13.160425 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.160401    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"} err="failed to get container status \"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952\": rpc error: code = NotFound desc = could not find container \"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952\": container with ID starting with da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952 not found: ID does not exist"
Nov 04 02:18:13.160425 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.160418    5450 scope.go:122] "RemoveContainer" containerID="8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"
Nov 04 02:18:13.160719 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.160695    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"} err="failed to get container status \"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c\": rpc error: code = NotFound desc = could not find container \"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c\": container with ID starting with 8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c not found: ID does not exist"
Nov 04 02:18:13.160772 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.160721    5450 scope.go:122] "RemoveContainer" containerID="0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"
Nov 04 02:18:13.160983 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.160964    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"} err="failed to get container status \"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f\": rpc error: code = NotFound desc = could not find container \"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f\": container with ID starting with 0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f not found: ID does not exist"
Nov 04 02:18:13.161029 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.160984    5450 scope.go:122] "RemoveContainer" containerID="17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"
Nov 04 02:18:13.161226 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.161209    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"} err="failed to get container status \"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6\": rpc error: code = NotFound desc = could not find container \"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6\": container with ID starting with 17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6 not found: ID does not exist"
Nov 04 02:18:13.161305 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.161227    5450 scope.go:122] "RemoveContainer" containerID="076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"
Nov 04 02:18:13.161470 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.161450    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"} err="failed to get container status \"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf\": rpc error: code = NotFound desc = could not find container \"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf\": container with ID starting with 076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf not found: ID does not exist"
Nov 04 02:18:13.161511 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.161472    5450 scope.go:122] "RemoveContainer" containerID="8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"
Nov 04 02:18:13.161721 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.161703    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"} err="failed to get container status \"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147\": rpc error: code = NotFound desc = could not find container \"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147\": container with ID starting with 8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147 not found: ID does not exist"
Nov 04 02:18:13.161781 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.161721    5450 scope.go:122] "RemoveContainer" containerID="a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"
Nov 04 02:18:13.161930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.161912    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"} err="failed to get container status \"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9\": rpc error: code = NotFound desc = could not find container \"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9\": container with ID starting with a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9 not found: ID does not exist"
Nov 04 02:18:13.161971 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.161932    5450 scope.go:122] "RemoveContainer" containerID="da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"
Nov 04 02:18:13.162145 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.162127    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"} err="failed to get container status \"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952\": rpc error: code = NotFound desc = could not find container \"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952\": container with ID starting with da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952 not found: ID does not exist"
Nov 04 02:18:13.162187 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.162145    5450 scope.go:122] "RemoveContainer" containerID="8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"
Nov 04 02:18:13.162361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.162342    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"} err="failed to get container status \"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c\": rpc error: code = NotFound desc = could not find container \"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c\": container with ID starting with 8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c not found: ID does not exist"
Nov 04 02:18:13.162413 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.162362    5450 scope.go:122] "RemoveContainer" containerID="0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"
Nov 04 02:18:13.162590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.162571    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"} err="failed to get container status \"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f\": rpc error: code = NotFound desc = could not find container \"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f\": container with ID starting with 0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f not found: ID does not exist"
Nov 04 02:18:13.162661 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.162589    5450 scope.go:122] "RemoveContainer" containerID="17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"
Nov 04 02:18:13.162839 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.162824    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"} err="failed to get container status \"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6\": rpc error: code = NotFound desc = could not find container \"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6\": container with ID starting with 17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6 not found: ID does not exist"
Nov 04 02:18:13.162879 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.162839    5450 scope.go:122] "RemoveContainer" containerID="076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"
Nov 04 02:18:13.163044 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.163029    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"} err="failed to get container status \"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf\": rpc error: code = NotFound desc = could not find container \"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf\": container with ID starting with 076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf not found: ID does not exist"
Nov 04 02:18:13.163086 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.163044    5450 scope.go:122] "RemoveContainer" containerID="8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"
Nov 04 02:18:13.163231 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.163216    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"} err="failed to get container status \"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147\": rpc error: code = NotFound desc = could not find container \"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147\": container with ID starting with 8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147 not found: ID does not exist"
Nov 04 02:18:13.163271 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.163231    5450 scope.go:122] "RemoveContainer" containerID="a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"
Nov 04 02:18:13.163408 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.163394    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"} err="failed to get container status \"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9\": rpc error: code = NotFound desc = could not find container \"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9\": container with ID starting with a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9 not found: ID does not exist"
Nov 04 02:18:13.163449 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.163408    5450 scope.go:122] "RemoveContainer" containerID="da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"
Nov 04 02:18:13.163585 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.163570    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"} err="failed to get container status \"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952\": rpc error: code = NotFound desc = could not find container \"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952\": container with ID starting with da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952 not found: ID does not exist"
Nov 04 02:18:13.163640 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.163585    5450 scope.go:122] "RemoveContainer" containerID="8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"
Nov 04 02:18:13.163777 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.163762    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"} err="failed to get container status \"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c\": rpc error: code = NotFound desc = could not find container \"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c\": container with ID starting with 8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c not found: ID does not exist"
Nov 04 02:18:13.163817 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.163777    5450 scope.go:122] "RemoveContainer" containerID="0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"
Nov 04 02:18:13.163954 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.163939    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"} err="failed to get container status \"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f\": rpc error: code = NotFound desc = could not find container \"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f\": container with ID starting with 0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f not found: ID does not exist"
Nov 04 02:18:13.163987 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.163954    5450 scope.go:122] "RemoveContainer" containerID="17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"
Nov 04 02:18:13.164137 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.164119    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"} err="failed to get container status \"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6\": rpc error: code = NotFound desc = could not find container \"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6\": container with ID starting with 17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6 not found: ID does not exist"
Nov 04 02:18:13.164181 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.164140    5450 scope.go:122] "RemoveContainer" containerID="076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"
Nov 04 02:18:13.164342 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.164328    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"} err="failed to get container status \"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf\": rpc error: code = NotFound desc = could not find container \"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf\": container with ID starting with 076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf not found: ID does not exist"
Nov 04 02:18:13.164382 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.164342    5450 scope.go:122] "RemoveContainer" containerID="8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"
Nov 04 02:18:13.164530 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.164516    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"} err="failed to get container status \"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147\": rpc error: code = NotFound desc = could not find container \"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147\": container with ID starting with 8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147 not found: ID does not exist"
Nov 04 02:18:13.164575 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.164530    5450 scope.go:122] "RemoveContainer" containerID="a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"
Nov 04 02:18:13.164743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.164727    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"} err="failed to get container status \"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9\": rpc error: code = NotFound desc = could not find container \"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9\": container with ID starting with a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9 not found: ID does not exist"
Nov 04 02:18:13.164795 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.164744    5450 scope.go:122] "RemoveContainer" containerID="da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"
Nov 04 02:18:13.164935 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.164920    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"} err="failed to get container status \"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952\": rpc error: code = NotFound desc = could not find container \"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952\": container with ID starting with da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952 not found: ID does not exist"
Nov 04 02:18:13.164981 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.164935    5450 scope.go:122] "RemoveContainer" containerID="8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"
Nov 04 02:18:13.165118 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.165103    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"} err="failed to get container status \"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c\": rpc error: code = NotFound desc = could not find container \"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c\": container with ID starting with 8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c not found: ID does not exist"
Nov 04 02:18:13.165163 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.165120    5450 scope.go:122] "RemoveContainer" containerID="0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"
Nov 04 02:18:13.165308 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.165291    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"} err="failed to get container status \"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f\": rpc error: code = NotFound desc = could not find container \"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f\": container with ID starting with 0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f not found: ID does not exist"
Nov 04 02:18:13.165357 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.165309    5450 scope.go:122] "RemoveContainer" containerID="17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"
Nov 04 02:18:13.165517 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.165498    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"} err="failed to get container status \"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6\": rpc error: code = NotFound desc = could not find container \"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6\": container with ID starting with 17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6 not found: ID does not exist"
Nov 04 02:18:13.165517 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.165513    5450 scope.go:122] "RemoveContainer" containerID="076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"
Nov 04 02:18:13.165783 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.165757    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"} err="failed to get container status \"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf\": rpc error: code = NotFound desc = could not find container \"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf\": container with ID starting with 076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf not found: ID does not exist"
Nov 04 02:18:13.165783 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.165782    5450 scope.go:122] "RemoveContainer" containerID="8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"
Nov 04 02:18:13.166059 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.166034    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"} err="failed to get container status \"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147\": rpc error: code = NotFound desc = could not find container \"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147\": container with ID starting with 8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147 not found: ID does not exist"
Nov 04 02:18:13.166059 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.166056    5450 scope.go:122] "RemoveContainer" containerID="a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"
Nov 04 02:18:13.166315 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.166294    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"} err="failed to get container status \"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9\": rpc error: code = NotFound desc = could not find container \"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9\": container with ID starting with a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9 not found: ID does not exist"
Nov 04 02:18:13.166315 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.166314    5450 scope.go:122] "RemoveContainer" containerID="da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"
Nov 04 02:18:13.166617 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.166574    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"} err="failed to get container status \"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952\": rpc error: code = NotFound desc = could not find container \"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952\": container with ID starting with da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952 not found: ID does not exist"
Nov 04 02:18:13.166617 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.166611    5450 scope.go:122] "RemoveContainer" containerID="8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"
Nov 04 02:18:13.166896 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.166875    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c"} err="failed to get container status \"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c\": rpc error: code = NotFound desc = could not find container \"8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c\": container with ID starting with 8e5e0d9ffb6f9b133e8d89ae922ddf559f5d18639d792afb26a06f2b175a364c not found: ID does not exist"
Nov 04 02:18:13.166896 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.166895    5450 scope.go:122] "RemoveContainer" containerID="0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"
Nov 04 02:18:13.167159 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.167139    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f"} err="failed to get container status \"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f\": rpc error: code = NotFound desc = could not find container \"0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f\": container with ID starting with 0767b79faa68ccf0ffd36bd6237a964dc1238be64d312e16b36b7af00ad8086f not found: ID does not exist"
Nov 04 02:18:13.167159 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.167158    5450 scope.go:122] "RemoveContainer" containerID="17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"
Nov 04 02:18:13.167408 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.167389    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6"} err="failed to get container status \"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6\": rpc error: code = NotFound desc = could not find container \"17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6\": container with ID starting with 17db8b4887aa227e44c68985285ff1e711845bb4feced6b95e06e68cf7f998a6 not found: ID does not exist"
Nov 04 02:18:13.167408 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.167408    5450 scope.go:122] "RemoveContainer" containerID="076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"
Nov 04 02:18:13.167697 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.167677    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf"} err="failed to get container status \"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf\": rpc error: code = NotFound desc = could not find container \"076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf\": container with ID starting with 076e53d2bfb839eb832f031f88e003d2628024430a9b8c7b99a775c83d0e87cf not found: ID does not exist"
Nov 04 02:18:13.167785 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.167702    5450 scope.go:122] "RemoveContainer" containerID="8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"
Nov 04 02:18:13.167941 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.167921    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147"} err="failed to get container status \"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147\": rpc error: code = NotFound desc = could not find container \"8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147\": container with ID starting with 8a21c2e7ff0b15538ebe2b1de884bda81d2091327c121ce33453fa03b139b147 not found: ID does not exist"
Nov 04 02:18:13.167941 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.167939    5450 scope.go:122] "RemoveContainer" containerID="a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"
Nov 04 02:18:13.168229 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.168197    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9"} err="failed to get container status \"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9\": rpc error: code = NotFound desc = could not find container \"a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9\": container with ID starting with a14aacdb7a5dc054be1e90e9ea8c216ed605a0695267085cab20b632750846c9 not found: ID does not exist"
Nov 04 02:18:13.168309 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.168231    5450 scope.go:122] "RemoveContainer" containerID="da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"
Nov 04 02:18:13.168504 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.168481    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952"} err="failed to get container status \"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952\": rpc error: code = NotFound desc = could not find container \"da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952\": container with ID starting with da4233571533738ac02a3300b215d8db721283f8daf0ef3a3f26e58190933952 not found: ID does not exist"
Nov 04 02:18:13.271890 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.271858    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 02:18:13.319870 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.319840    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 02:18:13.320419 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320402    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 02:18:13.320765 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320751    5450 cpu_manager.go:414] "containerMap: removing container" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="kube-rbac-proxy"
Nov 04 02:18:13.320815 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320768    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="kube-rbac-proxy"
Nov 04 02:18:13.320815 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320778    5450 cpu_manager.go:414] "containerMap: removing container" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="prometheus"
Nov 04 02:18:13.320815 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320783    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="prometheus"
Nov 04 02:18:13.320815 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320793    5450 cpu_manager.go:414] "containerMap: removing container" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="kube-rbac-proxy-web"
Nov 04 02:18:13.320815 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320798    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="kube-rbac-proxy-web"
Nov 04 02:18:13.320815 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320807    5450 cpu_manager.go:414] "containerMap: removing container" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="thanos-sidecar"
Nov 04 02:18:13.320815 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320812    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="thanos-sidecar"
Nov 04 02:18:13.321002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320820    5450 cpu_manager.go:414] "containerMap: removing container" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="kube-rbac-proxy-thanos"
Nov 04 02:18:13.321002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320828    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="kube-rbac-proxy-thanos"
Nov 04 02:18:13.321002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320845    5450 cpu_manager.go:414] "containerMap: removing container" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="init-config-reloader"
Nov 04 02:18:13.321002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320855    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="init-config-reloader"
Nov 04 02:18:13.321002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320864    5450 cpu_manager.go:414] "containerMap: removing container" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="config-reloader"
Nov 04 02:18:13.321002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320868    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="config-reloader"
Nov 04 02:18:13.321002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320935    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="thanos-sidecar"
Nov 04 02:18:13.321002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320943    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="kube-rbac-proxy-thanos"
Nov 04 02:18:13.321002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320950    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="config-reloader"
Nov 04 02:18:13.321002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320958    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="kube-rbac-proxy"
Nov 04 02:18:13.321002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320963    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="prometheus"
Nov 04 02:18:13.321002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.320970    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" containerName="kube-rbac-proxy-web"
Nov 04 02:18:13.328640 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.328575    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.379410 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.379380    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 04 02:18:13.379410 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.379380    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 04 02:18:13.379764 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.379720    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 04 02:18:13.379862 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.379726    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 04 02:18:13.379862 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.379750    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-pcp779l7m90v\""
Nov 04 02:18:13.380079 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.380063    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 04 02:18:13.380186 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.380171    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 04 02:18:13.380339 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.380321    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 04 02:18:13.380400 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.380360    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 04 02:18:13.380400 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.380388    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 04 02:18:13.380498 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.380447    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 04 02:18:13.380547 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.380512    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 04 02:18:13.380547 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.380520    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sqxgb\""
Nov 04 02:18:13.380665 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.380584    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 04 02:18:13.425542 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.425516    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5353ff64-a4c2-4eea-840f-f072db82beca-config-out\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.425542 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.425543    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.425736 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.425564    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.425736 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.425580    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.425736 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.425616    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.425890 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.425762    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.425890 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.425786    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.425890 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.425811    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.425890 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.425883    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-web-config\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.426090 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.425913    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.426090 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.425938    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.426090 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.425960    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.426090 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.426050    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.426090 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.426075    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5353ff64-a4c2-4eea-840f-f072db82beca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.426331 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.426095    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-config\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.426331 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.426111    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.426331 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.426169    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.426331 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.426200    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.426331 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.426235    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.426331 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.426311    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqcnv\" (UniqueName: \"kubernetes.io/projected/5353ff64-a4c2-4eea-840f-f072db82beca-kube-api-access-zqcnv\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.428895 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.428874    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 04 02:18:13.429003 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.428949    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 04 02:18:13.430239 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.430205    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 02:18:13.527391 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527351    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.527391 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527392    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5353ff64-a4c2-4eea-840f-f072db82beca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.527677 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527414    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-config\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.527677 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527437    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.527677 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527456    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.527677 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527473    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.527677 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527497    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.527677 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527516    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqcnv\" (UniqueName: \"kubernetes.io/projected/5353ff64-a4c2-4eea-840f-f072db82beca-kube-api-access-zqcnv\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.527677 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527561    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5353ff64-a4c2-4eea-840f-f072db82beca-config-out\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.527677 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527587    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.527677 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527655    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.527677 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527680    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.528197 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527695    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.528197 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527729    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.528197 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527751    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.528197 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527777    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.528197 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527804    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-web-config\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.528197 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527836    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.528197 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527867    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.528197 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.527892    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.528584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.528397    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.528584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.528519    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.528970 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.528948    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.528970 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.528960    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.529938 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.529647    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.529938 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.529680    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.530546 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.530518    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-config\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.531222 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.531191    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.531677 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.531636    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.531773 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.531713    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.532024 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.531996    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.532261 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.532240    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-web-config\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.532261 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.532253    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.532448 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.532433    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5353ff64-a4c2-4eea-840f-f072db82beca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.532902 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.532884    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5353ff64-a4c2-4eea-840f-f072db82beca-config-out\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.533057 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.533036    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5353ff64-a4c2-4eea-840f-f072db82beca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.533489 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.533467    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.533641 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.533625    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.533641 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.533633    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5353ff64-a4c2-4eea-840f-f072db82beca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.588663 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.588585    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqcnv\" (UniqueName: \"kubernetes.io/projected/5353ff64-a4c2-4eea-840f-f072db82beca-kube-api-access-zqcnv\") pod \"prometheus-k8s-0\" (UID: \"5353ff64-a4c2-4eea-840f-f072db82beca\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:13.647234 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:13.647202    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:14.083533 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:14.083503    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 02:18:14.089910 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:18:14.089877    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5353ff64_a4c2_4eea_840f_f072db82beca.slice/crio-6867ee4c030b3749c03636c1f3d49a0ad07e5864d58606efd7008022dc85650f WatchSource:0}: Error finding container 6867ee4c030b3749c03636c1f3d49a0ad07e5864d58606efd7008022dc85650f: Status 404 returned error can't find the container with id 6867ee4c030b3749c03636c1f3d49a0ad07e5864d58606efd7008022dc85650f
Nov 04 02:18:14.116973 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:14.116939    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5353ff64-a4c2-4eea-840f-f072db82beca","Type":"ContainerStarted","Data":"6867ee4c030b3749c03636c1f3d49a0ad07e5864d58606efd7008022dc85650f"}
Nov 04 02:18:14.630697 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:14.630665    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e777a6a4-21ab-4c5a-9760-47ac58139479" path="/var/lib/kubelet/pods/e777a6a4-21ab-4c5a-9760-47ac58139479/volumes"
Nov 04 02:18:15.122630 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:15.122578    5450 generic.go:356] "Generic (PLEG): container finished" podID="5353ff64-a4c2-4eea-840f-f072db82beca" containerID="8ebb55a426233f0c14f383c57698f0e4971fdef029b62f55d46a8a7a99cd5fac" exitCode=0
Nov 04 02:18:15.122789 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:15.122662    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5353ff64-a4c2-4eea-840f-f072db82beca","Type":"ContainerDied","Data":"8ebb55a426233f0c14f383c57698f0e4971fdef029b62f55d46a8a7a99cd5fac"}
Nov 04 02:18:16.129585 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:16.129545    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5353ff64-a4c2-4eea-840f-f072db82beca","Type":"ContainerStarted","Data":"c4a64fcf9f500b061fca1d5e41a9ebf938196d8157ee2aa1695198871e08acc4"}
Nov 04 02:18:16.130011 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:16.129648    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5353ff64-a4c2-4eea-840f-f072db82beca","Type":"ContainerStarted","Data":"d768a8ff74eee4a246ae6bd3d99c127488242176111a2ec2c537c131e6135226"}
Nov 04 02:18:16.130011 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:16.129689    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5353ff64-a4c2-4eea-840f-f072db82beca","Type":"ContainerStarted","Data":"9da41575b1a96e392beb7914e18fbe3b7bc90f2ff6896c07c0ce3601d7ce1cb9"}
Nov 04 02:18:16.130011 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:16.129724    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5353ff64-a4c2-4eea-840f-f072db82beca","Type":"ContainerStarted","Data":"69dc545564b086042f26f90707bd2438269c63bf8509b05eac4fd9583c07cdf3"}
Nov 04 02:18:16.130011 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:16.129757    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5353ff64-a4c2-4eea-840f-f072db82beca","Type":"ContainerStarted","Data":"f21997c0e80cf3138a7103d214edfa80f826d779bd822576e110e1e5c3c1f62f"}
Nov 04 02:18:16.130011 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:16.129792    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5353ff64-a4c2-4eea-840f-f072db82beca","Type":"ContainerStarted","Data":"d9b8cdf9b2de4a59be67fec615f58f9220d43f0ed7de71631d1d23749b6e0c15"}
Nov 04 02:18:16.258902 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:16.258856    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.243049031 podStartE2EDuration="3.258841445s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.792414ms" isStatefulPod=false podCreationTimestamp="2026-11-04 02:18:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:18:16.258423669 +0000 UTC m=+91.762364162" watchObservedRunningTime="2026-11-04 02:18:16.258841445 +0000 UTC m=+91.762782303"
Nov 04 02:18:17.762743 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:17.762706    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:18:18.647838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:18:18.647804    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:18:47.767330 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:18:47.767278    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:19:13.647644 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:19:13.647582    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:19:13.662989 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:19:13.662964    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:19:14.354956 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:19:14.354931    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 02:19:17.763286 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:19:17.763246    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:19:47.763883 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:19:47.763840    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:20:17.763055 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:20:17.763013    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:20:47.763576 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:20:47.763541    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:20:51.406364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:51.406325    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-bld85"]
Nov 04 02:20:51.408917 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:51.408899    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-bld85"
Nov 04 02:20:51.485482 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:51.485443    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftmhg\" (UniqueName: \"kubernetes.io/projected/d8d13871-ce3d-42c5-b793-5880eedbb198-kube-api-access-ftmhg\") pod \"jobset-operator-674cd59dc5-bld85\" (UID: \"d8d13871-ce3d-42c5-b793-5880eedbb198\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-bld85"
Nov 04 02:20:51.485687 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:51.485523    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8d13871-ce3d-42c5-b793-5880eedbb198-tmp\") pod \"jobset-operator-674cd59dc5-bld85\" (UID: \"d8d13871-ce3d-42c5-b793-5880eedbb198\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-bld85"
Nov 04 02:20:51.511507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:51.511475    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Nov 04 02:20:51.511713 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:51.511539    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:20:51.511713 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:51.511557    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-j5vzk\""
Nov 04 02:20:51.512361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:51.512342    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-bld85"]
Nov 04 02:20:51.586862 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:51.586823    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmhg\" (UniqueName: \"kubernetes.io/projected/d8d13871-ce3d-42c5-b793-5880eedbb198-kube-api-access-ftmhg\") pod \"jobset-operator-674cd59dc5-bld85\" (UID: \"d8d13871-ce3d-42c5-b793-5880eedbb198\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-bld85"
Nov 04 02:20:51.587055 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:51.586886    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8d13871-ce3d-42c5-b793-5880eedbb198-tmp\") pod \"jobset-operator-674cd59dc5-bld85\" (UID: \"d8d13871-ce3d-42c5-b793-5880eedbb198\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-bld85"
Nov 04 02:20:51.587282 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:51.587265    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8d13871-ce3d-42c5-b793-5880eedbb198-tmp\") pod \"jobset-operator-674cd59dc5-bld85\" (UID: \"d8d13871-ce3d-42c5-b793-5880eedbb198\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-bld85"
Nov 04 02:20:51.646293 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:51.646259    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftmhg\" (UniqueName: \"kubernetes.io/projected/d8d13871-ce3d-42c5-b793-5880eedbb198-kube-api-access-ftmhg\") pod \"jobset-operator-674cd59dc5-bld85\" (UID: \"d8d13871-ce3d-42c5-b793-5880eedbb198\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-bld85"
Nov 04 02:20:51.730804 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:51.730718    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-bld85"
Nov 04 02:20:52.103805 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:52.103769    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-bld85"]
Nov 04 02:20:52.110588 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:20:52.110553    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8d13871_ce3d_42c5_b793_5880eedbb198.slice/crio-a12991afc5e0cef2cec5cecea4e69dc09f1c6eede5d3d349eb79493596132e08 WatchSource:0}: Error finding container a12991afc5e0cef2cec5cecea4e69dc09f1c6eede5d3d349eb79493596132e08: Status 404 returned error can't find the container with id a12991afc5e0cef2cec5cecea4e69dc09f1c6eede5d3d349eb79493596132e08
Nov 04 02:20:52.698467 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:52.698432    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-bld85" event={"ID":"d8d13871-ce3d-42c5-b793-5880eedbb198","Type":"ContainerStarted","Data":"a12991afc5e0cef2cec5cecea4e69dc09f1c6eede5d3d349eb79493596132e08"}
Nov 04 02:20:56.443127 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:56.443086    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w"]
Nov 04 02:20:56.447725 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:56.447694    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w"
Nov 04 02:20:56.500233 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:56.500199    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w"]
Nov 04 02:20:56.530648 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:56.530611    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zzps\" (UniqueName: \"kubernetes.io/projected/54bf5aa7-2595-4620-8eec-e256cafab36d-kube-api-access-8zzps\") pod \"cert-manager-cainjector-5c57bbd4fc-7r89w\" (UID: \"54bf5aa7-2595-4620-8eec-e256cafab36d\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w"
Nov 04 02:20:56.530813 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:56.530694    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54bf5aa7-2595-4620-8eec-e256cafab36d-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-7r89w\" (UID: \"54bf5aa7-2595-4620-8eec-e256cafab36d\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w"
Nov 04 02:20:56.547207 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:56.547175    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Nov 04 02:20:56.547387 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:56.547257    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rmvz2\""
Nov 04 02:20:56.547387 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:56.547307    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Nov 04 02:20:56.631244 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:56.631211    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zzps\" (UniqueName: \"kubernetes.io/projected/54bf5aa7-2595-4620-8eec-e256cafab36d-kube-api-access-8zzps\") pod \"cert-manager-cainjector-5c57bbd4fc-7r89w\" (UID: \"54bf5aa7-2595-4620-8eec-e256cafab36d\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w"
Nov 04 02:20:56.631244 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:56.631246    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54bf5aa7-2595-4620-8eec-e256cafab36d-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-7r89w\" (UID: \"54bf5aa7-2595-4620-8eec-e256cafab36d\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w"
Nov 04 02:20:56.690535 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:56.690503    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54bf5aa7-2595-4620-8eec-e256cafab36d-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-7r89w\" (UID: \"54bf5aa7-2595-4620-8eec-e256cafab36d\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w"
Nov 04 02:20:56.690769 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:56.690747    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zzps\" (UniqueName: \"kubernetes.io/projected/54bf5aa7-2595-4620-8eec-e256cafab36d-kube-api-access-8zzps\") pod \"cert-manager-cainjector-5c57bbd4fc-7r89w\" (UID: \"54bf5aa7-2595-4620-8eec-e256cafab36d\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w"
Nov 04 02:20:56.761582 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:56.761547    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w"
Nov 04 02:20:57.136475 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:57.136382    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w"]
Nov 04 02:20:57.143642 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:20:57.143613    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54bf5aa7_2595_4620_8eec_e256cafab36d.slice/crio-81b2a97825145a94cc640f0e0899581f6bdb2b22b5cc8e7b839a140566520d4b WatchSource:0}: Error finding container 81b2a97825145a94cc640f0e0899581f6bdb2b22b5cc8e7b839a140566520d4b: Status 404 returned error can't find the container with id 81b2a97825145a94cc640f0e0899581f6bdb2b22b5cc8e7b839a140566520d4b
Nov 04 02:20:57.719577 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:57.719537    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w" event={"ID":"54bf5aa7-2595-4620-8eec-e256cafab36d","Type":"ContainerStarted","Data":"81b2a97825145a94cc640f0e0899581f6bdb2b22b5cc8e7b839a140566520d4b"}
Nov 04 02:20:57.721175 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:57.721140    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-bld85" event={"ID":"d8d13871-ce3d-42c5-b793-5880eedbb198","Type":"ContainerStarted","Data":"87911888092d053b70fc9902df900704fc28a83fa82e4ac32fe76abb3534b84d"}
Nov 04 02:20:57.834144 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:20:57.834044    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-bld85" podStartSLOduration=1.4182240130000001 podStartE2EDuration="6.834027998s" totalImagesPullingTime="5.415803985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:20:57.833191476 +0000 UTC m=+253.337131988" watchObservedRunningTime="2026-11-04 02:20:57.834027998 +0000 UTC m=+253.337968486"
Nov 04 02:21:00.821199 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:00.821166    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt"]
Nov 04 02:21:00.824639 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:00.824566    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt"
Nov 04 02:21:00.878568 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:00.878535    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-cjkc4\""
Nov 04 02:21:00.880248 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:00.880221    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt"]
Nov 04 02:21:00.970072 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:00.970032    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1c28728-d849-4080-8e89-e9816b5c54b8-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-6w9wt\" (UID: \"b1c28728-d849-4080-8e89-e9816b5c54b8\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt"
Nov 04 02:21:00.970072 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:00.970078    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksbsk\" (UniqueName: \"kubernetes.io/projected/b1c28728-d849-4080-8e89-e9816b5c54b8-kube-api-access-ksbsk\") pod \"cert-manager-webhook-5dbbbf75cc-6w9wt\" (UID: \"b1c28728-d849-4080-8e89-e9816b5c54b8\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt"
Nov 04 02:21:01.071622 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:01.071523    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1c28728-d849-4080-8e89-e9816b5c54b8-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-6w9wt\" (UID: \"b1c28728-d849-4080-8e89-e9816b5c54b8\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt"
Nov 04 02:21:01.071622 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:01.071562    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksbsk\" (UniqueName: \"kubernetes.io/projected/b1c28728-d849-4080-8e89-e9816b5c54b8-kube-api-access-ksbsk\") pod \"cert-manager-webhook-5dbbbf75cc-6w9wt\" (UID: \"b1c28728-d849-4080-8e89-e9816b5c54b8\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt"
Nov 04 02:21:01.141364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:01.141323    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksbsk\" (UniqueName: \"kubernetes.io/projected/b1c28728-d849-4080-8e89-e9816b5c54b8-kube-api-access-ksbsk\") pod \"cert-manager-webhook-5dbbbf75cc-6w9wt\" (UID: \"b1c28728-d849-4080-8e89-e9816b5c54b8\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt"
Nov 04 02:21:01.142035 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:01.142014    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1c28728-d849-4080-8e89-e9816b5c54b8-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-6w9wt\" (UID: \"b1c28728-d849-4080-8e89-e9816b5c54b8\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt"
Nov 04 02:21:01.438348 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:01.438262    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt"
Nov 04 02:21:01.826473 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:01.826441    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt"]
Nov 04 02:21:01.833796 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:21:01.833753    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1c28728_d849_4080_8e89_e9816b5c54b8.slice/crio-5b92fea6a5f150c8cf8336bd7f13643defabcbec62b030a32e8411098a76c8ae WatchSource:0}: Error finding container 5b92fea6a5f150c8cf8336bd7f13643defabcbec62b030a32e8411098a76c8ae: Status 404 returned error can't find the container with id 5b92fea6a5f150c8cf8336bd7f13643defabcbec62b030a32e8411098a76c8ae
Nov 04 02:21:02.749147 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:02.749100    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt" event={"ID":"b1c28728-d849-4080-8e89-e9816b5c54b8","Type":"ContainerStarted","Data":"5b92fea6a5f150c8cf8336bd7f13643defabcbec62b030a32e8411098a76c8ae"}
Nov 04 02:21:03.754876 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:03.754834    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt" event={"ID":"b1c28728-d849-4080-8e89-e9816b5c54b8","Type":"ContainerStarted","Data":"0250db0ef0bce6a8965091d43cf45f663d3fad3a24e1cb1dd2c8e5b4508bd82b"}
Nov 04 02:21:03.755325 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:03.754894    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt"
Nov 04 02:21:03.756348 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:03.756319    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w" event={"ID":"54bf5aa7-2595-4620-8eec-e256cafab36d","Type":"ContainerStarted","Data":"bf1eb4501acbef99fb3145c75b44d718b9f00155a5ae4cdc40e783ecfd71cc6f"}
Nov 04 02:21:03.868905 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:03.868856    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt" podStartSLOduration=2.277742553 podStartE2EDuration="3.868841119s" totalImagesPullingTime="1.591098566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:03.868229341 +0000 UTC m=+259.372169834" watchObservedRunningTime="2026-11-04 02:21:03.868841119 +0000 UTC m=+259.372781604"
Nov 04 02:21:03.987839 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:03.984077    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7r89w" podStartSLOduration=1.834296568 podStartE2EDuration="7.984057344s" totalImagesPullingTime="6.149760776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:03.983854836 +0000 UTC m=+259.487795354" watchObservedRunningTime="2026-11-04 02:21:03.984057344 +0000 UTC m=+259.487997839"
Nov 04 02:21:05.234789 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.234750    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"]
Nov 04 02:21:05.238444 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.238425    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.338026 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.337991    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 04 02:21:05.338026 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.338004    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 04 02:21:05.338264 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.338043    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 04 02:21:05.338264 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.338048    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 04 02:21:05.338264 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.338108    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 04 02:21:05.338640 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.338614    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-fkgjv\""
Nov 04 02:21:05.340783 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.340761    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"]
Nov 04 02:21:05.412159 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.412124    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1039cbdc-b63f-41c4-b10b-57bc1043c297-manifests\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.412159 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.412157    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1039cbdc-b63f-41c4-b10b-57bc1043c297-webhook-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.412355 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.412318    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1039cbdc-b63f-41c4-b10b-57bc1043c297-tmp\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.412392 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.412365    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1039cbdc-b63f-41c4-b10b-57bc1043c297-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.412429 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.412395    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1039cbdc-b63f-41c4-b10b-57bc1043c297-metrics-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.412471 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.412457    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcg86\" (UniqueName: \"kubernetes.io/projected/1039cbdc-b63f-41c4-b10b-57bc1043c297-kube-api-access-xcg86\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.512919 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.512877    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcg86\" (UniqueName: \"kubernetes.io/projected/1039cbdc-b63f-41c4-b10b-57bc1043c297-kube-api-access-xcg86\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.513124 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.512937    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1039cbdc-b63f-41c4-b10b-57bc1043c297-manifests\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.513124 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.512963    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1039cbdc-b63f-41c4-b10b-57bc1043c297-webhook-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.513124 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.513060    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1039cbdc-b63f-41c4-b10b-57bc1043c297-tmp\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.513124 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.513084    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1039cbdc-b63f-41c4-b10b-57bc1043c297-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.513124 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.513108    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1039cbdc-b63f-41c4-b10b-57bc1043c297-metrics-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.513476 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.513446    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1039cbdc-b63f-41c4-b10b-57bc1043c297-manifests\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.515537 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.515504    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1039cbdc-b63f-41c4-b10b-57bc1043c297-tmp\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.515980 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.515957    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1039cbdc-b63f-41c4-b10b-57bc1043c297-metrics-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.516065 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.516036    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1039cbdc-b63f-41c4-b10b-57bc1043c297-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.516378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.516360    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1039cbdc-b63f-41c4-b10b-57bc1043c297-webhook-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.572838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.572807    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcg86\" (UniqueName: \"kubernetes.io/projected/1039cbdc-b63f-41c4-b10b-57bc1043c297-kube-api-access-xcg86\") pod \"opendatahub-operator-controller-manager-8bf8997fb-4crf8\" (UID: \"1039cbdc-b63f-41c4-b10b-57bc1043c297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:05.853334 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:05.853242    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:06.448377 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:06.448341    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"]
Nov 04 02:21:06.454303 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:21:06.454274    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1039cbdc_b63f_41c4_b10b_57bc1043c297.slice/crio-50f3e9540865f4819a3453f3a8fc4f6772c1efae5869c0154ab85d00d9be3e56 WatchSource:0}: Error finding container 50f3e9540865f4819a3453f3a8fc4f6772c1efae5869c0154ab85d00d9be3e56: Status 404 returned error can't find the container with id 50f3e9540865f4819a3453f3a8fc4f6772c1efae5869c0154ab85d00d9be3e56
Nov 04 02:21:06.770337 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:06.770296    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8" event={"ID":"1039cbdc-b63f-41c4-b10b-57bc1043c297","Type":"ContainerStarted","Data":"50f3e9540865f4819a3453f3a8fc4f6772c1efae5869c0154ab85d00d9be3e56"}
Nov 04 02:21:09.763997 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:09.763954    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6w9wt"
Nov 04 02:21:11.798338 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:11.798301    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8" event={"ID":"1039cbdc-b63f-41c4-b10b-57bc1043c297","Type":"ContainerStarted","Data":"c86691fe96ab85f5ce444f6d80199f7ad46b095b5f34ab724268160ac332db4b"}
Nov 04 02:21:12.803977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:12.803937    5450 generic.go:356] "Generic (PLEG): container finished" podID="1039cbdc-b63f-41c4-b10b-57bc1043c297" containerID="c86691fe96ab85f5ce444f6d80199f7ad46b095b5f34ab724268160ac332db4b" exitCode=0
Nov 04 02:21:12.803977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:12.803981    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8" event={"ID":"1039cbdc-b63f-41c4-b10b-57bc1043c297","Type":"ContainerDied","Data":"c86691fe96ab85f5ce444f6d80199f7ad46b095b5f34ab724268160ac332db4b"}
Nov 04 02:21:13.810783 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:13.810749    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8" event={"ID":"1039cbdc-b63f-41c4-b10b-57bc1043c297","Type":"ContainerStarted","Data":"f8eee84fcf2184399e6c022c7d5150312083c46d465a2bb3b01418256dd66d4d"}
Nov 04 02:21:13.811158 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:13.810892    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:14.039381 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:14.039329    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8" podStartSLOduration=2.649140976 podStartE2EDuration="9.039313292s" totalImagesPullingTime="5.849350474s" totalInitContainerRuntime="540.821842ms" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:13.991327205 +0000 UTC m=+269.495267698" watchObservedRunningTime="2026-11-04 02:21:14.039313292 +0000 UTC m=+269.543253786"
Nov 04 02:21:14.147427 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:14.147390    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-7q8zn"]
Nov 04 02:21:14.151115 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:14.151089    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-7q8zn"
Nov 04 02:21:14.201587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:14.201547    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f867d60-a620-4392-a945-4ae6d951bac1-bound-sa-token\") pod \"cert-manager-597b95cb84-7q8zn\" (UID: \"0f867d60-a620-4392-a945-4ae6d951bac1\") " pod="cert-manager/cert-manager-597b95cb84-7q8zn"
Nov 04 02:21:14.201788 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:14.201714    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq425\" (UniqueName: \"kubernetes.io/projected/0f867d60-a620-4392-a945-4ae6d951bac1-kube-api-access-kq425\") pod \"cert-manager-597b95cb84-7q8zn\" (UID: \"0f867d60-a620-4392-a945-4ae6d951bac1\") " pod="cert-manager/cert-manager-597b95cb84-7q8zn"
Nov 04 02:21:14.208100 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:14.208073    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8c9n8\""
Nov 04 02:21:14.208403 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:14.208382    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-7q8zn"]
Nov 04 02:21:14.302301 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:14.302211    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq425\" (UniqueName: \"kubernetes.io/projected/0f867d60-a620-4392-a945-4ae6d951bac1-kube-api-access-kq425\") pod \"cert-manager-597b95cb84-7q8zn\" (UID: \"0f867d60-a620-4392-a945-4ae6d951bac1\") " pod="cert-manager/cert-manager-597b95cb84-7q8zn"
Nov 04 02:21:14.302301 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:14.302273    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f867d60-a620-4392-a945-4ae6d951bac1-bound-sa-token\") pod \"cert-manager-597b95cb84-7q8zn\" (UID: \"0f867d60-a620-4392-a945-4ae6d951bac1\") " pod="cert-manager/cert-manager-597b95cb84-7q8zn"
Nov 04 02:21:14.361507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:14.361479    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f867d60-a620-4392-a945-4ae6d951bac1-bound-sa-token\") pod \"cert-manager-597b95cb84-7q8zn\" (UID: \"0f867d60-a620-4392-a945-4ae6d951bac1\") " pod="cert-manager/cert-manager-597b95cb84-7q8zn"
Nov 04 02:21:14.361697 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:14.361588    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq425\" (UniqueName: \"kubernetes.io/projected/0f867d60-a620-4392-a945-4ae6d951bac1-kube-api-access-kq425\") pod \"cert-manager-597b95cb84-7q8zn\" (UID: \"0f867d60-a620-4392-a945-4ae6d951bac1\") " pod="cert-manager/cert-manager-597b95cb84-7q8zn"
Nov 04 02:21:14.463019 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:14.462981    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-7q8zn"
Nov 04 02:21:14.870376 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:14.870344    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-7q8zn"]
Nov 04 02:21:14.876652 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:21:14.876616    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f867d60_a620_4392_a945_4ae6d951bac1.slice/crio-ece6aef3579e35dfb171963930f083e50fcb18746796511a0bb21b6ede7efadb WatchSource:0}: Error finding container ece6aef3579e35dfb171963930f083e50fcb18746796511a0bb21b6ede7efadb: Status 404 returned error can't find the container with id ece6aef3579e35dfb171963930f083e50fcb18746796511a0bb21b6ede7efadb
Nov 04 02:21:15.820575 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:15.820535    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-7q8zn" event={"ID":"0f867d60-a620-4392-a945-4ae6d951bac1","Type":"ContainerStarted","Data":"df3dd843def8d4e672cf41c81f88f8eaca663bdd0c276f0faf83747f6920b4a7"}
Nov 04 02:21:15.820777 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:15.820588    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-7q8zn" event={"ID":"0f867d60-a620-4392-a945-4ae6d951bac1","Type":"ContainerStarted","Data":"ece6aef3579e35dfb171963930f083e50fcb18746796511a0bb21b6ede7efadb"}
Nov 04 02:21:15.939298 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:15.937922    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-7q8zn" podStartSLOduration=1.9379019720000001 podStartE2EDuration="1.937901972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:15.937860877 +0000 UTC m=+271.441801370" watchObservedRunningTime="2026-11-04 02:21:15.937901972 +0000 UTC m=+271.441842467"
Nov 04 02:21:17.764445 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:21:17.764406    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:21:24.816879 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:24.816795    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-4crf8"
Nov 04 02:21:26.876870 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:26.876838    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"]
Nov 04 02:21:26.969965 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:26.969926    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"]
Nov 04 02:21:26.970131 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:26.970053    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"
Nov 04 02:21:27.013752 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.013713    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fcf4580-8c24-41b9-a93f-dbc2feac8a7e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-bkv7h\" (UID: \"2fcf4580-8c24-41b9-a93f-dbc2feac8a7e\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"
Nov 04 02:21:27.013752 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.013752    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2fcf4580-8c24-41b9-a93f-dbc2feac8a7e-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-bkv7h\" (UID: \"2fcf4580-8c24-41b9-a93f-dbc2feac8a7e\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"
Nov 04 02:21:27.014023 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.013782    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhwpj\" (UniqueName: \"kubernetes.io/projected/2fcf4580-8c24-41b9-a93f-dbc2feac8a7e-kube-api-access-lhwpj\") pod \"kuadrant-console-plugin-66c4fb575d-bkv7h\" (UID: \"2fcf4580-8c24-41b9-a93f-dbc2feac8a7e\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"
Nov 04 02:21:27.065872 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.065837    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 04 02:21:27.068494 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.068466    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 04 02:21:27.068636 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.068466    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Nov 04 02:21:27.068636 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.068538    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rftcz\""
Nov 04 02:21:27.069139 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.069109    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Nov 04 02:21:27.115235 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.115196    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fcf4580-8c24-41b9-a93f-dbc2feac8a7e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-bkv7h\" (UID: \"2fcf4580-8c24-41b9-a93f-dbc2feac8a7e\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"
Nov 04 02:21:27.115235 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.115238    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2fcf4580-8c24-41b9-a93f-dbc2feac8a7e-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-bkv7h\" (UID: \"2fcf4580-8c24-41b9-a93f-dbc2feac8a7e\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"
Nov 04 02:21:27.115488 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.115282    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhwpj\" (UniqueName: \"kubernetes.io/projected/2fcf4580-8c24-41b9-a93f-dbc2feac8a7e-kube-api-access-lhwpj\") pod \"kuadrant-console-plugin-66c4fb575d-bkv7h\" (UID: \"2fcf4580-8c24-41b9-a93f-dbc2feac8a7e\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"
Nov 04 02:21:27.115964 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.115940    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2fcf4580-8c24-41b9-a93f-dbc2feac8a7e-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-bkv7h\" (UID: \"2fcf4580-8c24-41b9-a93f-dbc2feac8a7e\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"
Nov 04 02:21:27.117744 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.117720    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fcf4580-8c24-41b9-a93f-dbc2feac8a7e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-bkv7h\" (UID: \"2fcf4580-8c24-41b9-a93f-dbc2feac8a7e\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"
Nov 04 02:21:27.174924 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.174840    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhwpj\" (UniqueName: \"kubernetes.io/projected/2fcf4580-8c24-41b9-a93f-dbc2feac8a7e-kube-api-access-lhwpj\") pod \"kuadrant-console-plugin-66c4fb575d-bkv7h\" (UID: \"2fcf4580-8c24-41b9-a93f-dbc2feac8a7e\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"
Nov 04 02:21:27.300390 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.300356    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"
Nov 04 02:21:27.685961 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.685924    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h"]
Nov 04 02:21:27.692708 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:21:27.692678    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fcf4580_8c24_41b9_a93f_dbc2feac8a7e.slice/crio-ea5c16efd19703db37ae6bf77720ed5daf8714062d047f5568becaf733391c85 WatchSource:0}: Error finding container ea5c16efd19703db37ae6bf77720ed5daf8714062d047f5568becaf733391c85: Status 404 returned error can't find the container with id ea5c16efd19703db37ae6bf77720ed5daf8714062d047f5568becaf733391c85
Nov 04 02:21:27.871912 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:27.871843    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h" event={"ID":"2fcf4580-8c24-41b9-a93f-dbc2feac8a7e","Type":"ContainerStarted","Data":"ea5c16efd19703db37ae6bf77720ed5daf8714062d047f5568becaf733391c85"}
Nov 04 02:21:35.911225 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:35.911180    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h" event={"ID":"2fcf4580-8c24-41b9-a93f-dbc2feac8a7e","Type":"ContainerStarted","Data":"2c506644bcba94de3763052d4846654dba7b35afe6429f158fb9102f9713bd86"}
Nov 04 02:21:36.025960 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:36.025901    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-bkv7h" podStartSLOduration=2.250315951 podStartE2EDuration="10.025888052s" totalImagesPullingTime="7.775572101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:36.025459596 +0000 UTC m=+291.529400092" watchObservedRunningTime="2026-11-04 02:21:36.025888052 +0000 UTC m=+291.529828542"
Nov 04 02:21:42.758274 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.758239    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"]
Nov 04 02:21:42.761468 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.761447    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"
Nov 04 02:21:42.859555 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.859520    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49b58c3b-6d85-4798-9417-b0b5a938ee1d-tls-certs\") pod \"kube-auth-proxy-d555fc4c8-4mcz9\" (UID: \"49b58c3b-6d85-4798-9417-b0b5a938ee1d\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"
Nov 04 02:21:42.859555 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.859560    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b58c3b-6d85-4798-9417-b0b5a938ee1d-tmp\") pod \"kube-auth-proxy-d555fc4c8-4mcz9\" (UID: \"49b58c3b-6d85-4798-9417-b0b5a938ee1d\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"
Nov 04 02:21:42.859789 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.859674    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd8g7\" (UniqueName: \"kubernetes.io/projected/49b58c3b-6d85-4798-9417-b0b5a938ee1d-kube-api-access-dd8g7\") pod \"kube-auth-proxy-d555fc4c8-4mcz9\" (UID: \"49b58c3b-6d85-4798-9417-b0b5a938ee1d\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"
Nov 04 02:21:42.862132 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.862112    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 04 02:21:42.862132 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.862115    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 04 02:21:42.862309 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.862172    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xvxdr\""
Nov 04 02:21:42.862309 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.862204    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 04 02:21:42.862309 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.862219    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 04 02:21:42.863354 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.863334    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"]
Nov 04 02:21:42.960685 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.960650    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49b58c3b-6d85-4798-9417-b0b5a938ee1d-tls-certs\") pod \"kube-auth-proxy-d555fc4c8-4mcz9\" (UID: \"49b58c3b-6d85-4798-9417-b0b5a938ee1d\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"
Nov 04 02:21:42.960685 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.960689    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b58c3b-6d85-4798-9417-b0b5a938ee1d-tmp\") pod \"kube-auth-proxy-d555fc4c8-4mcz9\" (UID: \"49b58c3b-6d85-4798-9417-b0b5a938ee1d\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"
Nov 04 02:21:42.960953 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.960740    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd8g7\" (UniqueName: \"kubernetes.io/projected/49b58c3b-6d85-4798-9417-b0b5a938ee1d-kube-api-access-dd8g7\") pod \"kube-auth-proxy-d555fc4c8-4mcz9\" (UID: \"49b58c3b-6d85-4798-9417-b0b5a938ee1d\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"
Nov 04 02:21:42.963607 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.963556    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49b58c3b-6d85-4798-9417-b0b5a938ee1d-tls-certs\") pod \"kube-auth-proxy-d555fc4c8-4mcz9\" (UID: \"49b58c3b-6d85-4798-9417-b0b5a938ee1d\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"
Nov 04 02:21:42.963778 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:42.963759    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b58c3b-6d85-4798-9417-b0b5a938ee1d-tmp\") pod \"kube-auth-proxy-d555fc4c8-4mcz9\" (UID: \"49b58c3b-6d85-4798-9417-b0b5a938ee1d\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"
Nov 04 02:21:43.019985 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:43.019906    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd8g7\" (UniqueName: \"kubernetes.io/projected/49b58c3b-6d85-4798-9417-b0b5a938ee1d-kube-api-access-dd8g7\") pod \"kube-auth-proxy-d555fc4c8-4mcz9\" (UID: \"49b58c3b-6d85-4798-9417-b0b5a938ee1d\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"
Nov 04 02:21:43.072115 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:43.072082    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"
Nov 04 02:21:43.451908 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:43.451823    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9"]
Nov 04 02:21:43.458666 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:21:43.458635    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b58c3b_6d85_4798_9417_b0b5a938ee1d.slice/crio-fac89d1d63c13ff65e7b1d51ce0d690cfa53aac7a178c9fbf0787a3f7002d140 WatchSource:0}: Error finding container fac89d1d63c13ff65e7b1d51ce0d690cfa53aac7a178c9fbf0787a3f7002d140: Status 404 returned error can't find the container with id fac89d1d63c13ff65e7b1d51ce0d690cfa53aac7a178c9fbf0787a3f7002d140
Nov 04 02:21:43.948366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:43.948332    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9" event={"ID":"49b58c3b-6d85-4798-9417-b0b5a938ee1d","Type":"ContainerStarted","Data":"fac89d1d63c13ff65e7b1d51ce0d690cfa53aac7a178c9fbf0787a3f7002d140"}
Nov 04 02:21:44.660043 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:44.660009    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:21:44.660609 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:44.660571    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:21:44.788351 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:44.788317    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"]
Nov 04 02:21:44.791244 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:44.791217    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"
Nov 04 02:21:44.845759 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:44.845720    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"]
Nov 04 02:21:44.845948 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:44.845907    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Nov 04 02:21:44.878120 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:44.878082    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnm7d\" (UniqueName: \"kubernetes.io/projected/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-kube-api-access-vnm7d\") pod \"limitador-limitador-74dfcfb894-jcqq8\" (UID: \"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"
Nov 04 02:21:44.878120 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:44.878127    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-config-file\") pod \"limitador-limitador-74dfcfb894-jcqq8\" (UID: \"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"
Nov 04 02:21:44.979125 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:44.979047    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnm7d\" (UniqueName: \"kubernetes.io/projected/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-kube-api-access-vnm7d\") pod \"limitador-limitador-74dfcfb894-jcqq8\" (UID: \"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"
Nov 04 02:21:44.979125 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:44.979097    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-config-file\") pod \"limitador-limitador-74dfcfb894-jcqq8\" (UID: \"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"
Nov 04 02:21:44.979939 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:44.979916    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-config-file\") pod \"limitador-limitador-74dfcfb894-jcqq8\" (UID: \"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"
Nov 04 02:21:45.042295 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:45.042252    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"]
Nov 04 02:21:45.048346 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:45.048319    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnm7d\" (UniqueName: \"kubernetes.io/projected/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-kube-api-access-vnm7d\") pod \"limitador-limitador-74dfcfb894-jcqq8\" (UID: \"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"
Nov 04 02:21:45.104429 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:45.104397    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"
Nov 04 02:21:45.532559 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:45.532526    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"]
Nov 04 02:21:45.546099 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:21:45.546069    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5a6918d_6adf_4b3b_96bc_c0d60ed7880b.slice/crio-d1f8ddb8b56e11f50e7d08dffe6a6c29ddfb0ab129a144d0c146b14627d9fec0 WatchSource:0}: Error finding container d1f8ddb8b56e11f50e7d08dffe6a6c29ddfb0ab129a144d0c146b14627d9fec0: Status 404 returned error can't find the container with id d1f8ddb8b56e11f50e7d08dffe6a6c29ddfb0ab129a144d0c146b14627d9fec0
Nov 04 02:21:45.960895 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:45.960807    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8" event={"ID":"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b","Type":"ContainerStarted","Data":"d1f8ddb8b56e11f50e7d08dffe6a6c29ddfb0ab129a144d0c146b14627d9fec0"}
Nov 04 02:21:46.660328 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:46.660295    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 04 02:21:46.967055 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:46.966973    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9" event={"ID":"49b58c3b-6d85-4798-9417-b0b5a938ee1d","Type":"ContainerStarted","Data":"38f3d1008fa17113f5d8c733a2e7b6e9c5153e9a9e1a1c0922ac3914fb2a4ec6"}
Nov 04 02:21:47.079704 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:47.079647    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d555fc4c8-4mcz9" podStartSLOduration=1.9300103389999999 podStartE2EDuration="5.079631709s" totalImagesPullingTime="3.14962137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:47.078589728 +0000 UTC m=+302.582530223" watchObservedRunningTime="2026-11-04 02:21:47.079631709 +0000 UTC m=+302.583572202"
Nov 04 02:21:47.766668 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:21:47.766621    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:21:49.984659 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:49.984585    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8" event={"ID":"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b","Type":"ContainerStarted","Data":"7ccb4de4da0464c131c92847c45de6657cb0edb084e109f1c94bc4ee33eea710"}
Nov 04 02:21:49.985069 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:49.984769    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"
Nov 04 02:21:50.097785 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:21:50.097737    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8" podStartSLOduration=2.396400909 podStartE2EDuration="6.097723145s" totalImagesPullingTime="3.701322236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:50.097407497 +0000 UTC m=+305.601347987" watchObservedRunningTime="2026-11-04 02:21:50.097723145 +0000 UTC m=+305.601663638"
Nov 04 02:22:00.990497 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:00.990461    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"
Nov 04 02:22:08.513406 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:08.513361    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:22:08.524876 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:08.524845    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"
Nov 04 02:22:08.574020 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:08.573989    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:22:08.595611 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:08.595565    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4504d788-446c-46d7-863e-b4da14a53d0b-config-file\") pod \"limitador-limitador-7c9b87d574-ckdtv\" (UID: \"4504d788-446c-46d7-863e-b4da14a53d0b\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"
Nov 04 02:22:08.595774 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:08.595665    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fbwd\" (UniqueName: \"kubernetes.io/projected/4504d788-446c-46d7-863e-b4da14a53d0b-kube-api-access-9fbwd\") pod \"limitador-limitador-7c9b87d574-ckdtv\" (UID: \"4504d788-446c-46d7-863e-b4da14a53d0b\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"
Nov 04 02:22:08.696266 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:08.696229    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4504d788-446c-46d7-863e-b4da14a53d0b-config-file\") pod \"limitador-limitador-7c9b87d574-ckdtv\" (UID: \"4504d788-446c-46d7-863e-b4da14a53d0b\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"
Nov 04 02:22:08.696448 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:08.696280    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fbwd\" (UniqueName: \"kubernetes.io/projected/4504d788-446c-46d7-863e-b4da14a53d0b-kube-api-access-9fbwd\") pod \"limitador-limitador-7c9b87d574-ckdtv\" (UID: \"4504d788-446c-46d7-863e-b4da14a53d0b\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"
Nov 04 02:22:08.696929 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:08.696909    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4504d788-446c-46d7-863e-b4da14a53d0b-config-file\") pod \"limitador-limitador-7c9b87d574-ckdtv\" (UID: \"4504d788-446c-46d7-863e-b4da14a53d0b\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"
Nov 04 02:22:08.755933 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:08.755898    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fbwd\" (UniqueName: \"kubernetes.io/projected/4504d788-446c-46d7-863e-b4da14a53d0b-kube-api-access-9fbwd\") pod \"limitador-limitador-7c9b87d574-ckdtv\" (UID: \"4504d788-446c-46d7-863e-b4da14a53d0b\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"
Nov 04 02:22:08.822830 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:08.822748    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:22:08.837720 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:08.837690    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"
Nov 04 02:22:09.206920 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:09.206842    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:22:09.213491 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:22:09.213458    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4504d788_446c_46d7_863e_b4da14a53d0b.slice/crio-7b7a74192c89aaa230a66ad96629da3f30ca2ce8ea5a20f0656ce4d560726b44 WatchSource:0}: Error finding container 7b7a74192c89aaa230a66ad96629da3f30ca2ce8ea5a20f0656ce4d560726b44: Status 404 returned error can't find the container with id 7b7a74192c89aaa230a66ad96629da3f30ca2ce8ea5a20f0656ce4d560726b44
Nov 04 02:22:10.072432 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:10.072396    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-ckdtv" event={"ID":"4504d788-446c-46d7-863e-b4da14a53d0b","Type":"ContainerStarted","Data":"20626ff9e0271c2a76d16ac40711cfd93fd8aa5819b976e90f7d4f0025133ea5"}
Nov 04 02:22:10.072893 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:10.072447    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-ckdtv" event={"ID":"4504d788-446c-46d7-863e-b4da14a53d0b","Type":"ContainerStarted","Data":"7b7a74192c89aaa230a66ad96629da3f30ca2ce8ea5a20f0656ce4d560726b44"}
Nov 04 02:22:10.072893 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:10.072495    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"
Nov 04 02:22:10.185974 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:10.185921    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-ckdtv" podStartSLOduration=2.185908542 podStartE2EDuration="2.185908542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:22:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:22:10.185078038 +0000 UTC m=+325.689018545" watchObservedRunningTime="2026-11-04 02:22:10.185908542 +0000 UTC m=+325.689849094"
Nov 04 02:22:17.764486 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:22:17.764446    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:22:21.077823 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:21.077791    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"
Nov 04 02:22:21.239872 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:21.239836    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"]
Nov 04 02:22:21.240063 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:21.240027    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8" podUID="c5a6918d-6adf-4b3b-96bc-c0d60ed7880b" containerName="limitador" containerID="cri-o://7ccb4de4da0464c131c92847c45de6657cb0edb084e109f1c94bc4ee33eea710" gracePeriod=30
Nov 04 02:22:21.977053 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:21.977019    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"
Nov 04 02:22:21.999241 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:21.999194    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-kube-api-access-vnm7d\" (UniqueName: \"kubernetes.io/projected/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-kube-api-access-vnm7d\") pod \"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b\" (UID: \"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b\") "
Nov 04 02:22:21.999434 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:21.999266    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-config-file\" (UniqueName: \"kubernetes.io/configmap/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-config-file\") pod \"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b\" (UID: \"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b\") "
Nov 04 02:22:21.999677 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:21.999641    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-config-file" pod "c5a6918d-6adf-4b3b-96bc-c0d60ed7880b" (UID: "c5a6918d-6adf-4b3b-96bc-c0d60ed7880b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:22:22.001514 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:22.001493    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-kube-api-access-vnm7d" pod "c5a6918d-6adf-4b3b-96bc-c0d60ed7880b" (UID: "c5a6918d-6adf-4b3b-96bc-c0d60ed7880b"). InnerVolumeSpecName "kube-api-access-vnm7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:22:22.100571 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:22.100498    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnm7d\" (UniqueName: \"kubernetes.io/projected/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-kube-api-access-vnm7d\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:22:22.100571 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:22.100525    5450 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b-config-file\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:22:22.125667 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:22.125630    5450 generic.go:356] "Generic (PLEG): container finished" podID="c5a6918d-6adf-4b3b-96bc-c0d60ed7880b" containerID="7ccb4de4da0464c131c92847c45de6657cb0edb084e109f1c94bc4ee33eea710" exitCode=0
Nov 04 02:22:22.125865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:22.125686    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"
Nov 04 02:22:22.125865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:22.125721    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8" event={"ID":"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b","Type":"ContainerDied","Data":"7ccb4de4da0464c131c92847c45de6657cb0edb084e109f1c94bc4ee33eea710"}
Nov 04 02:22:22.125865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:22.125794    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-jcqq8" event={"ID":"c5a6918d-6adf-4b3b-96bc-c0d60ed7880b","Type":"ContainerDied","Data":"d1f8ddb8b56e11f50e7d08dffe6a6c29ddfb0ab129a144d0c146b14627d9fec0"}
Nov 04 02:22:22.125865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:22.125828    5450 scope.go:122] "RemoveContainer" containerID="7ccb4de4da0464c131c92847c45de6657cb0edb084e109f1c94bc4ee33eea710"
Nov 04 02:22:22.134825 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:22.134807    5450 scope.go:122] "RemoveContainer" containerID="7ccb4de4da0464c131c92847c45de6657cb0edb084e109f1c94bc4ee33eea710"
Nov 04 02:22:22.135087 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:22:22.135067    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ccb4de4da0464c131c92847c45de6657cb0edb084e109f1c94bc4ee33eea710\": container with ID starting with 7ccb4de4da0464c131c92847c45de6657cb0edb084e109f1c94bc4ee33eea710 not found: ID does not exist" containerID="7ccb4de4da0464c131c92847c45de6657cb0edb084e109f1c94bc4ee33eea710"
Nov 04 02:22:22.135149 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:22.135097    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ccb4de4da0464c131c92847c45de6657cb0edb084e109f1c94bc4ee33eea710"} err="failed to get container status \"7ccb4de4da0464c131c92847c45de6657cb0edb084e109f1c94bc4ee33eea710\": rpc error: code = NotFound desc = could not find container \"7ccb4de4da0464c131c92847c45de6657cb0edb084e109f1c94bc4ee33eea710\": container with ID starting with 7ccb4de4da0464c131c92847c45de6657cb0edb084e109f1c94bc4ee33eea710 not found: ID does not exist"
Nov 04 02:22:22.283995 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:22.283960    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"]
Nov 04 02:22:22.287955 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:22.287925    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-jcqq8"]
Nov 04 02:22:22.631118 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:22.631081    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5a6918d-6adf-4b3b-96bc-c0d60ed7880b" path="/var/lib/kubelet/pods/c5a6918d-6adf-4b3b-96bc-c0d60ed7880b/volumes"
Nov 04 02:22:29.303253 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.303212    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx"]
Nov 04 02:22:29.303664 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.303585    5450 cpu_manager.go:414] "containerMap: removing container" podUID="c5a6918d-6adf-4b3b-96bc-c0d60ed7880b" containerName="limitador"
Nov 04 02:22:29.303664 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.303612    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5a6918d-6adf-4b3b-96bc-c0d60ed7880b" containerName="limitador"
Nov 04 02:22:29.303738 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.303706    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5a6918d-6adf-4b3b-96bc-c0d60ed7880b" containerName="limitador"
Nov 04 02:22:29.306210 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.306188    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx"
Nov 04 02:22:29.360307 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.360276    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx"]
Nov 04 02:22:29.366272 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.366242    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpqs2\" (UniqueName: \"kubernetes.io/projected/cfbf4e94-67ea-40a9-9555-48666da8fa67-kube-api-access-zpqs2\") pod \"postgres-7cdbf6dc44-bn8xx\" (UID: \"cfbf4e94-67ea-40a9-9555-48666da8fa67\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx"
Nov 04 02:22:29.366434 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.366286    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cfbf4e94-67ea-40a9-9555-48666da8fa67-data\") pod \"postgres-7cdbf6dc44-bn8xx\" (UID: \"cfbf4e94-67ea-40a9-9555-48666da8fa67\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx"
Nov 04 02:22:29.371245 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.371221    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:22:29.406971 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.406933    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:22:29.406971 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.406968    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-vnmrb\""
Nov 04 02:22:29.407193 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.407068    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Nov 04 02:22:29.467263 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.467226    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpqs2\" (UniqueName: \"kubernetes.io/projected/cfbf4e94-67ea-40a9-9555-48666da8fa67-kube-api-access-zpqs2\") pod \"postgres-7cdbf6dc44-bn8xx\" (UID: \"cfbf4e94-67ea-40a9-9555-48666da8fa67\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx"
Nov 04 02:22:29.467453 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.467274    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cfbf4e94-67ea-40a9-9555-48666da8fa67-data\") pod \"postgres-7cdbf6dc44-bn8xx\" (UID: \"cfbf4e94-67ea-40a9-9555-48666da8fa67\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx"
Nov 04 02:22:29.467689 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.467673    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cfbf4e94-67ea-40a9-9555-48666da8fa67-data\") pod \"postgres-7cdbf6dc44-bn8xx\" (UID: \"cfbf4e94-67ea-40a9-9555-48666da8fa67\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx"
Nov 04 02:22:29.526945 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.526912    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpqs2\" (UniqueName: \"kubernetes.io/projected/cfbf4e94-67ea-40a9-9555-48666da8fa67-kube-api-access-zpqs2\") pod \"postgres-7cdbf6dc44-bn8xx\" (UID: \"cfbf4e94-67ea-40a9-9555-48666da8fa67\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx"
Nov 04 02:22:29.617572 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.617479    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx"
Nov 04 02:22:29.988642 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.988548    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx"]
Nov 04 02:22:29.995511 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:22:29.995466    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfbf4e94_67ea_40a9_9555_48666da8fa67.slice/crio-9c32aa487cde1a96350e6a2ebd691ef4d9757b5243bfbaaefe5d7467ff3b67f5 WatchSource:0}: Error finding container 9c32aa487cde1a96350e6a2ebd691ef4d9757b5243bfbaaefe5d7467ff3b67f5: Status 404 returned error can't find the container with id 9c32aa487cde1a96350e6a2ebd691ef4d9757b5243bfbaaefe5d7467ff3b67f5
Nov 04 02:22:29.996940 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:29.996918    5450 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:22:30.163702 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:30.163665    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx" event={"ID":"cfbf4e94-67ea-40a9-9555-48666da8fa67","Type":"ContainerStarted","Data":"9c32aa487cde1a96350e6a2ebd691ef4d9757b5243bfbaaefe5d7467ff3b67f5"}
Nov 04 02:22:47.763672 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:22:47.763633    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:22:53.094836 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:53.094806    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Nov 04 02:22:53.267913 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:53.267875    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx" event={"ID":"cfbf4e94-67ea-40a9-9555-48666da8fa67","Type":"ContainerStarted","Data":"9180f5e72646e8aeee319f84347db5034d0a7c519b1dbd29dcc052bba61a297b"}
Nov 04 02:22:53.268095 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:53.267961    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx"
Nov 04 02:22:53.379033 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:53.378932    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx" podStartSLOduration=1.331287205 podStartE2EDuration="24.378918897s" totalImagesPullingTime="23.047631692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:22:53.378696518 +0000 UTC m=+368.882637013" watchObservedRunningTime="2026-11-04 02:22:53.378918897 +0000 UTC m=+368.882859390"
Nov 04 02:22:59.301673 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:22:59.301633    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-bn8xx"
Nov 04 02:23:03.463931 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.463895    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-z99gz"]
Nov 04 02:23:03.484934 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.484904    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-z99gz"
Nov 04 02:23:03.521788 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.521758    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-z99gz"]
Nov 04 02:23:03.559026 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.558994    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 04 02:23:03.559026 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.559006    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 04 02:23:03.583425 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.583393    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kczg8\" (UniqueName: \"kubernetes.io/projected/94467c99-f42c-4305-a2c8-0566e48b68b5-kube-api-access-kczg8\") pod \"kserve-controller-manager-776cc66d47-z99gz\" (UID: \"94467c99-f42c-4305-a2c8-0566e48b68b5\") " pod="opendatahub/kserve-controller-manager-776cc66d47-z99gz"
Nov 04 02:23:03.583578 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.583533    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94467c99-f42c-4305-a2c8-0566e48b68b5-cert\") pod \"kserve-controller-manager-776cc66d47-z99gz\" (UID: \"94467c99-f42c-4305-a2c8-0566e48b68b5\") " pod="opendatahub/kserve-controller-manager-776cc66d47-z99gz"
Nov 04 02:23:03.612308 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.612277    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Nov 04 02:23:03.612450 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.612322    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tj46l\""
Nov 04 02:23:03.684146 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.684112    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94467c99-f42c-4305-a2c8-0566e48b68b5-cert\") pod \"kserve-controller-manager-776cc66d47-z99gz\" (UID: \"94467c99-f42c-4305-a2c8-0566e48b68b5\") " pod="opendatahub/kserve-controller-manager-776cc66d47-z99gz"
Nov 04 02:23:03.684311 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.684158    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kczg8\" (UniqueName: \"kubernetes.io/projected/94467c99-f42c-4305-a2c8-0566e48b68b5-kube-api-access-kczg8\") pod \"kserve-controller-manager-776cc66d47-z99gz\" (UID: \"94467c99-f42c-4305-a2c8-0566e48b68b5\") " pod="opendatahub/kserve-controller-manager-776cc66d47-z99gz"
Nov 04 02:23:03.686507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.686485    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94467c99-f42c-4305-a2c8-0566e48b68b5-cert\") pod \"kserve-controller-manager-776cc66d47-z99gz\" (UID: \"94467c99-f42c-4305-a2c8-0566e48b68b5\") " pod="opendatahub/kserve-controller-manager-776cc66d47-z99gz"
Nov 04 02:23:03.696812 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.696787    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-phrf7"]
Nov 04 02:23:03.735392 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.735329    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-phrf7"
Nov 04 02:23:03.743426 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.743404    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kczg8\" (UniqueName: \"kubernetes.io/projected/94467c99-f42c-4305-a2c8-0566e48b68b5-kube-api-access-kczg8\") pod \"kserve-controller-manager-776cc66d47-z99gz\" (UID: \"94467c99-f42c-4305-a2c8-0566e48b68b5\") " pod="opendatahub/kserve-controller-manager-776cc66d47-z99gz"
Nov 04 02:23:03.754990 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.754963    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-phrf7"]
Nov 04 02:23:03.787590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.787558    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Nov 04 02:23:03.787590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.787558    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-nbkh2\""
Nov 04 02:23:03.798865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.798836    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-z99gz"
Nov 04 02:23:03.817297 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.817260    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-h9lpt"]
Nov 04 02:23:03.840864 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.840838    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-h9lpt"
Nov 04 02:23:03.875393 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.875359    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-h9lpt"]
Nov 04 02:23:03.886173 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.886146    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c831875f-bf66-4462-a8d0-04b9692e01ab-tls-certs\") pod \"model-serving-api-75bd89fdfc-phrf7\" (UID: \"c831875f-bf66-4462-a8d0-04b9692e01ab\") " pod="opendatahub/model-serving-api-75bd89fdfc-phrf7"
Nov 04 02:23:03.886311 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.886287    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfz7n\" (UniqueName: \"kubernetes.io/projected/c831875f-bf66-4462-a8d0-04b9692e01ab-kube-api-access-bfz7n\") pod \"model-serving-api-75bd89fdfc-phrf7\" (UID: \"c831875f-bf66-4462-a8d0-04b9692e01ab\") " pod="opendatahub/model-serving-api-75bd89fdfc-phrf7"
Nov 04 02:23:03.891437 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.891351    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6wd65\""
Nov 04 02:23:03.891437 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.891404    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Nov 04 02:23:03.891437 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.891413    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Nov 04 02:23:03.987842 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.987761    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c831875f-bf66-4462-a8d0-04b9692e01ab-tls-certs\") pod \"model-serving-api-75bd89fdfc-phrf7\" (UID: \"c831875f-bf66-4462-a8d0-04b9692e01ab\") " pod="opendatahub/model-serving-api-75bd89fdfc-phrf7"
Nov 04 02:23:03.987842 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.987815    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4sfb\" (UniqueName: \"kubernetes.io/projected/7a9a3d4a-e35f-44f3-b256-782fa8625556-kube-api-access-f4sfb\") pod \"odh-model-controller-769875db56-h9lpt\" (UID: \"7a9a3d4a-e35f-44f3-b256-782fa8625556\") " pod="opendatahub/odh-model-controller-769875db56-h9lpt"
Nov 04 02:23:03.988029 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.987848    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfz7n\" (UniqueName: \"kubernetes.io/projected/c831875f-bf66-4462-a8d0-04b9692e01ab-kube-api-access-bfz7n\") pod \"model-serving-api-75bd89fdfc-phrf7\" (UID: \"c831875f-bf66-4462-a8d0-04b9692e01ab\") " pod="opendatahub/model-serving-api-75bd89fdfc-phrf7"
Nov 04 02:23:03.988029 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.987879    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a9a3d4a-e35f-44f3-b256-782fa8625556-cert\") pod \"odh-model-controller-769875db56-h9lpt\" (UID: \"7a9a3d4a-e35f-44f3-b256-782fa8625556\") " pod="opendatahub/odh-model-controller-769875db56-h9lpt"
Nov 04 02:23:03.988029 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.987915    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9a3d4a-e35f-44f3-b256-782fa8625556-metrics-certs\") pod \"odh-model-controller-769875db56-h9lpt\" (UID: \"7a9a3d4a-e35f-44f3-b256-782fa8625556\") " pod="opendatahub/odh-model-controller-769875db56-h9lpt"
Nov 04 02:23:03.990352 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:03.990326    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c831875f-bf66-4462-a8d0-04b9692e01ab-tls-certs\") pod \"model-serving-api-75bd89fdfc-phrf7\" (UID: \"c831875f-bf66-4462-a8d0-04b9692e01ab\") " pod="opendatahub/model-serving-api-75bd89fdfc-phrf7"
Nov 04 02:23:04.047211 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:04.047172    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfz7n\" (UniqueName: \"kubernetes.io/projected/c831875f-bf66-4462-a8d0-04b9692e01ab-kube-api-access-bfz7n\") pod \"model-serving-api-75bd89fdfc-phrf7\" (UID: \"c831875f-bf66-4462-a8d0-04b9692e01ab\") " pod="opendatahub/model-serving-api-75bd89fdfc-phrf7"
Nov 04 02:23:04.078207 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:04.078176    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-phrf7"
Nov 04 02:23:04.088613 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:04.088563    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4sfb\" (UniqueName: \"kubernetes.io/projected/7a9a3d4a-e35f-44f3-b256-782fa8625556-kube-api-access-f4sfb\") pod \"odh-model-controller-769875db56-h9lpt\" (UID: \"7a9a3d4a-e35f-44f3-b256-782fa8625556\") " pod="opendatahub/odh-model-controller-769875db56-h9lpt"
Nov 04 02:23:04.088773 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:04.088667    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a9a3d4a-e35f-44f3-b256-782fa8625556-cert\") pod \"odh-model-controller-769875db56-h9lpt\" (UID: \"7a9a3d4a-e35f-44f3-b256-782fa8625556\") " pod="opendatahub/odh-model-controller-769875db56-h9lpt"
Nov 04 02:23:04.088773 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:04.088717    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9a3d4a-e35f-44f3-b256-782fa8625556-metrics-certs\") pod \"odh-model-controller-769875db56-h9lpt\" (UID: \"7a9a3d4a-e35f-44f3-b256-782fa8625556\") " pod="opendatahub/odh-model-controller-769875db56-h9lpt"
Nov 04 02:23:04.091064 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:04.091040    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9a3d4a-e35f-44f3-b256-782fa8625556-metrics-certs\") pod \"odh-model-controller-769875db56-h9lpt\" (UID: \"7a9a3d4a-e35f-44f3-b256-782fa8625556\") " pod="opendatahub/odh-model-controller-769875db56-h9lpt"
Nov 04 02:23:04.091064 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:04.091059    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a9a3d4a-e35f-44f3-b256-782fa8625556-cert\") pod \"odh-model-controller-769875db56-h9lpt\" (UID: \"7a9a3d4a-e35f-44f3-b256-782fa8625556\") " pod="opendatahub/odh-model-controller-769875db56-h9lpt"
Nov 04 02:23:04.150116 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:04.150081    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4sfb\" (UniqueName: \"kubernetes.io/projected/7a9a3d4a-e35f-44f3-b256-782fa8625556-kube-api-access-f4sfb\") pod \"odh-model-controller-769875db56-h9lpt\" (UID: \"7a9a3d4a-e35f-44f3-b256-782fa8625556\") " pod="opendatahub/odh-model-controller-769875db56-h9lpt"
Nov 04 02:23:04.185003 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:04.184972    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-h9lpt"
Nov 04 02:23:04.201952 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:04.201919    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-z99gz"]
Nov 04 02:23:04.207591 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:23:04.207561    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94467c99_f42c_4305_a2c8_0566e48b68b5.slice/crio-0f80195ae3457e64622da8f5a98e3b0d39dc7327f2f6460e5886369c6d609900 WatchSource:0}: Error finding container 0f80195ae3457e64622da8f5a98e3b0d39dc7327f2f6460e5886369c6d609900: Status 404 returned error can't find the container with id 0f80195ae3457e64622da8f5a98e3b0d39dc7327f2f6460e5886369c6d609900
Nov 04 02:23:04.316988 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:04.316955    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-z99gz" event={"ID":"94467c99-f42c-4305-a2c8-0566e48b68b5","Type":"ContainerStarted","Data":"0f80195ae3457e64622da8f5a98e3b0d39dc7327f2f6460e5886369c6d609900"}
Nov 04 02:23:04.482435 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:04.482401    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-phrf7"]
Nov 04 02:23:04.488397 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:23:04.488366    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc831875f_bf66_4462_a8d0_04b9692e01ab.slice/crio-a014e5b1fa6a79fb159c1005f0e94276bed33dafde31ebce98be8f84105dc1af WatchSource:0}: Error finding container a014e5b1fa6a79fb159c1005f0e94276bed33dafde31ebce98be8f84105dc1af: Status 404 returned error can't find the container with id a014e5b1fa6a79fb159c1005f0e94276bed33dafde31ebce98be8f84105dc1af
Nov 04 02:23:04.579396 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:04.579317    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-h9lpt"]
Nov 04 02:23:04.582236 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:23:04.582210    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9a3d4a_e35f_44f3_b256_782fa8625556.slice/crio-7835b82ad7a23938a9a6a8c61f28619a51ba81b5d16f1529084606ec85cc2dd7 WatchSource:0}: Error finding container 7835b82ad7a23938a9a6a8c61f28619a51ba81b5d16f1529084606ec85cc2dd7: Status 404 returned error can't find the container with id 7835b82ad7a23938a9a6a8c61f28619a51ba81b5d16f1529084606ec85cc2dd7
Nov 04 02:23:05.323066 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:05.323023    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-phrf7" event={"ID":"c831875f-bf66-4462-a8d0-04b9692e01ab","Type":"ContainerStarted","Data":"a014e5b1fa6a79fb159c1005f0e94276bed33dafde31ebce98be8f84105dc1af"}
Nov 04 02:23:05.324340 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:05.324313    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-h9lpt" event={"ID":"7a9a3d4a-e35f-44f3-b256-782fa8625556","Type":"ContainerStarted","Data":"7835b82ad7a23938a9a6a8c61f28619a51ba81b5d16f1529084606ec85cc2dd7"}
Nov 04 02:23:06.490342 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.490297    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b86f7d796-mnw99"]
Nov 04 02:23:06.499335 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.499306    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:06.550200 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.550155    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Nov 04 02:23:06.599816 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.598032    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Nov 04 02:23:06.599816 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.598049    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Nov 04 02:23:06.599816 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.598150    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-49btd\""
Nov 04 02:23:06.599816 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.599742    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b86f7d796-mnw99"]
Nov 04 02:23:06.611848 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.611812    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-metrics-certs\") pod \"maas-controller-6b86f7d796-mnw99\" (UID: \"5112d080-185c-47d1-9222-3cc9985af525\") " pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:06.612034 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.611930    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whvbr\" (UniqueName: \"kubernetes.io/projected/5112d080-185c-47d1-9222-3cc9985af525-kube-api-access-whvbr\") pod \"maas-controller-6b86f7d796-mnw99\" (UID: \"5112d080-185c-47d1-9222-3cc9985af525\") " pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:06.612034 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.611974    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-webhook-cert\") pod \"maas-controller-6b86f7d796-mnw99\" (UID: \"5112d080-185c-47d1-9222-3cc9985af525\") " pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:06.712670 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.712631    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-webhook-cert\") pod \"maas-controller-6b86f7d796-mnw99\" (UID: \"5112d080-185c-47d1-9222-3cc9985af525\") " pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:06.712863 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.712730    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-metrics-certs\") pod \"maas-controller-6b86f7d796-mnw99\" (UID: \"5112d080-185c-47d1-9222-3cc9985af525\") " pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:06.712863 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.712822    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvbr\" (UniqueName: \"kubernetes.io/projected/5112d080-185c-47d1-9222-3cc9985af525-kube-api-access-whvbr\") pod \"maas-controller-6b86f7d796-mnw99\" (UID: \"5112d080-185c-47d1-9222-3cc9985af525\") " pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:06.716355 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.716325    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-webhook-cert\") pod \"maas-controller-6b86f7d796-mnw99\" (UID: \"5112d080-185c-47d1-9222-3cc9985af525\") " pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:06.719378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.719350    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-metrics-certs\") pod \"maas-controller-6b86f7d796-mnw99\" (UID: \"5112d080-185c-47d1-9222-3cc9985af525\") " pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:06.778127 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.778054    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whvbr\" (UniqueName: \"kubernetes.io/projected/5112d080-185c-47d1-9222-3cc9985af525-kube-api-access-whvbr\") pod \"maas-controller-6b86f7d796-mnw99\" (UID: \"5112d080-185c-47d1-9222-3cc9985af525\") " pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:06.819341 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:06.819084    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:07.096104 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.096024    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74b9444797-jtnrf"]
Nov 04 02:23:07.099937 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.099911    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74b9444797-jtnrf"
Nov 04 02:23:07.155951 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.155914    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74b9444797-jtnrf"]
Nov 04 02:23:07.218354 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.218321    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79065a57-7320-4823-a727-1fcb50145dd1-webhook-cert\") pod \"maas-controller-74b9444797-jtnrf\" (UID: \"79065a57-7320-4823-a727-1fcb50145dd1\") " pod="opendatahub/maas-controller-74b9444797-jtnrf"
Nov 04 02:23:07.218552 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.218470    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79065a57-7320-4823-a727-1fcb50145dd1-metrics-certs\") pod \"maas-controller-74b9444797-jtnrf\" (UID: \"79065a57-7320-4823-a727-1fcb50145dd1\") " pod="opendatahub/maas-controller-74b9444797-jtnrf"
Nov 04 02:23:07.218552 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.218512    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b86f7d796-mnw99"]
Nov 04 02:23:07.218552 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.218543    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvkfj\" (UniqueName: \"kubernetes.io/projected/79065a57-7320-4823-a727-1fcb50145dd1-kube-api-access-rvkfj\") pod \"maas-controller-74b9444797-jtnrf\" (UID: \"79065a57-7320-4823-a727-1fcb50145dd1\") " pod="opendatahub/maas-controller-74b9444797-jtnrf"
Nov 04 02:23:07.224886 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:23:07.224858    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5112d080_185c_47d1_9222_3cc9985af525.slice/crio-475d4081612cc7f618c2bd291e6fd18483ff0ea11136e936cf4f6c08282068d1 WatchSource:0}: Error finding container 475d4081612cc7f618c2bd291e6fd18483ff0ea11136e936cf4f6c08282068d1: Status 404 returned error can't find the container with id 475d4081612cc7f618c2bd291e6fd18483ff0ea11136e936cf4f6c08282068d1
Nov 04 02:23:07.320364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.319681    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79065a57-7320-4823-a727-1fcb50145dd1-metrics-certs\") pod \"maas-controller-74b9444797-jtnrf\" (UID: \"79065a57-7320-4823-a727-1fcb50145dd1\") " pod="opendatahub/maas-controller-74b9444797-jtnrf"
Nov 04 02:23:07.320364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.319764    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvkfj\" (UniqueName: \"kubernetes.io/projected/79065a57-7320-4823-a727-1fcb50145dd1-kube-api-access-rvkfj\") pod \"maas-controller-74b9444797-jtnrf\" (UID: \"79065a57-7320-4823-a727-1fcb50145dd1\") " pod="opendatahub/maas-controller-74b9444797-jtnrf"
Nov 04 02:23:07.320364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.319840    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79065a57-7320-4823-a727-1fcb50145dd1-webhook-cert\") pod \"maas-controller-74b9444797-jtnrf\" (UID: \"79065a57-7320-4823-a727-1fcb50145dd1\") " pod="opendatahub/maas-controller-74b9444797-jtnrf"
Nov 04 02:23:07.323017 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.322989    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79065a57-7320-4823-a727-1fcb50145dd1-webhook-cert\") pod \"maas-controller-74b9444797-jtnrf\" (UID: \"79065a57-7320-4823-a727-1fcb50145dd1\") " pod="opendatahub/maas-controller-74b9444797-jtnrf"
Nov 04 02:23:07.323448 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.323423    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79065a57-7320-4823-a727-1fcb50145dd1-metrics-certs\") pod \"maas-controller-74b9444797-jtnrf\" (UID: \"79065a57-7320-4823-a727-1fcb50145dd1\") " pod="opendatahub/maas-controller-74b9444797-jtnrf"
Nov 04 02:23:07.342855 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.342806    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b86f7d796-mnw99" event={"ID":"5112d080-185c-47d1-9222-3cc9985af525","Type":"ContainerStarted","Data":"475d4081612cc7f618c2bd291e6fd18483ff0ea11136e936cf4f6c08282068d1"}
Nov 04 02:23:07.381175 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.381099    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvkfj\" (UniqueName: \"kubernetes.io/projected/79065a57-7320-4823-a727-1fcb50145dd1-kube-api-access-rvkfj\") pod \"maas-controller-74b9444797-jtnrf\" (UID: \"79065a57-7320-4823-a727-1fcb50145dd1\") " pod="opendatahub/maas-controller-74b9444797-jtnrf"
Nov 04 02:23:07.416807 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.416759    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74b9444797-jtnrf"
Nov 04 02:23:07.804991 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:07.804903    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74b9444797-jtnrf"]
Nov 04 02:23:07.813832 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:23:07.813796    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79065a57_7320_4823_a727_1fcb50145dd1.slice/crio-a9518b0f17fd70c0febc994cb1a7b6258e7b1b0036e5fece37055e6fbc55bb2d WatchSource:0}: Error finding container a9518b0f17fd70c0febc994cb1a7b6258e7b1b0036e5fece37055e6fbc55bb2d: Status 404 returned error can't find the container with id a9518b0f17fd70c0febc994cb1a7b6258e7b1b0036e5fece37055e6fbc55bb2d
Nov 04 02:23:08.349879 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:08.349840    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-phrf7" event={"ID":"c831875f-bf66-4462-a8d0-04b9692e01ab","Type":"ContainerStarted","Data":"e3729b47f7c6fdcf5b5093c06d77a2bc0a1857917d24889e5eff5bf475b66f23"}
Nov 04 02:23:08.350064 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:08.349940    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-phrf7"
Nov 04 02:23:08.351981 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:08.351952    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-z99gz" event={"ID":"94467c99-f42c-4305-a2c8-0566e48b68b5","Type":"ContainerStarted","Data":"19fcaa5245d49d75d3ab8e58e990f3b5b97e03d71a098baafb81ff90b4b1206c"}
Nov 04 02:23:08.352133 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:08.352010    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-z99gz"
Nov 04 02:23:08.353277 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:08.353250    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74b9444797-jtnrf" event={"ID":"79065a57-7320-4823-a727-1fcb50145dd1","Type":"ContainerStarted","Data":"a9518b0f17fd70c0febc994cb1a7b6258e7b1b0036e5fece37055e6fbc55bb2d"}
Nov 04 02:23:08.463227 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:08.463173    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-phrf7" podStartSLOduration=2.332677372 podStartE2EDuration="5.463153985s" totalImagesPullingTime="3.130476613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:23:08.462143108 +0000 UTC m=+383.966083603" watchObservedRunningTime="2026-11-04 02:23:08.463153985 +0000 UTC m=+383.967094473"
Nov 04 02:23:08.575738 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:08.575686    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-z99gz" podStartSLOduration=1.840624124 podStartE2EDuration="5.575670852s" totalImagesPullingTime="3.735046728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:23:08.57452059 +0000 UTC m=+384.078461103" watchObservedRunningTime="2026-11-04 02:23:08.575670852 +0000 UTC m=+384.079611345"
Nov 04 02:23:09.362283 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:09.362195    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-h9lpt" event={"ID":"7a9a3d4a-e35f-44f3-b256-782fa8625556","Type":"ContainerStarted","Data":"13e323a14fd9eaca7d439e358e475e95b4e33363f2d9d13933dcf99dca1a8f0a"}
Nov 04 02:23:09.363062 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:09.363037    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-h9lpt"
Nov 04 02:23:09.477895 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:09.477822    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-h9lpt" podStartSLOduration=1.9776431780000001 podStartE2EDuration="6.477802112s" totalImagesPullingTime="4.500158934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:23:09.476112342 +0000 UTC m=+384.980052840" watchObservedRunningTime="2026-11-04 02:23:09.477802112 +0000 UTC m=+384.981742607"
Nov 04 02:23:14.392735 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:14.392640    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b86f7d796-mnw99" event={"ID":"5112d080-185c-47d1-9222-3cc9985af525","Type":"ContainerStarted","Data":"3abb9ad0d410d03d937b4c9d58d82edededf5fbfb3c9f3570e5c48370712d505"}
Nov 04 02:23:14.393219 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:14.392849    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:14.394424 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:14.394387    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74b9444797-jtnrf" event={"ID":"79065a57-7320-4823-a727-1fcb50145dd1","Type":"ContainerStarted","Data":"de6175e08c0de948890ca93736b4cc130ea7d376d0c568e6c1afa737b5204de4"}
Nov 04 02:23:14.394565 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:14.394474    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74b9444797-jtnrf"
Nov 04 02:23:14.565807 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:14.565751    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-6b86f7d796-mnw99" podStartSLOduration=2.076046705 podStartE2EDuration="8.565736586s" totalImagesPullingTime="6.489689881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:23:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:23:14.56414995 +0000 UTC m=+390.068090472" watchObservedRunningTime="2026-11-04 02:23:14.565736586 +0000 UTC m=+390.069677079"
Nov 04 02:23:14.683121 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:14.682999    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-74b9444797-jtnrf" podStartSLOduration=1.7412570939999998 podStartE2EDuration="7.68297964s" totalImagesPullingTime="5.941722546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:23:14.681785287 +0000 UTC m=+390.185725780" watchObservedRunningTime="2026-11-04 02:23:14.68297964 +0000 UTC m=+390.186920136"
Nov 04 02:23:17.764007 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:23:17.763968    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:23:19.366763 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:19.366730    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-phrf7"
Nov 04 02:23:21.374525 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:21.374498    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-h9lpt"
Nov 04 02:23:25.401372 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:25.401331    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:25.401782 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:25.401407    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74b9444797-jtnrf"
Nov 04 02:23:25.661744 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:25.661642    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b86f7d796-mnw99"]
Nov 04 02:23:25.661941 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:25.661906    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-6b86f7d796-mnw99" podUID="5112d080-185c-47d1-9222-3cc9985af525" containerName="manager" containerID="cri-o://3abb9ad0d410d03d937b4c9d58d82edededf5fbfb3c9f3570e5c48370712d505" gracePeriod=30
Nov 04 02:23:25.908848 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:25.908824    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:26.008344 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.008317    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-metrics-certs\") pod \"5112d080-185c-47d1-9222-3cc9985af525\" (UID: \"5112d080-185c-47d1-9222-3cc9985af525\") "
Nov 04 02:23:26.008504 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.008380    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5112d080-185c-47d1-9222-3cc9985af525-kube-api-access-whvbr\" (UniqueName: \"kubernetes.io/projected/5112d080-185c-47d1-9222-3cc9985af525-kube-api-access-whvbr\") pod \"5112d080-185c-47d1-9222-3cc9985af525\" (UID: \"5112d080-185c-47d1-9222-3cc9985af525\") "
Nov 04 02:23:26.008504 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.008483    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-webhook-cert\" (UniqueName: \"kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-webhook-cert\") pod \"5112d080-185c-47d1-9222-3cc9985af525\" (UID: \"5112d080-185c-47d1-9222-3cc9985af525\") "
Nov 04 02:23:26.010628 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.010586    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5112d080-185c-47d1-9222-3cc9985af525-kube-api-access-whvbr" pod "5112d080-185c-47d1-9222-3cc9985af525" (UID: "5112d080-185c-47d1-9222-3cc9985af525"). InnerVolumeSpecName "kube-api-access-whvbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:23:26.010888 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.010865    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-metrics-certs" pod "5112d080-185c-47d1-9222-3cc9985af525" (UID: "5112d080-185c-47d1-9222-3cc9985af525"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:23:26.010994 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.010894    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-webhook-cert" pod "5112d080-185c-47d1-9222-3cc9985af525" (UID: "5112d080-185c-47d1-9222-3cc9985af525"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:23:26.109592 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.109548    5450 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-metrics-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:23:26.109592 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.109583    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whvbr\" (UniqueName: \"kubernetes.io/projected/5112d080-185c-47d1-9222-3cc9985af525-kube-api-access-whvbr\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:23:26.109592 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.109616    5450 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5112d080-185c-47d1-9222-3cc9985af525-webhook-cert\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:23:26.456909 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.456813    5450 generic.go:356] "Generic (PLEG): container finished" podID="5112d080-185c-47d1-9222-3cc9985af525" containerID="3abb9ad0d410d03d937b4c9d58d82edededf5fbfb3c9f3570e5c48370712d505" exitCode=0
Nov 04 02:23:26.456909 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.456864    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b86f7d796-mnw99" event={"ID":"5112d080-185c-47d1-9222-3cc9985af525","Type":"ContainerDied","Data":"3abb9ad0d410d03d937b4c9d58d82edededf5fbfb3c9f3570e5c48370712d505"}
Nov 04 02:23:26.456909 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.456887    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b86f7d796-mnw99"
Nov 04 02:23:26.457509 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.456933    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b86f7d796-mnw99" event={"ID":"5112d080-185c-47d1-9222-3cc9985af525","Type":"ContainerDied","Data":"475d4081612cc7f618c2bd291e6fd18483ff0ea11136e936cf4f6c08282068d1"}
Nov 04 02:23:26.457509 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.456956    5450 scope.go:122] "RemoveContainer" containerID="3abb9ad0d410d03d937b4c9d58d82edededf5fbfb3c9f3570e5c48370712d505"
Nov 04 02:23:26.466111 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.466089    5450 scope.go:122] "RemoveContainer" containerID="3abb9ad0d410d03d937b4c9d58d82edededf5fbfb3c9f3570e5c48370712d505"
Nov 04 02:23:26.466381 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:23:26.466360    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3abb9ad0d410d03d937b4c9d58d82edededf5fbfb3c9f3570e5c48370712d505\": container with ID starting with 3abb9ad0d410d03d937b4c9d58d82edededf5fbfb3c9f3570e5c48370712d505 not found: ID does not exist" containerID="3abb9ad0d410d03d937b4c9d58d82edededf5fbfb3c9f3570e5c48370712d505"
Nov 04 02:23:26.466448 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.466390    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3abb9ad0d410d03d937b4c9d58d82edededf5fbfb3c9f3570e5c48370712d505"} err="failed to get container status \"3abb9ad0d410d03d937b4c9d58d82edededf5fbfb3c9f3570e5c48370712d505\": rpc error: code = NotFound desc = could not find container \"3abb9ad0d410d03d937b4c9d58d82edededf5fbfb3c9f3570e5c48370712d505\": container with ID starting with 3abb9ad0d410d03d937b4c9d58d82edededf5fbfb3c9f3570e5c48370712d505 not found: ID does not exist"
Nov 04 02:23:26.615757 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.615722    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b86f7d796-mnw99"]
Nov 04 02:23:26.620015 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.619989    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b86f7d796-mnw99"]
Nov 04 02:23:26.631663 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:26.631637    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5112d080-185c-47d1-9222-3cc9985af525" path="/var/lib/kubelet/pods/5112d080-185c-47d1-9222-3cc9985af525/volumes"
Nov 04 02:23:39.368880 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:39.368849    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-z99gz"
Nov 04 02:23:47.764300 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:23:47.764259    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:23:51.331925 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:51.331891    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:23:59.662607 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.662570    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"]
Nov 04 02:23:59.663034 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.663018    5450 cpu_manager.go:414] "containerMap: removing container" podUID="5112d080-185c-47d1-9222-3cc9985af525" containerName="manager"
Nov 04 02:23:59.663077 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.663036    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5112d080-185c-47d1-9222-3cc9985af525" containerName="manager"
Nov 04 02:23:59.663123 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.663114    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="5112d080-185c-47d1-9222-3cc9985af525" containerName="manager"
Nov 04 02:23:59.665318 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.665302    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:23:59.710423 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.710388    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"]
Nov 04 02:23:59.721382 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.721356    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v62b\" (UniqueName: \"kubernetes.io/projected/00731567-5ec5-45f5-a4a0-d692ec45cd52-kube-api-access-8v62b\") pod \"maas-api-57fb95ff7c-2swn6\" (UID: \"00731567-5ec5-45f5-a4a0-d692ec45cd52\") " pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:23:59.721533 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.721482    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00731567-5ec5-45f5-a4a0-d692ec45cd52-openshift-service-ca\") pod \"maas-api-57fb95ff7c-2swn6\" (UID: \"00731567-5ec5-45f5-a4a0-d692ec45cd52\") " pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:23:59.721640 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.721616    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00731567-5ec5-45f5-a4a0-d692ec45cd52-metrics-certs\") pod \"maas-api-57fb95ff7c-2swn6\" (UID: \"00731567-5ec5-45f5-a4a0-d692ec45cd52\") " pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:23:59.721742 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.721730    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00731567-5ec5-45f5-a4a0-d692ec45cd52-maas-api-tls\") pod \"maas-api-57fb95ff7c-2swn6\" (UID: \"00731567-5ec5-45f5-a4a0-d692ec45cd52\") " pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:23:59.723656 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.723633    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 04 02:23:59.723779 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.723673    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-plfvj\""
Nov 04 02:23:59.763487 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.763458    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 04 02:23:59.822416 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.822386    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v62b\" (UniqueName: \"kubernetes.io/projected/00731567-5ec5-45f5-a4a0-d692ec45cd52-kube-api-access-8v62b\") pod \"maas-api-57fb95ff7c-2swn6\" (UID: \"00731567-5ec5-45f5-a4a0-d692ec45cd52\") " pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:23:59.822633 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.822438    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00731567-5ec5-45f5-a4a0-d692ec45cd52-openshift-service-ca\") pod \"maas-api-57fb95ff7c-2swn6\" (UID: \"00731567-5ec5-45f5-a4a0-d692ec45cd52\") " pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:23:59.822633 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.822457    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00731567-5ec5-45f5-a4a0-d692ec45cd52-metrics-certs\") pod \"maas-api-57fb95ff7c-2swn6\" (UID: \"00731567-5ec5-45f5-a4a0-d692ec45cd52\") " pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:23:59.822633 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.822511    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00731567-5ec5-45f5-a4a0-d692ec45cd52-maas-api-tls\") pod \"maas-api-57fb95ff7c-2swn6\" (UID: \"00731567-5ec5-45f5-a4a0-d692ec45cd52\") " pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:23:59.823154 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.823129    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00731567-5ec5-45f5-a4a0-d692ec45cd52-openshift-service-ca\") pod \"maas-api-57fb95ff7c-2swn6\" (UID: \"00731567-5ec5-45f5-a4a0-d692ec45cd52\") " pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:23:59.824958 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.824925    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00731567-5ec5-45f5-a4a0-d692ec45cd52-metrics-certs\") pod \"maas-api-57fb95ff7c-2swn6\" (UID: \"00731567-5ec5-45f5-a4a0-d692ec45cd52\") " pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:23:59.825047 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.824992    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00731567-5ec5-45f5-a4a0-d692ec45cd52-maas-api-tls\") pod \"maas-api-57fb95ff7c-2swn6\" (UID: \"00731567-5ec5-45f5-a4a0-d692ec45cd52\") " pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:23:59.882281 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.882243    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v62b\" (UniqueName: \"kubernetes.io/projected/00731567-5ec5-45f5-a4a0-d692ec45cd52-kube-api-access-8v62b\") pod \"maas-api-57fb95ff7c-2swn6\" (UID: \"00731567-5ec5-45f5-a4a0-d692ec45cd52\") " pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:23:59.978377 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:23:59.978290    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:24:00.347717 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:24:00.347684    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"]
Nov 04 02:24:00.354790 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:24:00.354760    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00731567_5ec5_45f5_a4a0_d692ec45cd52.slice/crio-85a000cb36c7e0a11b1dbd51b2449bfefdedc220fd5917dad1c124eef719c358 WatchSource:0}: Error finding container 85a000cb36c7e0a11b1dbd51b2449bfefdedc220fd5917dad1c124eef719c358: Status 404 returned error can't find the container with id 85a000cb36c7e0a11b1dbd51b2449bfefdedc220fd5917dad1c124eef719c358
Nov 04 02:24:00.615895 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:24:00.615810    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6" event={"ID":"00731567-5ec5-45f5-a4a0-d692ec45cd52","Type":"ContainerStarted","Data":"85a000cb36c7e0a11b1dbd51b2449bfefdedc220fd5917dad1c124eef719c358"}
Nov 04 02:24:02.631865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:24:02.631776    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6" event={"ID":"00731567-5ec5-45f5-a4a0-d692ec45cd52","Type":"ContainerStarted","Data":"03f744e6e4acda7832555d46bee49062dd359613e9d5f6cbd2f35993eba81e31"}
Nov 04 02:24:02.632220 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:24:02.631910    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:24:02.746941 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:24:02.746887    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6" podStartSLOduration=1.8321311200000001 podStartE2EDuration="3.746872969s" totalImagesPullingTime="1.914741849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:24:02.746046957 +0000 UTC m=+438.249987451" watchObservedRunningTime="2026-11-04 02:24:02.746872969 +0000 UTC m=+438.250813462"
Nov 04 02:24:08.641961 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:24:08.641930    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-57fb95ff7c-2swn6"
Nov 04 02:24:17.763756 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:24:17.763717    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:24:47.763843 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:24:47.763803    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:25:07.646720 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.646679    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-4l68q"]
Nov 04 02:25:07.650746 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.650721    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-4l68q"
Nov 04 02:25:07.703859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.703827    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Nov 04 02:25:07.751763 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.751726    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dchxf\""
Nov 04 02:25:07.753125 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.753104    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-4l68q"]
Nov 04 02:25:07.753197 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.753180    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr4gt\" (UniqueName: \"kubernetes.io/projected/2e145331-60bc-4fea-9d4e-04bfbb4964c8-kube-api-access-gr4gt\") pod \"payload-pre-processing-7b98bb678c-4l68q\" (UID: \"2e145331-60bc-4fea-9d4e-04bfbb4964c8\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-4l68q"
Nov 04 02:25:07.753269 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.753256    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e145331-60bc-4fea-9d4e-04bfbb4964c8-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-4l68q\" (UID: \"2e145331-60bc-4fea-9d4e-04bfbb4964c8\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-4l68q"
Nov 04 02:25:07.800959 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.800928    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-bd857"]
Nov 04 02:25:07.804550 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.804530    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bb9489676-bd857"
Nov 04 02:25:07.845086 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.845047    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-bd857"]
Nov 04 02:25:07.854903 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.854873    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e145331-60bc-4fea-9d4e-04bfbb4964c8-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-4l68q\" (UID: \"2e145331-60bc-4fea-9d4e-04bfbb4964c8\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-4l68q"
Nov 04 02:25:07.855059 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.854979    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr4gt\" (UniqueName: \"kubernetes.io/projected/2e145331-60bc-4fea-9d4e-04bfbb4964c8-kube-api-access-gr4gt\") pod \"payload-pre-processing-7b98bb678c-4l68q\" (UID: \"2e145331-60bc-4fea-9d4e-04bfbb4964c8\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-4l68q"
Nov 04 02:25:07.855824 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.855800    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e145331-60bc-4fea-9d4e-04bfbb4964c8-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-4l68q\" (UID: \"2e145331-60bc-4fea-9d4e-04bfbb4964c8\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-4l68q"
Nov 04 02:25:07.915403 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.915314    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr4gt\" (UniqueName: \"kubernetes.io/projected/2e145331-60bc-4fea-9d4e-04bfbb4964c8-kube-api-access-gr4gt\") pod \"payload-pre-processing-7b98bb678c-4l68q\" (UID: \"2e145331-60bc-4fea-9d4e-04bfbb4964c8\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-4l68q"
Nov 04 02:25:07.955729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.955693    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xllnl\" (UniqueName: \"kubernetes.io/projected/87b7890e-a38b-45c7-8ca3-4fe3ba33435f-kube-api-access-xllnl\") pod \"payload-processing-7bb9489676-bd857\" (UID: \"87b7890e-a38b-45c7-8ca3-4fe3ba33435f\") " pod="openshift-ingress/payload-processing-7bb9489676-bd857"
Nov 04 02:25:07.955872 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.955756    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87b7890e-a38b-45c7-8ca3-4fe3ba33435f-plugins-config-volume\") pod \"payload-processing-7bb9489676-bd857\" (UID: \"87b7890e-a38b-45c7-8ca3-4fe3ba33435f\") " pod="openshift-ingress/payload-processing-7bb9489676-bd857"
Nov 04 02:25:07.963554 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:07.963525    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-4l68q"
Nov 04 02:25:08.057404 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:08.057370    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xllnl\" (UniqueName: \"kubernetes.io/projected/87b7890e-a38b-45c7-8ca3-4fe3ba33435f-kube-api-access-xllnl\") pod \"payload-processing-7bb9489676-bd857\" (UID: \"87b7890e-a38b-45c7-8ca3-4fe3ba33435f\") " pod="openshift-ingress/payload-processing-7bb9489676-bd857"
Nov 04 02:25:08.057574 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:08.057426    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87b7890e-a38b-45c7-8ca3-4fe3ba33435f-plugins-config-volume\") pod \"payload-processing-7bb9489676-bd857\" (UID: \"87b7890e-a38b-45c7-8ca3-4fe3ba33435f\") " pod="openshift-ingress/payload-processing-7bb9489676-bd857"
Nov 04 02:25:08.058130 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:08.058105    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87b7890e-a38b-45c7-8ca3-4fe3ba33435f-plugins-config-volume\") pod \"payload-processing-7bb9489676-bd857\" (UID: \"87b7890e-a38b-45c7-8ca3-4fe3ba33435f\") " pod="openshift-ingress/payload-processing-7bb9489676-bd857"
Nov 04 02:25:08.116784 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:08.116751    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xllnl\" (UniqueName: \"kubernetes.io/projected/87b7890e-a38b-45c7-8ca3-4fe3ba33435f-kube-api-access-xllnl\") pod \"payload-processing-7bb9489676-bd857\" (UID: \"87b7890e-a38b-45c7-8ca3-4fe3ba33435f\") " pod="openshift-ingress/payload-processing-7bb9489676-bd857"
Nov 04 02:25:08.117509 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:08.117489    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bb9489676-bd857"
Nov 04 02:25:08.331890 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:08.331856    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-4l68q"]
Nov 04 02:25:08.337562 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:25:08.337526    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e145331_60bc_4fea_9d4e_04bfbb4964c8.slice/crio-db3d420aac92cd22ac3f028c6b3a0a7d6997fe41513fef96fd6058570d3b79c1 WatchSource:0}: Error finding container db3d420aac92cd22ac3f028c6b3a0a7d6997fe41513fef96fd6058570d3b79c1: Status 404 returned error can't find the container with id db3d420aac92cd22ac3f028c6b3a0a7d6997fe41513fef96fd6058570d3b79c1
Nov 04 02:25:08.491736 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:08.491647    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-bd857"]
Nov 04 02:25:08.497414 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:25:08.497383    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b7890e_a38b_45c7_8ca3_4fe3ba33435f.slice/crio-b5573f9fb48ea3ac42ce2c14b937702e1f2720df3bbc9f066ffc9dfcf1cad075 WatchSource:0}: Error finding container b5573f9fb48ea3ac42ce2c14b937702e1f2720df3bbc9f066ffc9dfcf1cad075: Status 404 returned error can't find the container with id b5573f9fb48ea3ac42ce2c14b937702e1f2720df3bbc9f066ffc9dfcf1cad075
Nov 04 02:25:08.933590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:08.933554    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bb9489676-bd857" event={"ID":"87b7890e-a38b-45c7-8ca3-4fe3ba33435f","Type":"ContainerStarted","Data":"b5573f9fb48ea3ac42ce2c14b937702e1f2720df3bbc9f066ffc9dfcf1cad075"}
Nov 04 02:25:08.934809 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:08.934779    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-4l68q" event={"ID":"2e145331-60bc-4fea-9d4e-04bfbb4964c8","Type":"ContainerStarted","Data":"db3d420aac92cd22ac3f028c6b3a0a7d6997fe41513fef96fd6058570d3b79c1"}
Nov 04 02:25:13.968024 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:13.967985    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bb9489676-bd857" event={"ID":"87b7890e-a38b-45c7-8ca3-4fe3ba33435f","Type":"ContainerStarted","Data":"2b91dac413ee850227918a8b25ea8f1116dcf30037616667f53fd35525b39b6d"}
Nov 04 02:25:13.968492 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:13.968071    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bb9489676-bd857"
Nov 04 02:25:13.969682 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:13.969649    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-4l68q" event={"ID":"2e145331-60bc-4fea-9d4e-04bfbb4964c8","Type":"ContainerStarted","Data":"b537545cc7f61bf5cb34ea162e539ee9261796f2d0a4fd0a070fb7cb8cf740e8"}
Nov 04 02:25:13.969808 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:13.969741    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-4l68q"
Nov 04 02:25:14.082770 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:14.082713    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bb9489676-bd857" podStartSLOduration=2.543606361 podStartE2EDuration="7.082696295s" totalImagesPullingTime="4.539089934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:25:14.081340521 +0000 UTC m=+509.585281015" watchObservedRunningTime="2026-11-04 02:25:14.082696295 +0000 UTC m=+509.586636789"
Nov 04 02:25:14.194006 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:14.193954    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-4l68q" podStartSLOduration=2.443011577 podStartE2EDuration="7.193938943s" totalImagesPullingTime="4.750927366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:25:14.192917031 +0000 UTC m=+509.696857525" watchObservedRunningTime="2026-11-04 02:25:14.193938943 +0000 UTC m=+509.697879436"
Nov 04 02:25:17.764446 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:25:17.764404    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:25:24.977573 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:24.977543    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-4l68q"
Nov 04 02:25:24.978075 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:24.977641    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bb9489676-bd857"
Nov 04 02:25:44.550892 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:44.550846    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:25:46.558219 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.558186    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"]
Nov 04 02:25:46.565776 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.565752    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.616929 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.616894    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"]
Nov 04 02:25:46.624571 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.624536    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.624747 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.624629    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8pw5\" (UniqueName: \"kubernetes.io/projected/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-kube-api-access-d8pw5\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.624747 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.624682    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.624819 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.624752    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.624819 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.624792    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.624927 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.624836    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.663146 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.663111    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Nov 04 02:25:46.663146 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.663117    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Nov 04 02:25:46.663918 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.663901    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nvkrm\""
Nov 04 02:25:46.663962 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.663908    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Nov 04 02:25:46.725799 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.725764    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.725962 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.725858    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.725962 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.725906    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8pw5\" (UniqueName: \"kubernetes.io/projected/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-kube-api-access-d8pw5\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.725962 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.725950    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.726123 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.725976    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.726123 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.726006    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.726278 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.726257    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.726343 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.726303    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.726389 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.726363    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.728255 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.728229    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.728463 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.728444    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.784997 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.784964    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8pw5\" (UniqueName: \"kubernetes.io/projected/9a78a346-f513-4cb1-a278-6d5ae9eb66f3-kube-api-access-d8pw5\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-vkkgd\" (UID: \"9a78a346-f513-4cb1-a278-6d5ae9eb66f3\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:46.878367 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:46.878276    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:47.250856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:47.250256    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"]
Nov 04 02:25:47.258521 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:25:47.258493    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a78a346_f513_4cb1_a278_6d5ae9eb66f3.slice/crio-ddc48c37a7d04fbe56a53941f6bb4b16f2e9fa8b739d553c5e9e17536357b635 WatchSource:0}: Error finding container ddc48c37a7d04fbe56a53941f6bb4b16f2e9fa8b739d553c5e9e17536357b635: Status 404 returned error can't find the container with id ddc48c37a7d04fbe56a53941f6bb4b16f2e9fa8b739d553c5e9e17536357b635
Nov 04 02:25:47.763259 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:25:47.763222    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:25:48.137650 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:48.137545    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd" event={"ID":"9a78a346-f513-4cb1-a278-6d5ae9eb66f3","Type":"ContainerStarted","Data":"ddc48c37a7d04fbe56a53941f6bb4b16f2e9fa8b739d553c5e9e17536357b635"}
Nov 04 02:25:49.144549 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:49.144455    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd" event={"ID":"9a78a346-f513-4cb1-a278-6d5ae9eb66f3","Type":"ContainerStarted","Data":"8558eb4d36ad280d5cf8db1b23a1ccb337c0be33ea383d9fcf79594ef642687e"}
Nov 04 02:25:49.258880 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:49.258826    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd" podStartSLOduration=1.7250588040000001 podStartE2EDuration="3.258811104s" totalImagesPullingTime="1.5337523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:25:49.25827558 +0000 UTC m=+544.762216109" watchObservedRunningTime="2026-11-04 02:25:49.258811104 +0000 UTC m=+544.762751593"
Nov 04 02:25:49.879182 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:49.879149    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:56.878453 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:56.878369    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:56.890750 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:56.890725    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:57.192683 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:57.192604    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-vkkgd"
Nov 04 02:25:57.322820 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:57.322789    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:25:58.383827 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.383793    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"]
Nov 04 02:25:58.387782 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.387759    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.438522 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.438486    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Nov 04 02:25:58.443440 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.443399    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"]
Nov 04 02:25:58.543720 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.543675    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bdddd82-a903-4017-98ae-200faa4219c3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.543904 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.543732    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bdddd82-a903-4017-98ae-200faa4219c3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.543904 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.543876    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bdddd82-a903-4017-98ae-200faa4219c3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.543976 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.543929    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24kzz\" (UniqueName: \"kubernetes.io/projected/1bdddd82-a903-4017-98ae-200faa4219c3-kube-api-access-24kzz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.544014 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.543992    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bdddd82-a903-4017-98ae-200faa4219c3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.544083 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.544069    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bdddd82-a903-4017-98ae-200faa4219c3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.645654 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.645560    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bdddd82-a903-4017-98ae-200faa4219c3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.645654 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.645615    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bdddd82-a903-4017-98ae-200faa4219c3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.645654 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.645652    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bdddd82-a903-4017-98ae-200faa4219c3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.645932 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.645683    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24kzz\" (UniqueName: \"kubernetes.io/projected/1bdddd82-a903-4017-98ae-200faa4219c3-kube-api-access-24kzz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.645932 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.645703    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bdddd82-a903-4017-98ae-200faa4219c3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.645932 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.645743    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bdddd82-a903-4017-98ae-200faa4219c3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.646063 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.646011    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bdddd82-a903-4017-98ae-200faa4219c3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.646063 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.646034    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bdddd82-a903-4017-98ae-200faa4219c3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.646172 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.646085    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bdddd82-a903-4017-98ae-200faa4219c3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.647916 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.647886    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bdddd82-a903-4017-98ae-200faa4219c3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.648280 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.648255    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bdddd82-a903-4017-98ae-200faa4219c3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:58.704826 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:58.704797    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24kzz\" (UniqueName: \"kubernetes.io/projected/1bdddd82-a903-4017-98ae-200faa4219c3-kube-api-access-24kzz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9\" (UID: \"1bdddd82-a903-4017-98ae-200faa4219c3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:59.000937 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:59.000852    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:25:59.369903 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:25:59.369872    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"]
Nov 04 02:25:59.376157 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:25:59.376124    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bdddd82_a903_4017_98ae_200faa4219c3.slice/crio-840698f9163b7cdf8696505d7345a723686528757253ea2f96bf596b5384f189 WatchSource:0}: Error finding container 840698f9163b7cdf8696505d7345a723686528757253ea2f96bf596b5384f189: Status 404 returned error can't find the container with id 840698f9163b7cdf8696505d7345a723686528757253ea2f96bf596b5384f189
Nov 04 02:26:00.198939 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:00.198894    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9" event={"ID":"1bdddd82-a903-4017-98ae-200faa4219c3","Type":"ContainerStarted","Data":"4cafc3b85a2f2e7bf404874a1ab3e5ef0dd7e06a2ba69658afb99910c8f12de7"}
Nov 04 02:26:00.199301 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:00.198961    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9" event={"ID":"1bdddd82-a903-4017-98ae-200faa4219c3","Type":"ContainerStarted","Data":"840698f9163b7cdf8696505d7345a723686528757253ea2f96bf596b5384f189"}
Nov 04 02:26:00.313586 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:00.313487    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9" podStartSLOduration=1.669988289 podStartE2EDuration="2.313471709s" totalImagesPullingTime="643.48342ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:25:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:26:00.312103493 +0000 UTC m=+555.816043988" watchObservedRunningTime="2026-11-04 02:26:00.313471709 +0000 UTC m=+555.817412203"
Nov 04 02:26:01.001349 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:01.001307    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:26:01.835495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:01.835457    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-snzd9"]
Nov 04 02:26:01.838716 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:01.838683    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:01.937152 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:01.937116    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Nov 04 02:26:01.938708 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:01.938685    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-snzd9"]
Nov 04 02:26:01.977959 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:01.977924    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bdc67c0-5165-4137-a066-78649d51681c-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:01.977959 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:01.977961    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bdc67c0-5165-4137-a066-78649d51681c-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:01.978225 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:01.978067    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bdc67c0-5165-4137-a066-78649d51681c-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:01.978225 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:01.978132    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bdc67c0-5165-4137-a066-78649d51681c-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:01.978225 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:01.978203    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bdc67c0-5165-4137-a066-78649d51681c-home\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:01.978327 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:01.978262    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb6bl\" (UniqueName: \"kubernetes.io/projected/7bdc67c0-5165-4137-a066-78649d51681c-kube-api-access-bb6bl\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.078821 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.078780    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb6bl\" (UniqueName: \"kubernetes.io/projected/7bdc67c0-5165-4137-a066-78649d51681c-kube-api-access-bb6bl\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.079021 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.078832    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bdc67c0-5165-4137-a066-78649d51681c-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.079021 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.078849    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bdc67c0-5165-4137-a066-78649d51681c-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.079021 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.078891    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bdc67c0-5165-4137-a066-78649d51681c-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.079021 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.078914    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bdc67c0-5165-4137-a066-78649d51681c-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.079021 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.078965    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bdc67c0-5165-4137-a066-78649d51681c-home\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.079309 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.079284    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bdc67c0-5165-4137-a066-78649d51681c-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.079359 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.079329    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bdc67c0-5165-4137-a066-78649d51681c-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.079414 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.079332    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bdc67c0-5165-4137-a066-78649d51681c-home\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.081282 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.081254    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bdc67c0-5165-4137-a066-78649d51681c-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.081465 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.081449    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bdc67c0-5165-4137-a066-78649d51681c-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.139388 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.139313    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb6bl\" (UniqueName: \"kubernetes.io/projected/7bdc67c0-5165-4137-a066-78649d51681c-kube-api-access-bb6bl\") pod \"echo-simulator-kserve-64b6f8f96c-snzd9\" (UID: \"7bdc67c0-5165-4137-a066-78649d51681c\") " pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.151767 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.151739    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:02.523973 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:02.523941    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-snzd9"]
Nov 04 02:26:02.530925 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:26:02.530885    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bdc67c0_5165_4137_a066_78649d51681c.slice/crio-4c30b9a41d442f17ab7c0d72606a258444d093f9a5812669345b067946a56894 WatchSource:0}: Error finding container 4c30b9a41d442f17ab7c0d72606a258444d093f9a5812669345b067946a56894: Status 404 returned error can't find the container with id 4c30b9a41d442f17ab7c0d72606a258444d093f9a5812669345b067946a56894
Nov 04 02:26:03.215951 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:03.215915    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9" event={"ID":"7bdc67c0-5165-4137-a066-78649d51681c","Type":"ContainerStarted","Data":"4c30b9a41d442f17ab7c0d72606a258444d093f9a5812669345b067946a56894"}
Nov 04 02:26:06.235166 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:06.235124    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9" event={"ID":"7bdc67c0-5165-4137-a066-78649d51681c","Type":"ContainerStarted","Data":"e5a8ec79d0c64dde6eb7f8ec69fe774cd1f53fce1d66576346f40c4cd016149d"}
Nov 04 02:26:06.353687 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:06.353636    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9" podStartSLOduration=2.702589859 podStartE2EDuration="5.353590325s" totalImagesPullingTime="2.651000466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:26:06.353277817 +0000 UTC m=+561.857218325" watchObservedRunningTime="2026-11-04 02:26:06.353590325 +0000 UTC m=+561.857530819"
Nov 04 02:26:07.152091 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:07.152051    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:09.001751 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.001710    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:26:09.014206 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.014179    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:26:09.260610 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.260567    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9"
Nov 04 02:26:09.380768 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.380732    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"]
Nov 04 02:26:09.384828 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.384803    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.435425 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.435389    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 04 02:26:09.435425 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.435425    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gflvh\""
Nov 04 02:26:09.444286 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.444250    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.444436 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.444319    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.444436 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.444356    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.444436 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.444380    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tzsk\" (UniqueName: \"kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-kube-api-access-2tzsk\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.444541 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.444489    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.444572 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.444533    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.444648 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.444634    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.444687 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.444659    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.444687 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.444681    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.484704 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.484665    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"]
Nov 04 02:26:09.545975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.545891    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.545975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.545952    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.545975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.545975    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.546267 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.546013    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.546267 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.546062    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.546267 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.546101    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.546267 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.546130    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.546267 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.546158    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzsk\" (UniqueName: \"kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-kube-api-access-2tzsk\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.546267 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.546204    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.546543 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.546406    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.546543 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.546470    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.546543 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.546519    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.546681 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.546564    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.546974 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.546951    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.548382 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.548358    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.548611 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.548583    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.607446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.607413    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.607640 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.607514    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tzsk\" (UniqueName: \"kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-kube-api-access-2tzsk\") pod \"maas-default-gateway-openshift-default-fd4b99879-kzkx2\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:09.698458 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:09.698418    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:10.121972 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:10.121939    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"]
Nov 04 02:26:10.127357 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:26:10.127328    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d4ff8b_2780_4d97_93c1_cc03b58ac272.slice/crio-7cc4f7acf2636924fd7c9846a4565046666f4522597c6f0718a1befdd11c2544 WatchSource:0}: Error finding container 7cc4f7acf2636924fd7c9846a4565046666f4522597c6f0718a1befdd11c2544: Status 404 returned error can't find the container with id 7cc4f7acf2636924fd7c9846a4565046666f4522597c6f0718a1befdd11c2544
Nov 04 02:26:10.257087 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:10.257042    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2" event={"ID":"a0d4ff8b-2780-4d97-93c1-cc03b58ac272","Type":"ContainerStarted","Data":"7cc4f7acf2636924fd7c9846a4565046666f4522597c6f0718a1befdd11c2544"}
Nov 04 02:26:12.152581 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:12.152525    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:12.164852 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:12.164821    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:12.278758 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:12.278727    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-snzd9"
Nov 04 02:26:12.887053 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:12.887017    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:26:14.471618 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:14.471554    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:26:14.471922 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:14.471647    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:26:14.471922 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:14.471682    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:26:15.298353 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:15.298309    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2" event={"ID":"a0d4ff8b-2780-4d97-93c1-cc03b58ac272","Type":"ContainerStarted","Data":"542c0abc88fc8a35cf108770a0fa49251333bdb6a10fa7a8705422a5642bf436"}
Nov 04 02:26:15.464241 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:15.464173    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2" podStartSLOduration=2.123068112 podStartE2EDuration="6.464151544s" totalImagesPullingTime="4.341083432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:26:15.463120896 +0000 UTC m=+570.967061391" watchObservedRunningTime="2026-11-04 02:26:15.464151544 +0000 UTC m=+570.968092039"
Nov 04 02:26:15.698853 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:15.698766    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:15.700406 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:15.700373    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-kzkx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 04 02:26:15.700543 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:15.700426    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2" podUID="a0d4ff8b-2780-4d97-93c1-cc03b58ac272" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 04 02:26:16.698863 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:16.698821    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-kzkx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 04 02:26:16.699356 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:16.698888    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2" podUID="a0d4ff8b-2780-4d97-93c1-cc03b58ac272" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 04 02:26:17.699848 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:17.699811    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-kzkx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 04 02:26:17.700242 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:17.699873    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2" podUID="a0d4ff8b-2780-4d97-93c1-cc03b58ac272" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 04 02:26:17.762993 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:26:17.762959    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:26:18.699693 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:18.699654    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-kzkx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 04 02:26:18.699871 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:18.699727    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2" podUID="a0d4ff8b-2780-4d97-93c1-cc03b58ac272" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 04 02:26:19.699852 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:19.699811    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-kzkx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 04 02:26:19.700219 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:19.699887    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2" podUID="a0d4ff8b-2780-4d97-93c1-cc03b58ac272" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 04 02:26:20.699591 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:20.699547    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-kzkx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 04 02:26:20.699787 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:20.699664    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2" podUID="a0d4ff8b-2780-4d97-93c1-cc03b58ac272" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 04 02:26:21.699868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:21.699824    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-kzkx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 04 02:26:21.700284 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:21.699883    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2" podUID="a0d4ff8b-2780-4d97-93c1-cc03b58ac272" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 04 02:26:22.856917 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:22.856875    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:22.857827 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:22.857727    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:22.858527 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:22.858507    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:26:24.522897 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.522864    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"]
Nov 04 02:26:24.526685 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.526646    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.620402 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.620360    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.620569 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.620469    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.620569 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.620537    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.620683 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.620574    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32649641-c2da-4603-b9da-356c285a805b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.620683 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.620648    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32649641-c2da-4603-b9da-356c285a805b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.620751 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.620709    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.620781 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.620750    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.620841 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.620823    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lfd6\" (UniqueName: \"kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-kube-api-access-8lfd6\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.620872 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.620857    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.721697 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.721653    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.721873 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.721717    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32649641-c2da-4603-b9da-356c285a805b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.721873 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.721737    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32649641-c2da-4603-b9da-356c285a805b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.721873 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.721759    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.721873 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.721784    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.721873 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.721827    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lfd6\" (UniqueName: \"kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-kube-api-access-8lfd6\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.721873 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.721865    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.722194 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.721993    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.722194 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.722047    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.722194 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.722103    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.722338 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.722191    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.722442 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.722407    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.722585 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.722473    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.722585 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.722518    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32649641-c2da-4603-b9da-356c285a805b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.724874 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.724409    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.724874 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.724792    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32649641-c2da-4603-b9da-356c285a805b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.727199 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.727177    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"]
Nov 04 02:26:24.781162 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.781081    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.781300 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.781266    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lfd6\" (UniqueName: \"kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-kube-api-access-8lfd6\") pod \"maas-default-gateway-openshift-default-fd4b99879-jrkdc\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:24.839589 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:24.839543    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:25.264362 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:25.264318    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"]
Nov 04 02:26:25.270506 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:26:25.270475    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32649641_c2da_4603_b9da_356c285a805b.slice/crio-ae3e1db62e51f2510baa77c8c1a431698f8ee2dd627fe0945b1684fe192b0fca WatchSource:0}: Error finding container ae3e1db62e51f2510baa77c8c1a431698f8ee2dd627fe0945b1684fe192b0fca: Status 404 returned error can't find the container with id ae3e1db62e51f2510baa77c8c1a431698f8ee2dd627fe0945b1684fe192b0fca
Nov 04 02:26:25.273524 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:25.273486    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:26:25.273664 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:25.273568    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:26:25.273664 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:25.273619    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:26:25.355380 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:25.355346    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc" event={"ID":"32649641-c2da-4603-b9da-356c285a805b","Type":"ContainerStarted","Data":"73fe0f34b8d4f1c0f89e727fb98f04cda9a7bd96e87dec0dc2fde853e61e4899"}
Nov 04 02:26:25.355503 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:25.355417    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc" event={"ID":"32649641-c2da-4603-b9da-356c285a805b","Type":"ContainerStarted","Data":"ae3e1db62e51f2510baa77c8c1a431698f8ee2dd627fe0945b1684fe192b0fca"}
Nov 04 02:26:25.474195 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:25.474138    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc" podStartSLOduration=1.474122268 podStartE2EDuration="1.474122268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:26:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:26:25.472408575 +0000 UTC m=+580.976349098" watchObservedRunningTime="2026-11-04 02:26:25.474122268 +0000 UTC m=+580.978062753"
Nov 04 02:26:25.840512 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:25.840479    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:26.841997 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:26.841955    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-jrkdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 04 02:26:26.842382 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:26.842018    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc" podUID="32649641-c2da-4603-b9da-356c285a805b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 04 02:26:27.841062 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:27.841020    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-jrkdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 04 02:26:27.841243 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:27.841096    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc" podUID="32649641-c2da-4603-b9da-356c285a805b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 04 02:26:28.840798 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:28.840759    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-jrkdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 04 02:26:28.841299 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:28.840835    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc" podUID="32649641-c2da-4603-b9da-356c285a805b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 04 02:26:29.840085 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:29.840052    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-jrkdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 04 02:26:29.840274 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:29.840108    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc" podUID="32649641-c2da-4603-b9da-356c285a805b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 04 02:26:30.840075 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:30.840038    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-jrkdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 04 02:26:30.840541 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:30.840099    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc" podUID="32649641-c2da-4603-b9da-356c285a805b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 04 02:26:31.840588 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:31.840551    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-jrkdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 04 02:26:31.840998 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:31.840639    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc" podUID="32649641-c2da-4603-b9da-356c285a805b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 04 02:26:33.639970 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:33.639931    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:33.641022 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:33.641000    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:33.641709 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:33.641687    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:26:44.695111 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:44.695080    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:26:44.695551 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:26:44.695473    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:26:47.763738 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:26:47.763699    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:27:17.762645 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:27:17.762582    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:27:28.581672 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.581575    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"]
Nov 04 02:27:28.584840 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.584818    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"
Nov 04 02:27:28.685878 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.685833    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-ab53c1-dockercfg-8qm6k\""
Nov 04 02:27:28.685878 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.685873    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-ab53c1\""
Nov 04 02:27:28.688286 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.688255    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"]
Nov 04 02:27:28.698180 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.698144    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv2wd\" (UniqueName: \"kubernetes.io/projected/e13dcd76-74dd-4201-bb8b-612f7be49c32-kube-api-access-vv2wd\") pod \"payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7\" (UID: \"e13dcd76-74dd-4201-bb8b-612f7be49c32\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"
Nov 04 02:27:28.698320 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.698291    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13dcd76-74dd-4201-bb8b-612f7be49c32-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7\" (UID: \"e13dcd76-74dd-4201-bb8b-612f7be49c32\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"
Nov 04 02:27:28.745448 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.745415    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"]
Nov 04 02:27:28.749053 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.749025    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"
Nov 04 02:27:28.798921 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.798865    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13dcd76-74dd-4201-bb8b-612f7be49c32-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7\" (UID: \"e13dcd76-74dd-4201-bb8b-612f7be49c32\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"
Nov 04 02:27:28.799123 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.798996    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv2wd\" (UniqueName: \"kubernetes.io/projected/e13dcd76-74dd-4201-bb8b-612f7be49c32-kube-api-access-vv2wd\") pod \"payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7\" (UID: \"e13dcd76-74dd-4201-bb8b-612f7be49c32\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"
Nov 04 02:27:28.799637 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.799592    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13dcd76-74dd-4201-bb8b-612f7be49c32-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7\" (UID: \"e13dcd76-74dd-4201-bb8b-612f7be49c32\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"
Nov 04 02:27:28.830814 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.830784    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"]
Nov 04 02:27:28.858375 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.858298    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv2wd\" (UniqueName: \"kubernetes.io/projected/e13dcd76-74dd-4201-bb8b-612f7be49c32-kube-api-access-vv2wd\") pod \"payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7\" (UID: \"e13dcd76-74dd-4201-bb8b-612f7be49c32\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"
Nov 04 02:27:28.896644 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.896589    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"
Nov 04 02:27:28.899748 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.899546    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76eb656d-9d15-46bc-b921-b7400173e867-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt\" (UID: \"76eb656d-9d15-46bc-b921-b7400173e867\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"
Nov 04 02:27:28.899748 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:28.899625    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvp6m\" (UniqueName: \"kubernetes.io/projected/76eb656d-9d15-46bc-b921-b7400173e867-kube-api-access-kvp6m\") pod \"payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt\" (UID: \"76eb656d-9d15-46bc-b921-b7400173e867\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"
Nov 04 02:27:29.000541 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.000504    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76eb656d-9d15-46bc-b921-b7400173e867-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt\" (UID: \"76eb656d-9d15-46bc-b921-b7400173e867\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"
Nov 04 02:27:29.000748 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.000554    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvp6m\" (UniqueName: \"kubernetes.io/projected/76eb656d-9d15-46bc-b921-b7400173e867-kube-api-access-kvp6m\") pod \"payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt\" (UID: \"76eb656d-9d15-46bc-b921-b7400173e867\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"
Nov 04 02:27:29.001389 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.001363    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76eb656d-9d15-46bc-b921-b7400173e867-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt\" (UID: \"76eb656d-9d15-46bc-b921-b7400173e867\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"
Nov 04 02:27:29.059354 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.059316    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvp6m\" (UniqueName: \"kubernetes.io/projected/76eb656d-9d15-46bc-b921-b7400173e867-kube-api-access-kvp6m\") pod \"payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt\" (UID: \"76eb656d-9d15-46bc-b921-b7400173e867\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"
Nov 04 02:27:29.062254 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.062231    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"
Nov 04 02:27:29.265137 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.265101    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"]
Nov 04 02:27:29.270791 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:27:29.270759    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13dcd76_74dd_4201_bb8b_612f7be49c32.slice/crio-9260fdbd49fa0398e6b311bafed0c0d05049a2fe36dcbfaf0ce93321d73f4502 WatchSource:0}: Error finding container 9260fdbd49fa0398e6b311bafed0c0d05049a2fe36dcbfaf0ce93321d73f4502: Status 404 returned error can't find the container with id 9260fdbd49fa0398e6b311bafed0c0d05049a2fe36dcbfaf0ce93321d73f4502
Nov 04 02:27:29.432266 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.432173    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"]
Nov 04 02:27:29.437760 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:27:29.437733    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76eb656d_9d15_46bc_b921_b7400173e867.slice/crio-42fc94c18764f31c9ac9789cb2582c5842117857f155d27b24672eb290245143 WatchSource:0}: Error finding container 42fc94c18764f31c9ac9789cb2582c5842117857f155d27b24672eb290245143: Status 404 returned error can't find the container with id 42fc94c18764f31c9ac9789cb2582c5842117857f155d27b24672eb290245143
Nov 04 02:27:29.696982 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.696880    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7" event={"ID":"e13dcd76-74dd-4201-bb8b-612f7be49c32","Type":"ContainerStarted","Data":"e0b40d57a2145b59e6be8773a6b130100ae2353b3a015356509ec3f9ccc833d4"}
Nov 04 02:27:29.696982 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.696944    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7" event={"ID":"e13dcd76-74dd-4201-bb8b-612f7be49c32","Type":"ContainerStarted","Data":"9260fdbd49fa0398e6b311bafed0c0d05049a2fe36dcbfaf0ce93321d73f4502"}
Nov 04 02:27:29.696982 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.696979    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"
Nov 04 02:27:29.698589 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.698560    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt" event={"ID":"76eb656d-9d15-46bc-b921-b7400173e867","Type":"ContainerStarted","Data":"62407a62cfc4f2c7213ea24f78ced453c24b2f4ee3e051eb123bbb5fb5ec1cb4"}
Nov 04 02:27:29.698729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.698617    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt" event={"ID":"76eb656d-9d15-46bc-b921-b7400173e867","Type":"ContainerStarted","Data":"42fc94c18764f31c9ac9789cb2582c5842117857f155d27b24672eb290245143"}
Nov 04 02:27:29.698729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.698638    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"
Nov 04 02:27:29.808975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.808927    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7" podStartSLOduration=1.808913899 podStartE2EDuration="1.808913899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:29.808497694 +0000 UTC m=+645.312438188" watchObservedRunningTime="2026-11-04 02:27:29.808913899 +0000 UTC m=+645.312854419"
Nov 04 02:27:29.920890 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:29.920841    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt" podStartSLOduration=1.9208256970000002 podStartE2EDuration="1.920825697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:29.920165524 +0000 UTC m=+645.424106016" watchObservedRunningTime="2026-11-04 02:27:29.920825697 +0000 UTC m=+645.424766225"
Nov 04 02:27:30.965901 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:30.965861    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"]
Nov 04 02:27:30.970220 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:30.970192    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.020553 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.020518    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-6c403f-serving-cert\""
Nov 04 02:27:31.070000 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.069969    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"]
Nov 04 02:27:31.122587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.122537    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.122781 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.122720    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt6gd\" (UniqueName: \"kubernetes.io/projected/9e6274d8-5084-48c5-bb87-83090caea8fb-kube-api-access-jt6gd\") pod \"maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.122781 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.122764    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-metrics-certs\") pod \"maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.122905 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.122884    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e6274d8-5084-48c5-bb87-83090caea8fb-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.224308 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.224228    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6gd\" (UniqueName: \"kubernetes.io/projected/9e6274d8-5084-48c5-bb87-83090caea8fb-kube-api-access-jt6gd\") pod \"maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.224308 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.224278    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-metrics-certs\") pod \"maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.224508 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.224317    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e6274d8-5084-48c5-bb87-83090caea8fb-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.224508 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.224405    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.224588 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:27:31.224520    5450 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-serving-cert: secret "maas-api-e2e-worker-w3-6c403f-serving-cert" not found
Nov 04 02:27:31.224650 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:27:31.224638    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-maas-api-tls podName:9e6274d8-5084-48c5-bb87-83090caea8fb nodeName:}" failed. No retries permitted until 2026-11-04 02:27:31.724577628 +0000 UTC m=+647.228518122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-maas-api-tls") pod "maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j" (UID: "9e6274d8-5084-48c5-bb87-83090caea8fb") : secret "maas-api-e2e-worker-w3-6c403f-serving-cert" not found
Nov 04 02:27:31.225139 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.225111    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e6274d8-5084-48c5-bb87-83090caea8fb-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.226924 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.226903    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-metrics-certs\") pod \"maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.289878 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.289844    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt6gd\" (UniqueName: \"kubernetes.io/projected/9e6274d8-5084-48c5-bb87-83090caea8fb-kube-api-access-jt6gd\") pod \"maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.729936 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.729900    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.732232 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.732203    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:31.885575 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:31.885492    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:32.260682 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:32.260647    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"]
Nov 04 02:27:32.266478 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:27:32.266447    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6274d8_5084_48c5_bb87_83090caea8fb.slice/crio-43d8081a16c6d20d8aa8465f5752ff3b85adedf319c5460b53eddcf1bd51be38 WatchSource:0}: Error finding container 43d8081a16c6d20d8aa8465f5752ff3b85adedf319c5460b53eddcf1bd51be38: Status 404 returned error can't find the container with id 43d8081a16c6d20d8aa8465f5752ff3b85adedf319c5460b53eddcf1bd51be38
Nov 04 02:27:32.267898 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:32.267877    5450 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:27:32.718290 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:32.718203    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j" event={"ID":"9e6274d8-5084-48c5-bb87-83090caea8fb","Type":"ContainerStarted","Data":"43d8081a16c6d20d8aa8465f5752ff3b85adedf319c5460b53eddcf1bd51be38"}
Nov 04 02:27:33.454646 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.454592    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"]
Nov 04 02:27:33.458874 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.458846    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"
Nov 04 02:27:33.512879 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.512843    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"]
Nov 04 02:27:33.518825 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.518798    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-6c403f\""
Nov 04 02:27:33.549395 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.549304    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgpns\" (UniqueName: \"kubernetes.io/projected/d107791d-401c-469f-8d48-749147f7ef24-kube-api-access-vgpns\") pod \"payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln\" (UID: \"d107791d-401c-469f-8d48-749147f7ef24\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"
Nov 04 02:27:33.549395 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.549351    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d107791d-401c-469f-8d48-749147f7ef24-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln\" (UID: \"d107791d-401c-469f-8d48-749147f7ef24\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"
Nov 04 02:27:33.558222 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.558190    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-6c403f-dockercfg-ndtsh\""
Nov 04 02:27:33.612587 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.612553    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"]
Nov 04 02:27:33.616442 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.616425    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"
Nov 04 02:27:33.650774 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.650743    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgpns\" (UniqueName: \"kubernetes.io/projected/d107791d-401c-469f-8d48-749147f7ef24-kube-api-access-vgpns\") pod \"payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln\" (UID: \"d107791d-401c-469f-8d48-749147f7ef24\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"
Nov 04 02:27:33.650923 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.650788    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d107791d-401c-469f-8d48-749147f7ef24-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln\" (UID: \"d107791d-401c-469f-8d48-749147f7ef24\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"
Nov 04 02:27:33.651534 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.651504    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d107791d-401c-469f-8d48-749147f7ef24-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln\" (UID: \"d107791d-401c-469f-8d48-749147f7ef24\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"
Nov 04 02:27:33.670771 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.670740    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"]
Nov 04 02:27:33.712086 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.712051    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgpns\" (UniqueName: \"kubernetes.io/projected/d107791d-401c-469f-8d48-749147f7ef24-kube-api-access-vgpns\") pod \"payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln\" (UID: \"d107791d-401c-469f-8d48-749147f7ef24\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"
Nov 04 02:27:33.725716 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.725681    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j" event={"ID":"9e6274d8-5084-48c5-bb87-83090caea8fb","Type":"ContainerStarted","Data":"baac811fc07f4f9df0fcaeef063992102979590944b200b60506d7015ea4117f"}
Nov 04 02:27:33.725867 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.725752    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:33.751821 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.751786    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1a697a2-dd3a-4efa-9575-c095e8081fd5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz\" (UID: \"b1a697a2-dd3a-4efa-9575-c095e8081fd5\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"
Nov 04 02:27:33.751821 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.751828    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bks6\" (UniqueName: \"kubernetes.io/projected/b1a697a2-dd3a-4efa-9575-c095e8081fd5-kube-api-access-6bks6\") pod \"payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz\" (UID: \"b1a697a2-dd3a-4efa-9575-c095e8081fd5\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"
Nov 04 02:27:33.771688 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.771657    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"
Nov 04 02:27:33.844560 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.844511    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j" podStartSLOduration=2.8180453979999998 podStartE2EDuration="3.844493653s" totalImagesPullingTime="1.026448255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:33.843227642 +0000 UTC m=+649.347168346" watchObservedRunningTime="2026-11-04 02:27:33.844493653 +0000 UTC m=+649.348434146"
Nov 04 02:27:33.852971 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.852934    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1a697a2-dd3a-4efa-9575-c095e8081fd5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz\" (UID: \"b1a697a2-dd3a-4efa-9575-c095e8081fd5\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"
Nov 04 02:27:33.853147 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.852995    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bks6\" (UniqueName: \"kubernetes.io/projected/b1a697a2-dd3a-4efa-9575-c095e8081fd5-kube-api-access-6bks6\") pod \"payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz\" (UID: \"b1a697a2-dd3a-4efa-9575-c095e8081fd5\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"
Nov 04 02:27:33.854417 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.854389    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1a697a2-dd3a-4efa-9575-c095e8081fd5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz\" (UID: \"b1a697a2-dd3a-4efa-9575-c095e8081fd5\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"
Nov 04 02:27:33.912120 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.912085    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bks6\" (UniqueName: \"kubernetes.io/projected/b1a697a2-dd3a-4efa-9575-c095e8081fd5-kube-api-access-6bks6\") pod \"payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz\" (UID: \"b1a697a2-dd3a-4efa-9575-c095e8081fd5\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"
Nov 04 02:27:33.928913 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:33.928883    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"
Nov 04 02:27:34.141795 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:34.141716    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"]
Nov 04 02:27:34.146874 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:27:34.146842    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd107791d_401c_469f_8d48_749147f7ef24.slice/crio-9fb4f306a3d1aec5fcf758ecbc925fd8a0d7dedf083d3044f38dfd38a55e9cd0 WatchSource:0}: Error finding container 9fb4f306a3d1aec5fcf758ecbc925fd8a0d7dedf083d3044f38dfd38a55e9cd0: Status 404 returned error can't find the container with id 9fb4f306a3d1aec5fcf758ecbc925fd8a0d7dedf083d3044f38dfd38a55e9cd0
Nov 04 02:27:34.303860 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:34.303828    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"]
Nov 04 02:27:34.309196 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:27:34.309169    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a697a2_dd3a_4efa_9575_c095e8081fd5.slice/crio-afa47d3d55fdf8dfe47058fb72cea001a4bf8ed00877748eecb7ecf967007380 WatchSource:0}: Error finding container afa47d3d55fdf8dfe47058fb72cea001a4bf8ed00877748eecb7ecf967007380: Status 404 returned error can't find the container with id afa47d3d55fdf8dfe47058fb72cea001a4bf8ed00877748eecb7ecf967007380
Nov 04 02:27:34.731886 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:34.731855    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz" event={"ID":"b1a697a2-dd3a-4efa-9575-c095e8081fd5","Type":"ContainerStarted","Data":"900c5dd1e9a5d592eef6da4a015fbe2f5628588469c529888cb15cb3e42c4939"}
Nov 04 02:27:34.732360 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:34.731903    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz" event={"ID":"b1a697a2-dd3a-4efa-9575-c095e8081fd5","Type":"ContainerStarted","Data":"afa47d3d55fdf8dfe47058fb72cea001a4bf8ed00877748eecb7ecf967007380"}
Nov 04 02:27:34.732360 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:34.731967    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"
Nov 04 02:27:34.733444 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:34.733420    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln" event={"ID":"d107791d-401c-469f-8d48-749147f7ef24","Type":"ContainerStarted","Data":"98190982ca94fb5cdb117b6e3086add3c828bfc433e31099f5552ae4ea2858c7"}
Nov 04 02:27:34.733547 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:34.733464    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"
Nov 04 02:27:34.733547 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:34.733479    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln" event={"ID":"d107791d-401c-469f-8d48-749147f7ef24","Type":"ContainerStarted","Data":"9fb4f306a3d1aec5fcf758ecbc925fd8a0d7dedf083d3044f38dfd38a55e9cd0"}
Nov 04 02:27:34.845631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:34.845556    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz" podStartSLOduration=1.845541952 podStartE2EDuration="1.845541952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:34.844659775 +0000 UTC m=+650.348600268" watchObservedRunningTime="2026-11-04 02:27:34.845541952 +0000 UTC m=+650.349482444"
Nov 04 02:27:34.958210 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:34.958152    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln" podStartSLOduration=1.9581349540000001 podStartE2EDuration="1.958134954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:34.956107385 +0000 UTC m=+650.460047880" watchObservedRunningTime="2026-11-04 02:27:34.958134954 +0000 UTC m=+650.462075448"
Nov 04 02:27:35.952905 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:35.952869    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"]
Nov 04 02:27:35.956881 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:35.956859    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"
Nov 04 02:27:36.056483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.056448    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-1e4f1e-dockercfg-tkmfg\""
Nov 04 02:27:36.056483 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.056446    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-1e4f1e\""
Nov 04 02:27:36.058251 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.058227    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"]
Nov 04 02:27:36.079254 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.079218    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a76723a-39f2-468f-ae6b-dc0984460548-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2\" (UID: \"2a76723a-39f2-468f-ae6b-dc0984460548\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"
Nov 04 02:27:36.079254 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.079255    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92bl5\" (UniqueName: \"kubernetes.io/projected/2a76723a-39f2-468f-ae6b-dc0984460548-kube-api-access-92bl5\") pod \"payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2\" (UID: \"2a76723a-39f2-468f-ae6b-dc0984460548\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"
Nov 04 02:27:36.106673 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.106640    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"]
Nov 04 02:27:36.110487 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.110466    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"
Nov 04 02:27:36.164050 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.164019    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"]
Nov 04 02:27:36.180505 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.180474    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9qhv\" (UniqueName: \"kubernetes.io/projected/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-kube-api-access-n9qhv\") pod \"payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp\" (UID: \"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"
Nov 04 02:27:36.180652 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.180630    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a76723a-39f2-468f-ae6b-dc0984460548-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2\" (UID: \"2a76723a-39f2-468f-ae6b-dc0984460548\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"
Nov 04 02:27:36.180700 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.180662    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92bl5\" (UniqueName: \"kubernetes.io/projected/2a76723a-39f2-468f-ae6b-dc0984460548-kube-api-access-92bl5\") pod \"payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2\" (UID: \"2a76723a-39f2-468f-ae6b-dc0984460548\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"
Nov 04 02:27:36.180770 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.180755    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp\" (UID: \"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"
Nov 04 02:27:36.181420 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.181391    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a76723a-39f2-468f-ae6b-dc0984460548-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2\" (UID: \"2a76723a-39f2-468f-ae6b-dc0984460548\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"
Nov 04 02:27:36.244240 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.244179    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92bl5\" (UniqueName: \"kubernetes.io/projected/2a76723a-39f2-468f-ae6b-dc0984460548-kube-api-access-92bl5\") pod \"payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2\" (UID: \"2a76723a-39f2-468f-ae6b-dc0984460548\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"
Nov 04 02:27:36.269398 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.269373    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"
Nov 04 02:27:36.281774 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.281746    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9qhv\" (UniqueName: \"kubernetes.io/projected/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-kube-api-access-n9qhv\") pod \"payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp\" (UID: \"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"
Nov 04 02:27:36.281906 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.281889    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp\" (UID: \"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"
Nov 04 02:27:36.282776 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.282748    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp\" (UID: \"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"
Nov 04 02:27:36.341411 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.341376    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9qhv\" (UniqueName: \"kubernetes.io/projected/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-kube-api-access-n9qhv\") pod \"payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp\" (UID: \"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"
Nov 04 02:27:36.427681 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.427642    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"
Nov 04 02:27:36.649337 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.649300    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"]
Nov 04 02:27:36.654988 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:27:36.654960    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a76723a_39f2_468f_ae6b_dc0984460548.slice/crio-5f104c38eba8f5d16fe72a2f440ea73534da6e8bf8ba3cb005275ebe68313e4a WatchSource:0}: Error finding container 5f104c38eba8f5d16fe72a2f440ea73534da6e8bf8ba3cb005275ebe68313e4a: Status 404 returned error can't find the container with id 5f104c38eba8f5d16fe72a2f440ea73534da6e8bf8ba3cb005275ebe68313e4a
Nov 04 02:27:36.745900 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.745865    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2" event={"ID":"2a76723a-39f2-468f-ae6b-dc0984460548","Type":"ContainerStarted","Data":"e8f4f9e24b044890707d6d92db6ed6655facb5fbca39837197e8e147ac8552f7"}
Nov 04 02:27:36.746022 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.745922    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2" event={"ID":"2a76723a-39f2-468f-ae6b-dc0984460548","Type":"ContainerStarted","Data":"5f104c38eba8f5d16fe72a2f440ea73534da6e8bf8ba3cb005275ebe68313e4a"}
Nov 04 02:27:36.746022 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.745944    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"
Nov 04 02:27:36.845389 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.845357    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"]
Nov 04 02:27:36.850786 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:27:36.850758    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfbdd8b_01b8_4bc5_a0ca_04983655a2b7.slice/crio-4380efbc800988972e583a366952359905f56d90b6836c85c3bb615b9f345fe5 WatchSource:0}: Error finding container 4380efbc800988972e583a366952359905f56d90b6836c85c3bb615b9f345fe5: Status 404 returned error can't find the container with id 4380efbc800988972e583a366952359905f56d90b6836c85c3bb615b9f345fe5
Nov 04 02:27:36.871521 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.871481    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2" podStartSLOduration=1.8714684419999998 podStartE2EDuration="1.871468442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:36.87011557 +0000 UTC m=+652.374056063" watchObservedRunningTime="2026-11-04 02:27:36.871468442 +0000 UTC m=+652.375408936"
Nov 04 02:27:36.937355 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.937326    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"]
Nov 04 02:27:36.941266 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:36.941247    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.002102 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.002080    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-1e4f1e-serving-cert\""
Nov 04 02:27:37.003900 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.003879    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"]
Nov 04 02:27:37.089110 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.089072    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.089284 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.089148    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-maas-api-tls\") pod \"maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.089333 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.089300    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t2xr\" (UniqueName: \"kubernetes.io/projected/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-kube-api-access-7t2xr\") pod \"maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.089446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.089424    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-metrics-certs\") pod \"maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.190445 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.190348    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-metrics-certs\") pod \"maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.190625 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.190537    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.190862 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:27:37.190831    5450 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-serving-cert: secret "maas-api-e2e-worker-w2-1e4f1e-serving-cert" not found
Nov 04 02:27:37.190995 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:27:37.190909    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-maas-api-tls podName:00af9bdc-ac9c-4d11-9589-4d5dc6609aa3 nodeName:}" failed. No retries permitted until 2026-11-04 02:27:37.690886751 +0000 UTC m=+653.194827241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-maas-api-tls") pod "maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5" (UID: "00af9bdc-ac9c-4d11-9589-4d5dc6609aa3") : secret "maas-api-e2e-worker-w2-1e4f1e-serving-cert" not found
Nov 04 02:27:37.191210 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.191188    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-maas-api-tls\") pod \"maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.191329 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.191310    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t2xr\" (UniqueName: \"kubernetes.io/projected/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-kube-api-access-7t2xr\") pod \"maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.191521 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.191502    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.193847 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.193823    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-metrics-certs\") pod \"maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.250497 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.250465    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t2xr\" (UniqueName: \"kubernetes.io/projected/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-kube-api-access-7t2xr\") pod \"maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.695647 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.695583    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-maas-api-tls\") pod \"maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.698027 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.697999    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-maas-api-tls\") pod \"maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.752812 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.752776    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp" event={"ID":"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7","Type":"ContainerStarted","Data":"142b1ef924ea0273e583ffd5f919e5caeae0471d96eb7e0ddb7fa291c8ad1f14"}
Nov 04 02:27:37.752980 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.752835    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp" event={"ID":"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7","Type":"ContainerStarted","Data":"4380efbc800988972e583a366952359905f56d90b6836c85c3bb615b9f345fe5"}
Nov 04 02:27:37.853849 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.853817    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:37.864788 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:37.864744    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp" podStartSLOduration=1.864730899 podStartE2EDuration="1.864730899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:37.864386477 +0000 UTC m=+653.368326995" watchObservedRunningTime="2026-11-04 02:27:37.864730899 +0000 UTC m=+653.368671386"
Nov 04 02:27:38.282650 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:38.282615    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"]
Nov 04 02:27:38.289124 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:27:38.289087    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00af9bdc_ac9c_4d11_9589_4d5dc6609aa3.slice/crio-6c7f0e320b657283aaacb11b472da8e202fb78611238b041a600d25590bba776 WatchSource:0}: Error finding container 6c7f0e320b657283aaacb11b472da8e202fb78611238b041a600d25590bba776: Status 404 returned error can't find the container with id 6c7f0e320b657283aaacb11b472da8e202fb78611238b041a600d25590bba776
Nov 04 02:27:38.764823 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:38.761805    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5" event={"ID":"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3","Type":"ContainerStarted","Data":"6c7f0e320b657283aaacb11b472da8e202fb78611238b041a600d25590bba776"}
Nov 04 02:27:38.764823 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:38.761898    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"
Nov 04 02:27:39.739700 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:39.739669    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:27:39.767562 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:39.767527    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5" event={"ID":"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3","Type":"ContainerStarted","Data":"f7e1c5e2d70998a4c843e1aad5469ba5bb39eb170e5a4d57f3a6c4664fe1bbe6"}
Nov 04 02:27:39.767717 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:39.767633    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:39.968787 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:39.968728    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5" podStartSLOduration=3.033745765 podStartE2EDuration="3.96871227s" totalImagesPullingTime="934.966505ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:39.967780628 +0000 UTC m=+655.471721121" watchObservedRunningTime="2026-11-04 02:27:39.96871227 +0000 UTC m=+655.472652763"
Nov 04 02:27:40.105771 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:40.105733    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:27:40.709548 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:40.709522    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"
Nov 04 02:27:40.709729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:40.709585    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"
Nov 04 02:27:42.892331 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:42.892299    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"]
Nov 04 02:27:42.896550 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:42.896527    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:42.946935 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:42.946907    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-ab53c1-serving-cert\""
Nov 04 02:27:42.996754 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:42.996722    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"]
Nov 04 02:27:43.050331 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.050297    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-maas-api-tls\") pod \"maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:43.050492 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.050373    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-metrics-certs\") pod \"maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:43.050492 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.050474    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d66fc2c-399d-44e5-84f9-28373e7aacae-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:43.050626 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.050527    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2k8w\" (UniqueName: \"kubernetes.io/projected/4d66fc2c-399d-44e5-84f9-28373e7aacae-kube-api-access-p2k8w\") pod \"maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:43.152101 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.152016    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-maas-api-tls\") pod \"maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:43.152101 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.152073    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-metrics-certs\") pod \"maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:43.152101 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.152100    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d66fc2c-399d-44e5-84f9-28373e7aacae-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:43.152306 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.152132    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2k8w\" (UniqueName: \"kubernetes.io/projected/4d66fc2c-399d-44e5-84f9-28373e7aacae-kube-api-access-p2k8w\") pod \"maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:43.152306 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:27:43.152164    5450 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-serving-cert: secret "maas-api-e2e-worker-w4-ab53c1-serving-cert" not found
Nov 04 02:27:43.152306 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:27:43.152235    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-maas-api-tls podName:4d66fc2c-399d-44e5-84f9-28373e7aacae nodeName:}" failed. No retries permitted until 2026-11-04 02:27:43.652216437 +0000 UTC m=+659.156156909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-maas-api-tls") pod "maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t" (UID: "4d66fc2c-399d-44e5-84f9-28373e7aacae") : secret "maas-api-e2e-worker-w4-ab53c1-serving-cert" not found
Nov 04 02:27:43.152867 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.152850    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d66fc2c-399d-44e5-84f9-28373e7aacae-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:43.154442 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.154423    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-metrics-certs\") pod \"maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:43.212390 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.212354    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2k8w\" (UniqueName: \"kubernetes.io/projected/4d66fc2c-399d-44e5-84f9-28373e7aacae-kube-api-access-p2k8w\") pod \"maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:43.659192 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.659158    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-maas-api-tls\") pod \"maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:43.661306 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.661283    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-maas-api-tls\") pod \"maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:43.810180 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:43.810148    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:44.183791 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:44.183756    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"]
Nov 04 02:27:44.193719 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:27:44.193682    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d66fc2c_399d_44e5_84f9_28373e7aacae.slice/crio-9f0929130ac1ef0e78791cc5adc800fc2aefb29a8ad9cad84109643ce6136827 WatchSource:0}: Error finding container 9f0929130ac1ef0e78791cc5adc800fc2aefb29a8ad9cad84109643ce6136827: Status 404 returned error can't find the container with id 9f0929130ac1ef0e78791cc5adc800fc2aefb29a8ad9cad84109643ce6136827
Nov 04 02:27:44.794298 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:44.794254    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t" event={"ID":"4d66fc2c-399d-44e5-84f9-28373e7aacae","Type":"ContainerStarted","Data":"9f0929130ac1ef0e78791cc5adc800fc2aefb29a8ad9cad84109643ce6136827"}
Nov 04 02:27:45.742278 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:45.742250    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"
Nov 04 02:27:45.742754 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:45.742313    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"
Nov 04 02:27:45.777941 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:45.777910    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:27:45.806003 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:45.805966    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t" event={"ID":"4d66fc2c-399d-44e5-84f9-28373e7aacae","Type":"ContainerStarted","Data":"1017488c9954737e2bd6b22fb262eb12f5daaf895602f980af725d8608346be3"}
Nov 04 02:27:45.806208 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:45.806039    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:46.196361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:46.196311    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t" podStartSLOduration=3.3139088340000002 podStartE2EDuration="4.196296882s" totalImagesPullingTime="882.388048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:46.194473773 +0000 UTC m=+661.698414266" watchObservedRunningTime="2026-11-04 02:27:46.196296882 +0000 UTC m=+661.700237410"
Nov 04 02:27:47.757777 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:47.757745    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"
Nov 04 02:27:47.767066 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:27:47.767033    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:27:49.484382 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:49.484344    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:27:49.770503 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:49.770472    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"
Nov 04 02:27:51.817503 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:51.817476    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:27:59.443255 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.443212    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"]
Nov 04 02:27:59.447349 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.447325    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:27:59.500103 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.500067    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-2ba6b8-serving-cert\""
Nov 04 02:27:59.511654 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.511623    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwbz5\" (UniqueName: \"kubernetes.io/projected/ebf46132-a37c-44d8-8131-66ff63df710a-kube-api-access-bwbz5\") pod \"maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:27:59.511837 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.511812    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-maas-api-tls\") pod \"maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:27:59.511905 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.511857    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebf46132-a37c-44d8-8131-66ff63df710a-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:27:59.511955 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.511940    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-metrics-certs\") pod \"maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:27:59.550130 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.550092    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"]
Nov 04 02:27:59.612752 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.612716    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwbz5\" (UniqueName: \"kubernetes.io/projected/ebf46132-a37c-44d8-8131-66ff63df710a-kube-api-access-bwbz5\") pod \"maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:27:59.613043 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.612890    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-maas-api-tls\") pod \"maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:27:59.613043 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.612923    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebf46132-a37c-44d8-8131-66ff63df710a-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:27:59.613043 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.612975    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-metrics-certs\") pod \"maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:27:59.613854 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.613817    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebf46132-a37c-44d8-8131-66ff63df710a-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:27:59.613998 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:27:59.613936    5450 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-serving-cert: secret "maas-api-e2e-worker-w0-2ba6b8-serving-cert" not found
Nov 04 02:27:59.614045 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:27:59.614016    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-maas-api-tls podName:ebf46132-a37c-44d8-8131-66ff63df710a nodeName:}" failed. No retries permitted until 2026-11-04 02:28:00.113996758 +0000 UTC m=+675.617937248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-maas-api-tls") pod "maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r" (UID: "ebf46132-a37c-44d8-8131-66ff63df710a") : secret "maas-api-e2e-worker-w0-2ba6b8-serving-cert" not found
Nov 04 02:27:59.615997 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.615969    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-metrics-certs\") pod \"maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:27:59.672330 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:27:59.672290    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwbz5\" (UniqueName: \"kubernetes.io/projected/ebf46132-a37c-44d8-8131-66ff63df710a-kube-api-access-bwbz5\") pod \"maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:28:00.118421 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:28:00.118384    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-maas-api-tls\") pod \"maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:28:00.120819 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:28:00.120798    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-maas-api-tls\") pod \"maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:28:00.366306 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:28:00.366267    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:28:00.412098 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:28:00.412064    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:28:00.742507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:28:00.742424    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"]
Nov 04 02:28:00.748322 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:28:00.748297    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf46132_a37c_44d8_8131_66ff63df710a.slice/crio-7632bee11174b342af18f0135dd9e6e16a551d13be7c9f32cff65686488da49f WatchSource:0}: Error finding container 7632bee11174b342af18f0135dd9e6e16a551d13be7c9f32cff65686488da49f: Status 404 returned error can't find the container with id 7632bee11174b342af18f0135dd9e6e16a551d13be7c9f32cff65686488da49f
Nov 04 02:28:00.884572 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:28:00.884535    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r" event={"ID":"ebf46132-a37c-44d8-8131-66ff63df710a","Type":"ContainerStarted","Data":"7632bee11174b342af18f0135dd9e6e16a551d13be7c9f32cff65686488da49f"}
Nov 04 02:28:01.891802 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:28:01.891763    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r" event={"ID":"ebf46132-a37c-44d8-8131-66ff63df710a","Type":"ContainerStarted","Data":"20d76d74c9fac9854f41d8fa0a97697dbedc604a6ac8098ee8b480880794e947"}
Nov 04 02:28:01.892255 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:28:01.891827    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:28:02.005561 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:28:02.005505    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r" podStartSLOduration=2.069096236 podStartE2EDuration="3.00548985s" totalImagesPullingTime="936.393614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:28:02.004535045 +0000 UTC m=+677.508475541" watchObservedRunningTime="2026-11-04 02:28:02.00548985 +0000 UTC m=+677.509430344"
Nov 04 02:28:07.902656 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:28:07.902627    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:28:17.763982 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:28:17.763946    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:28:19.015396 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:28:19.015368    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:28:32.479320 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:28:32.479283    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:28:47.763928 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:28:47.763891    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:28:49.698172 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:28:49.698138    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:29:08.811705 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:29:08.811630    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:29:17.763772 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:29:17.763736    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:29:25.334300 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:29:25.334265    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:29:47.765130 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:29:47.765090    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:29:49.493421 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:29:49.493384    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:30:15.141480 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:30:15.141445    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:30:17.762729 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:30:17.762689    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:30:39.868737 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:30:39.868700    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:30:47.768679 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:30:47.768643    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:31:03.704958 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:03.704926    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:31:17.764449 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:31:17.764410    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:31:34.604379 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:34.604343    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:31:37.881320 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:37.881289    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7507-ced468"]
Nov 04 02:31:37.885362 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:37.885343    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-ced468"
Nov 04 02:31:37.935831 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:37.935802    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfnks\" (UniqueName: \"kubernetes.io/projected/232de102-60be-4d0b-b27d-7556f39f82d3-kube-api-access-wfnks\") pod \"test-curl-7507-ced468\" (UID: \"232de102-60be-4d0b-b27d-7556f39f82d3\") " pod="opendatahub/test-curl-7507-ced468"
Nov 04 02:31:37.938163 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:37.938140    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-ced468"]
Nov 04 02:31:37.983103 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:37.983080    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-628tn\""
Nov 04 02:31:38.036944 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:38.036921    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfnks\" (UniqueName: \"kubernetes.io/projected/232de102-60be-4d0b-b27d-7556f39f82d3-kube-api-access-wfnks\") pod \"test-curl-7507-ced468\" (UID: \"232de102-60be-4d0b-b27d-7556f39f82d3\") " pod="opendatahub/test-curl-7507-ced468"
Nov 04 02:31:38.096044 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:38.096020    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfnks\" (UniqueName: \"kubernetes.io/projected/232de102-60be-4d0b-b27d-7556f39f82d3-kube-api-access-wfnks\") pod \"test-curl-7507-ced468\" (UID: \"232de102-60be-4d0b-b27d-7556f39f82d3\") " pod="opendatahub/test-curl-7507-ced468"
Nov 04 02:31:38.196643 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:38.196550    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-ced468"
Nov 04 02:31:38.566464 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:38.566434    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-ced468"]
Nov 04 02:31:38.572079 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:31:38.572040    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod232de102_60be_4d0b_b27d_7556f39f82d3.slice/crio-2cce449ca25a72f12bf02abd49bae25e18a6a90f7cb7a37de71cb00906388a9a WatchSource:0}: Error finding container 2cce449ca25a72f12bf02abd49bae25e18a6a90f7cb7a37de71cb00906388a9a: Status 404 returned error can't find the container with id 2cce449ca25a72f12bf02abd49bae25e18a6a90f7cb7a37de71cb00906388a9a
Nov 04 02:31:39.037119 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:39.037084    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-ced468" event={"ID":"232de102-60be-4d0b-b27d-7556f39f82d3","Type":"ContainerStarted","Data":"2cce449ca25a72f12bf02abd49bae25e18a6a90f7cb7a37de71cb00906388a9a"}
Nov 04 02:31:42.053889 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:42.053845    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-ced468" event={"ID":"232de102-60be-4d0b-b27d-7556f39f82d3","Type":"ContainerStarted","Data":"a4e53fddd4aabbf4394dd2988f898820c40f6b21f7b6bb4596df612ac5c22f0d"}
Nov 04 02:31:42.163521 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:42.163475    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7507-ced468" podStartSLOduration=2.722227174 podStartE2EDuration="5.163463839s" totalImagesPullingTime="2.441236665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:31:42.163005728 +0000 UTC m=+897.666946222" watchObservedRunningTime="2026-11-04 02:31:42.163463839 +0000 UTC m=+897.667404356"
Nov 04 02:31:43.601290 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:43.601256    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7507-ced468"]
Nov 04 02:31:43.605925 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:43.605897    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7507-ced468"]
Nov 04 02:31:43.785522 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:43.785491    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7507-40f94d"]
Nov 04 02:31:43.786024 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:43.786011    5450 cpu_manager.go:414] "containerMap: removing container" podUID="232de102-60be-4d0b-b27d-7556f39f82d3" containerName="test-curl-7507-ced468"
Nov 04 02:31:43.786069 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:43.786026    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="232de102-60be-4d0b-b27d-7556f39f82d3" containerName="test-curl-7507-ced468"
Nov 04 02:31:43.786119 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:43.786111    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="232de102-60be-4d0b-b27d-7556f39f82d3" containerName="test-curl-7507-ced468"
Nov 04 02:31:43.789580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:43.789560    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-40f94d"
Nov 04 02:31:43.839268 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:43.839245    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-40f94d"]
Nov 04 02:31:43.896504 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:43.896437    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcjxf\" (UniqueName: \"kubernetes.io/projected/32b82e51-e1e0-44fd-950c-56b9ec5be08b-kube-api-access-kcjxf\") pod \"test-curl-7507-40f94d\" (UID: \"32b82e51-e1e0-44fd-950c-56b9ec5be08b\") " pod="opendatahub/test-curl-7507-40f94d"
Nov 04 02:31:43.997554 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:43.997527    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcjxf\" (UniqueName: \"kubernetes.io/projected/32b82e51-e1e0-44fd-950c-56b9ec5be08b-kube-api-access-kcjxf\") pod \"test-curl-7507-40f94d\" (UID: \"32b82e51-e1e0-44fd-950c-56b9ec5be08b\") " pod="opendatahub/test-curl-7507-40f94d"
Nov 04 02:31:44.056850 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:44.056820    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcjxf\" (UniqueName: \"kubernetes.io/projected/32b82e51-e1e0-44fd-950c-56b9ec5be08b-kube-api-access-kcjxf\") pod \"test-curl-7507-40f94d\" (UID: \"32b82e51-e1e0-44fd-950c-56b9ec5be08b\") " pod="opendatahub/test-curl-7507-40f94d"
Nov 04 02:31:44.063408 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:44.063376    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7507-ced468" podUID="232de102-60be-4d0b-b27d-7556f39f82d3" containerName="test-curl-7507-ced468" containerID="cri-o://a4e53fddd4aabbf4394dd2988f898820c40f6b21f7b6bb4596df612ac5c22f0d" gracePeriod=2
Nov 04 02:31:44.101554 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:44.101530    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-40f94d"
Nov 04 02:31:44.112655 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:31:44.112631    5450 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7507-ced468\" is forbidden: User \"system:node:ip-10-0-131-226.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-226.us-west-2.compute.internal' and this object" podUID="232de102-60be-4d0b-b27d-7556f39f82d3" pod="opendatahub/test-curl-7507-ced468"
Nov 04 02:31:44.472095 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:44.472023    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7507-40f94d"]
Nov 04 02:31:44.477769 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:31:44.477743    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32b82e51_e1e0_44fd_950c_56b9ec5be08b.slice/crio-5dcbd8ec45efe6d99898bcaf9454a6236fd94ca11633a09988be5ec9cec3ff1d WatchSource:0}: Error finding container 5dcbd8ec45efe6d99898bcaf9454a6236fd94ca11633a09988be5ec9cec3ff1d: Status 404 returned error can't find the container with id 5dcbd8ec45efe6d99898bcaf9454a6236fd94ca11633a09988be5ec9cec3ff1d
Nov 04 02:31:44.678011 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:31:44.677975    5450 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7507-ced468\" is forbidden: User \"system:node:ip-10-0-131-226.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-226.us-west-2.compute.internal' and this object" podUID="232de102-60be-4d0b-b27d-7556f39f82d3" pod="opendatahub/test-curl-7507-ced468"
Nov 04 02:31:44.733427 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:44.733361    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:31:44.733427 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:44.733367    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:31:45.069345 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:45.069310    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-40f94d" event={"ID":"32b82e51-e1e0-44fd-950c-56b9ec5be08b","Type":"ContainerStarted","Data":"51b640b48117812d4ad80c9a66a8c0028d132e9a0e32e829ab0802600b4a4401"}
Nov 04 02:31:45.069548 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:45.069362    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7507-40f94d" event={"ID":"32b82e51-e1e0-44fd-950c-56b9ec5be08b","Type":"ContainerStarted","Data":"5dcbd8ec45efe6d99898bcaf9454a6236fd94ca11633a09988be5ec9cec3ff1d"}
Nov 04 02:31:45.180460 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:45.180412    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7507-40f94d" podStartSLOduration=2.180399561 podStartE2EDuration="2.180399561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:31:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:31:45.178849078 +0000 UTC m=+900.682789571" watchObservedRunningTime="2026-11-04 02:31:45.180399561 +0000 UTC m=+900.684340054"
Nov 04 02:31:46.293344 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:46.293321    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-ced468"
Nov 04 02:31:46.422475 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:46.422394    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/232de102-60be-4d0b-b27d-7556f39f82d3-kube-api-access-wfnks\" (UniqueName: \"kubernetes.io/projected/232de102-60be-4d0b-b27d-7556f39f82d3-kube-api-access-wfnks\") pod \"232de102-60be-4d0b-b27d-7556f39f82d3\" (UID: \"232de102-60be-4d0b-b27d-7556f39f82d3\") "
Nov 04 02:31:46.424290 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:46.424265    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/232de102-60be-4d0b-b27d-7556f39f82d3-kube-api-access-wfnks" pod "232de102-60be-4d0b-b27d-7556f39f82d3" (UID: "232de102-60be-4d0b-b27d-7556f39f82d3"). InnerVolumeSpecName "kube-api-access-wfnks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:31:46.523258 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:46.523231    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfnks\" (UniqueName: \"kubernetes.io/projected/232de102-60be-4d0b-b27d-7556f39f82d3-kube-api-access-wfnks\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:46.632809 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:46.632783    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="232de102-60be-4d0b-b27d-7556f39f82d3" path="/var/lib/kubelet/pods/232de102-60be-4d0b-b27d-7556f39f82d3/volumes"
Nov 04 02:31:46.755063 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:46.755040    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7507-40f94d"]
Nov 04 02:31:46.759705 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:46.759677    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7507-40f94d"]
Nov 04 02:31:47.080478 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:47.080396    5450 generic.go:356] "Generic (PLEG): container finished" podID="232de102-60be-4d0b-b27d-7556f39f82d3" containerID="a4e53fddd4aabbf4394dd2988f898820c40f6b21f7b6bb4596df612ac5c22f0d" exitCode=137
Nov 04 02:31:47.080478 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:47.080433    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-ced468"
Nov 04 02:31:47.080678 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:47.080492    5450 scope.go:122] "RemoveContainer" containerID="a4e53fddd4aabbf4394dd2988f898820c40f6b21f7b6bb4596df612ac5c22f0d"
Nov 04 02:31:47.080726 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:47.080685    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7507-40f94d" podUID="32b82e51-e1e0-44fd-950c-56b9ec5be08b" containerName="test-curl-7507-40f94d" containerID="cri-o://51b640b48117812d4ad80c9a66a8c0028d132e9a0e32e829ab0802600b4a4401" gracePeriod=2
Nov 04 02:31:47.088898 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:47.088881    5450 scope.go:122] "RemoveContainer" containerID="a4e53fddd4aabbf4394dd2988f898820c40f6b21f7b6bb4596df612ac5c22f0d"
Nov 04 02:31:47.089168 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:31:47.089150    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4e53fddd4aabbf4394dd2988f898820c40f6b21f7b6bb4596df612ac5c22f0d\": container with ID starting with a4e53fddd4aabbf4394dd2988f898820c40f6b21f7b6bb4596df612ac5c22f0d not found: ID does not exist" containerID="a4e53fddd4aabbf4394dd2988f898820c40f6b21f7b6bb4596df612ac5c22f0d"
Nov 04 02:31:47.089214 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:47.089175    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e53fddd4aabbf4394dd2988f898820c40f6b21f7b6bb4596df612ac5c22f0d"} err="failed to get container status \"a4e53fddd4aabbf4394dd2988f898820c40f6b21f7b6bb4596df612ac5c22f0d\": rpc error: code = NotFound desc = could not find container \"a4e53fddd4aabbf4394dd2988f898820c40f6b21f7b6bb4596df612ac5c22f0d\": container with ID starting with a4e53fddd4aabbf4394dd2988f898820c40f6b21f7b6bb4596df612ac5c22f0d not found: ID does not exist"
Nov 04 02:31:47.130419 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:31:47.130391    5450 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7507-40f94d\" is forbidden: User \"system:node:ip-10-0-131-226.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-226.us-west-2.compute.internal' and this object" podUID="32b82e51-e1e0-44fd-950c-56b9ec5be08b" pod="opendatahub/test-curl-7507-40f94d"
Nov 04 02:31:47.184615 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:31:47.183832    5450 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7507-40f94d\" is forbidden: User \"system:node:ip-10-0-131-226.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-226.us-west-2.compute.internal' and this object" podUID="32b82e51-e1e0-44fd-950c-56b9ec5be08b" pod="opendatahub/test-curl-7507-40f94d"
Nov 04 02:31:47.764167 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:31:47.764131    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:31:49.337893 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:49.337833    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-40f94d"
Nov 04 02:31:49.456439 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:49.456410    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/32b82e51-e1e0-44fd-950c-56b9ec5be08b-kube-api-access-kcjxf\" (UniqueName: \"kubernetes.io/projected/32b82e51-e1e0-44fd-950c-56b9ec5be08b-kube-api-access-kcjxf\") pod \"32b82e51-e1e0-44fd-950c-56b9ec5be08b\" (UID: \"32b82e51-e1e0-44fd-950c-56b9ec5be08b\") "
Nov 04 02:31:49.458461 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:49.458435    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32b82e51-e1e0-44fd-950c-56b9ec5be08b-kube-api-access-kcjxf" pod "32b82e51-e1e0-44fd-950c-56b9ec5be08b" (UID: "32b82e51-e1e0-44fd-950c-56b9ec5be08b"). InnerVolumeSpecName "kube-api-access-kcjxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:31:49.557526 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:49.557494    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcjxf\" (UniqueName: \"kubernetes.io/projected/32b82e51-e1e0-44fd-950c-56b9ec5be08b-kube-api-access-kcjxf\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:50.099322 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.099284    5450 generic.go:356] "Generic (PLEG): container finished" podID="32b82e51-e1e0-44fd-950c-56b9ec5be08b" containerID="51b640b48117812d4ad80c9a66a8c0028d132e9a0e32e829ab0802600b4a4401" exitCode=137
Nov 04 02:31:50.099507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.099330    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7507-40f94d"
Nov 04 02:31:50.099507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.099347    5450 scope.go:122] "RemoveContainer" containerID="51b640b48117812d4ad80c9a66a8c0028d132e9a0e32e829ab0802600b4a4401"
Nov 04 02:31:50.110758 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.110739    5450 scope.go:122] "RemoveContainer" containerID="51b640b48117812d4ad80c9a66a8c0028d132e9a0e32e829ab0802600b4a4401"
Nov 04 02:31:50.111003 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:31:50.110980    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51b640b48117812d4ad80c9a66a8c0028d132e9a0e32e829ab0802600b4a4401\": container with ID starting with 51b640b48117812d4ad80c9a66a8c0028d132e9a0e32e829ab0802600b4a4401 not found: ID does not exist" containerID="51b640b48117812d4ad80c9a66a8c0028d132e9a0e32e829ab0802600b4a4401"
Nov 04 02:31:50.111085 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.111011    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b640b48117812d4ad80c9a66a8c0028d132e9a0e32e829ab0802600b4a4401"} err="failed to get container status \"51b640b48117812d4ad80c9a66a8c0028d132e9a0e32e829ab0802600b4a4401\": rpc error: code = NotFound desc = could not find container \"51b640b48117812d4ad80c9a66a8c0028d132e9a0e32e829ab0802600b4a4401\": container with ID starting with 51b640b48117812d4ad80c9a66a8c0028d132e9a0e32e829ab0802600b4a4401 not found: ID does not exist"
Nov 04 02:31:50.159553 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:31:50.159520    5450 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7507-40f94d\" is forbidden: User \"system:node:ip-10-0-131-226.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-226.us-west-2.compute.internal' and this object" podUID="32b82e51-e1e0-44fd-950c-56b9ec5be08b" pod="opendatahub/test-curl-7507-40f94d"
Nov 04 02:31:50.390124 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.390045    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"]
Nov 04 02:31:50.390843 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.390822    5450 cpu_manager.go:414] "containerMap: removing container" podUID="32b82e51-e1e0-44fd-950c-56b9ec5be08b" containerName="test-curl-7507-40f94d"
Nov 04 02:31:50.390940 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.390843    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="32b82e51-e1e0-44fd-950c-56b9ec5be08b" containerName="test-curl-7507-40f94d"
Nov 04 02:31:50.391003 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.390974    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="32b82e51-e1e0-44fd-950c-56b9ec5be08b" containerName="test-curl-7507-40f94d"
Nov 04 02:31:50.395701 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.395678    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.446095 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.446068    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-1e4f1e-openshift-default-dockercfg-rnr9f\""
Nov 04 02:31:50.466669 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.466644    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-token\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.466786 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.466681    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-podinfo\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.466786 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.466781    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f311be95-2069-4a78-b3c1-39a111f1ddf4-istiod-ca-cert\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.466870 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.466806    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-certs\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.466870 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.466822    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgckh\" (UniqueName: \"kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-kube-api-access-xgckh\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.466870 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.466840    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-data\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.466977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.466959    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-credential-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.467027 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.467010    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-envoy\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.467083 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.467072    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.495762 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.495738    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"]
Nov 04 02:31:50.559165 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:31:50.559131    5450 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7507-40f94d\" is forbidden: User \"system:node:ip-10-0-131-226.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-226.us-west-2.compute.internal' and this object" podUID="32b82e51-e1e0-44fd-950c-56b9ec5be08b" pod="opendatahub/test-curl-7507-40f94d"
Nov 04 02:31:50.567786 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.567765    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-credential-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.567871 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.567815    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-envoy\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.567943 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.567926    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.567998 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.567982    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-token\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.568056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.568039    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-podinfo\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.568184 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.568160    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f311be95-2069-4a78-b3c1-39a111f1ddf4-istiod-ca-cert\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.568302 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.568206    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-certs\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.568302 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.568224    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-credential-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.568302 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.568236    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgckh\" (UniqueName: \"kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-kube-api-access-xgckh\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.568302 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.568275    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.568302 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.568282    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-data\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.568567 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.568494    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-certs\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.568567 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.568553    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-data\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.568917 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.568893    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f311be95-2069-4a78-b3c1-39a111f1ddf4-istiod-ca-cert\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.570133 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.570112    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-envoy\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.570387 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.570367    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-podinfo\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.627041 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.627012    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-token\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.627124 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.627115    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgckh\" (UniqueName: \"kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-kube-api-access-xgckh\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:50.632751 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.632730    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="32b82e51-e1e0-44fd-950c-56b9ec5be08b" path="/var/lib/kubelet/pods/32b82e51-e1e0-44fd-950c-56b9ec5be08b/volumes"
Nov 04 02:31:50.709171 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:50.709116    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:51.131567 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:51.131534    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"]
Nov 04 02:31:51.137095 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:31:51.137062    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf311be95_2069_4a78_b3c1_39a111f1ddf4.slice/crio-207efc94e5036b20ef83a3b1b860a57163b64f612af6994cb31931fa2fb53215 WatchSource:0}: Error finding container 207efc94e5036b20ef83a3b1b860a57163b64f612af6994cb31931fa2fb53215: Status 404 returned error can't find the container with id 207efc94e5036b20ef83a3b1b860a57163b64f612af6994cb31931fa2fb53215
Nov 04 02:31:51.139258 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:51.139225    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:31:51.139364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:51.139288    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:31:51.139364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:51.139317    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:31:52.113000 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:52.112965    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz" event={"ID":"f311be95-2069-4a78-b3c1-39a111f1ddf4","Type":"ContainerStarted","Data":"a91b654ece7aeffea36c19893e4933db4f05b4a1db93392107cd2b6e7acd2ec1"}
Nov 04 02:31:52.113393 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:52.113016    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz" event={"ID":"f311be95-2069-4a78-b3c1-39a111f1ddf4","Type":"ContainerStarted","Data":"207efc94e5036b20ef83a3b1b860a57163b64f612af6994cb31931fa2fb53215"}
Nov 04 02:31:52.280354 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:52.280241    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz" podStartSLOduration=2.280221642 podStartE2EDuration="2.280221642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:31:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:31:52.279095588 +0000 UTC m=+907.783036084" watchObservedRunningTime="2026-11-04 02:31:52.280221642 +0000 UTC m=+907.784162136"
Nov 04 02:31:52.709623 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:52.709578    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:52.711455 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:52.711429    5450 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 04 02:31:52.711581 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:52.711474    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz" podUID="f311be95-2069-4a78-b3c1-39a111f1ddf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 04 02:31:53.709641 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:53.709590    5450 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 04 02:31:53.710043 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:53.709681    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz" podUID="f311be95-2069-4a78-b3c1-39a111f1ddf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 04 02:31:54.709946 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:54.709905    5450 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 04 02:31:54.710411 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:54.709970    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz" podUID="f311be95-2069-4a78-b3c1-39a111f1ddf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 04 02:31:55.710463 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:55.710425    5450 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 04 02:31:55.710872 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:55.710494    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz" podUID="f311be95-2069-4a78-b3c1-39a111f1ddf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 04 02:31:56.709727 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:56.709696    5450 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Nov 04 02:31:56.709897 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:56.709745    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz" podUID="f311be95-2069-4a78-b3c1-39a111f1ddf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Nov 04 02:31:57.907229 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:57.907191    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"]
Nov 04 02:31:57.912019 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:57.911993    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"
Nov 04 02:31:57.965044 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:57.964673    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"]
Nov 04 02:31:57.965044 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:57.964932    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-a-493b10\""
Nov 04 02:31:57.965295 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:57.965152    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-a-493b10-dockercfg-z5svn\""
Nov 04 02:31:58.015512 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.015480    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:58.015856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.015823    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:58.017389 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.017369    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:31:58.051422 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.051387    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx\" (UID: \"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"
Nov 04 02:31:58.051560 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.051429    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxvzp\" (UniqueName: \"kubernetes.io/projected/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-kube-api-access-dxvzp\") pod \"payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx\" (UID: \"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"
Nov 04 02:31:58.053000 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.052981    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"]
Nov 04 02:31:58.056893 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.056876    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"
Nov 04 02:31:58.111901 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.111838    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"]
Nov 04 02:31:58.152812 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.152778    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0503b120-75d9-4173-a709-c4fd3af91b26-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw\" (UID: \"0503b120-75d9-4173-a709-c4fd3af91b26\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"
Nov 04 02:31:58.152965 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.152848    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx\" (UID: \"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"
Nov 04 02:31:58.152965 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.152930    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxvzp\" (UniqueName: \"kubernetes.io/projected/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-kube-api-access-dxvzp\") pod \"payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx\" (UID: \"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"
Nov 04 02:31:58.153090 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.152977    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w25c\" (UniqueName: \"kubernetes.io/projected/0503b120-75d9-4173-a709-c4fd3af91b26-kube-api-access-8w25c\") pod \"payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw\" (UID: \"0503b120-75d9-4173-a709-c4fd3af91b26\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"
Nov 04 02:31:58.153708 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.153683    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx\" (UID: \"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"
Nov 04 02:31:58.211995 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.211931    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxvzp\" (UniqueName: \"kubernetes.io/projected/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-kube-api-access-dxvzp\") pod \"payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx\" (UID: \"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"
Nov 04 02:31:58.226816 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.226788    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"
Nov 04 02:31:58.254838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.254807    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0503b120-75d9-4173-a709-c4fd3af91b26-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw\" (UID: \"0503b120-75d9-4173-a709-c4fd3af91b26\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"
Nov 04 02:31:58.254973 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.254896    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w25c\" (UniqueName: \"kubernetes.io/projected/0503b120-75d9-4173-a709-c4fd3af91b26-kube-api-access-8w25c\") pod \"payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw\" (UID: \"0503b120-75d9-4173-a709-c4fd3af91b26\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"
Nov 04 02:31:58.255583 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.255559    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0503b120-75d9-4173-a709-c4fd3af91b26-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw\" (UID: \"0503b120-75d9-4173-a709-c4fd3af91b26\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"
Nov 04 02:31:58.318467 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.318250    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w25c\" (UniqueName: \"kubernetes.io/projected/0503b120-75d9-4173-a709-c4fd3af91b26-kube-api-access-8w25c\") pod \"payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw\" (UID: \"0503b120-75d9-4173-a709-c4fd3af91b26\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"
Nov 04 02:31:58.369809 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.369779    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"
Nov 04 02:31:58.598366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.598333    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"]
Nov 04 02:31:58.603869 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:31:58.603843    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ee4ffc_9bdb_496a_bb11_9b0dc1791c04.slice/crio-92904a9757f201273f1c62e2716ba919448daa073f2afa8fa5d2a8bdad2bf89f WatchSource:0}: Error finding container 92904a9757f201273f1c62e2716ba919448daa073f2afa8fa5d2a8bdad2bf89f: Status 404 returned error can't find the container with id 92904a9757f201273f1c62e2716ba919448daa073f2afa8fa5d2a8bdad2bf89f
Nov 04 02:31:58.744143 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:58.744113    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"]
Nov 04 02:31:58.749695 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:31:58.749663    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0503b120_75d9_4173_a709_c4fd3af91b26.slice/crio-4c71da42bd988d100f326397709ed445b6fc02d857c76fe9963f447e653b9258 WatchSource:0}: Error finding container 4c71da42bd988d100f326397709ed445b6fc02d857c76fe9963f447e653b9258: Status 404 returned error can't find the container with id 4c71da42bd988d100f326397709ed445b6fc02d857c76fe9963f447e653b9258
Nov 04 02:31:59.153588 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:59.153556    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw" event={"ID":"0503b120-75d9-4173-a709-c4fd3af91b26","Type":"ContainerStarted","Data":"6836a58225538334c00c20f2175ba7a1990b298638ae8dd707aa58e7df7eb6d0"}
Nov 04 02:31:59.154055 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:59.153633    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw" event={"ID":"0503b120-75d9-4173-a709-c4fd3af91b26","Type":"ContainerStarted","Data":"4c71da42bd988d100f326397709ed445b6fc02d857c76fe9963f447e653b9258"}
Nov 04 02:31:59.154055 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:59.153677    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"
Nov 04 02:31:59.155174 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:59.155150    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx" event={"ID":"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04","Type":"ContainerStarted","Data":"a4c818af98223ef531935e4fc403e11f3bfaf594deb2c7eb8342ee54e1c118dd"}
Nov 04 02:31:59.155293 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:59.155189    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx" event={"ID":"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04","Type":"ContainerStarted","Data":"92904a9757f201273f1c62e2716ba919448daa073f2afa8fa5d2a8bdad2bf89f"}
Nov 04 02:31:59.155293 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:59.155244    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"
Nov 04 02:31:59.266335 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:59.266287    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw" podStartSLOduration=1.2662749469999999 podStartE2EDuration="1.266274947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:31:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:31:59.264787373 +0000 UTC m=+914.768727868" watchObservedRunningTime="2026-11-04 02:31:59.266274947 +0000 UTC m=+914.770215485"
Nov 04 02:31:59.380345 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:31:59.380298    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx" podStartSLOduration=2.380285731 podStartE2EDuration="2.380285731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:31:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:31:59.379589339 +0000 UTC m=+914.883529833" watchObservedRunningTime="2026-11-04 02:31:59.380285731 +0000 UTC m=+914.884226224"
Nov 04 02:32:10.164410 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:10.164379    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"
Nov 04 02:32:10.164915 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:10.164453    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"
Nov 04 02:32:11.795904 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:11.795867    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:32:17.763727 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:32:17.763679    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:32:23.001100 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.001060    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"]
Nov 04 02:32:23.006546 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.006520    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"
Nov 04 02:32:23.061292 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.061259    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"]
Nov 04 02:32:23.103343 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.103307    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxl9x\" (UniqueName: \"kubernetes.io/projected/170a5ee7-56d5-4218-90db-9e3d495e9247-kube-api-access-jxl9x\") pod \"payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q\" (UID: \"170a5ee7-56d5-4218-90db-9e3d495e9247\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"
Nov 04 02:32:23.103489 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.103430    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/170a5ee7-56d5-4218-90db-9e3d495e9247-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q\" (UID: \"170a5ee7-56d5-4218-90db-9e3d495e9247\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"
Nov 04 02:32:23.106659 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.106642    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-a-31626a\""
Nov 04 02:32:23.106755 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.106742    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-a-31626a-dockercfg-rjd2x\""
Nov 04 02:32:23.204926 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.204868    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxl9x\" (UniqueName: \"kubernetes.io/projected/170a5ee7-56d5-4218-90db-9e3d495e9247-kube-api-access-jxl9x\") pod \"payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q\" (UID: \"170a5ee7-56d5-4218-90db-9e3d495e9247\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"
Nov 04 02:32:23.205190 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.205032    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/170a5ee7-56d5-4218-90db-9e3d495e9247-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q\" (UID: \"170a5ee7-56d5-4218-90db-9e3d495e9247\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"
Nov 04 02:32:23.206046 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.206021    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/170a5ee7-56d5-4218-90db-9e3d495e9247-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q\" (UID: \"170a5ee7-56d5-4218-90db-9e3d495e9247\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"
Nov 04 02:32:23.215175 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.215149    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"]
Nov 04 02:32:23.219213 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.219198    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"
Nov 04 02:32:23.264278 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.264244    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxl9x\" (UniqueName: \"kubernetes.io/projected/170a5ee7-56d5-4218-90db-9e3d495e9247-kube-api-access-jxl9x\") pod \"payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q\" (UID: \"170a5ee7-56d5-4218-90db-9e3d495e9247\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"
Nov 04 02:32:23.273997 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.273975    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"]
Nov 04 02:32:23.305799 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.305768    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17692d26-e7ea-4ce5-b182-10e51eeeaebc-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz\" (UID: \"17692d26-e7ea-4ce5-b182-10e51eeeaebc\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"
Nov 04 02:32:23.305958 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.305940    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tddg\" (UniqueName: \"kubernetes.io/projected/17692d26-e7ea-4ce5-b182-10e51eeeaebc-kube-api-access-7tddg\") pod \"payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz\" (UID: \"17692d26-e7ea-4ce5-b182-10e51eeeaebc\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"
Nov 04 02:32:23.320473 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.320438    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"
Nov 04 02:32:23.408430 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.407467    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tddg\" (UniqueName: \"kubernetes.io/projected/17692d26-e7ea-4ce5-b182-10e51eeeaebc-kube-api-access-7tddg\") pod \"payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz\" (UID: \"17692d26-e7ea-4ce5-b182-10e51eeeaebc\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"
Nov 04 02:32:23.408430 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.407569    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17692d26-e7ea-4ce5-b182-10e51eeeaebc-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz\" (UID: \"17692d26-e7ea-4ce5-b182-10e51eeeaebc\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"
Nov 04 02:32:23.408430 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.408380    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17692d26-e7ea-4ce5-b182-10e51eeeaebc-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz\" (UID: \"17692d26-e7ea-4ce5-b182-10e51eeeaebc\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"
Nov 04 02:32:23.466654 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.466624    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tddg\" (UniqueName: \"kubernetes.io/projected/17692d26-e7ea-4ce5-b182-10e51eeeaebc-kube-api-access-7tddg\") pod \"payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz\" (UID: \"17692d26-e7ea-4ce5-b182-10e51eeeaebc\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"
Nov 04 02:32:23.532544 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.532478    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"
Nov 04 02:32:23.712787 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.712754    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"]
Nov 04 02:32:23.718798 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:32:23.718767    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170a5ee7_56d5_4218_90db_9e3d495e9247.slice/crio-70f7ee5b9fab44503d77c17aa2b285ca3dea91545616d75cad1f9b0d66f71c6d WatchSource:0}: Error finding container 70f7ee5b9fab44503d77c17aa2b285ca3dea91545616d75cad1f9b0d66f71c6d: Status 404 returned error can't find the container with id 70f7ee5b9fab44503d77c17aa2b285ca3dea91545616d75cad1f9b0d66f71c6d
Nov 04 02:32:23.906090 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:23.906021    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"]
Nov 04 02:32:23.911301 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:32:23.911271    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17692d26_e7ea_4ce5_b182_10e51eeeaebc.slice/crio-c27a795b4ac12b4108413c25f674f22f2592efa501ea8ae3c0e8125178d7fcd4 WatchSource:0}: Error finding container c27a795b4ac12b4108413c25f674f22f2592efa501ea8ae3c0e8125178d7fcd4: Status 404 returned error can't find the container with id c27a795b4ac12b4108413c25f674f22f2592efa501ea8ae3c0e8125178d7fcd4
Nov 04 02:32:24.293077 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:24.293036    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz" event={"ID":"17692d26-e7ea-4ce5-b182-10e51eeeaebc","Type":"ContainerStarted","Data":"7ed6f0a448699cbb81d454ce3517d016cf45373ccec3b5f525aa7174013c34ea"}
Nov 04 02:32:24.293559 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:24.293130    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz" event={"ID":"17692d26-e7ea-4ce5-b182-10e51eeeaebc","Type":"ContainerStarted","Data":"c27a795b4ac12b4108413c25f674f22f2592efa501ea8ae3c0e8125178d7fcd4"}
Nov 04 02:32:24.293559 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:24.293237    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"
Nov 04 02:32:24.294754 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:24.294731    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q" event={"ID":"170a5ee7-56d5-4218-90db-9e3d495e9247","Type":"ContainerStarted","Data":"65829759ea4de193548b150a8944b56ba4da556f41b61358a91a25c116c3283d"}
Nov 04 02:32:24.294884 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:24.294764    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q" event={"ID":"170a5ee7-56d5-4218-90db-9e3d495e9247","Type":"ContainerStarted","Data":"70f7ee5b9fab44503d77c17aa2b285ca3dea91545616d75cad1f9b0d66f71c6d"}
Nov 04 02:32:24.294884 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:24.294812    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"
Nov 04 02:32:24.410113 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:24.410066    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz" podStartSLOduration=1.410052704 podStartE2EDuration="1.410052704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:32:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:32:24.407923119 +0000 UTC m=+939.911863613" watchObservedRunningTime="2026-11-04 02:32:24.410052704 +0000 UTC m=+939.913993230"
Nov 04 02:32:24.521300 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:24.521252    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q" podStartSLOduration=2.521238594 podStartE2EDuration="2.521238594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:32:24.519712957 +0000 UTC m=+940.023653460" watchObservedRunningTime="2026-11-04 02:32:24.521238594 +0000 UTC m=+940.025179088"
Nov 04 02:32:27.811172 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:27.811143    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"]
Nov 04 02:32:27.815034 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:27.815015    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:27.867889 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:27.867859    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-a-493b10-serving-cert\""
Nov 04 02:32:27.917859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:27.917827    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"]
Nov 04 02:32:27.951024 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:27.951001    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-maas-api-tls\") pod \"maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:27.951175 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:27.951057    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-metrics-certs\") pod \"maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:27.951175 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:27.951170    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34ce6ae-5bb1-4f95-905a-736cae472b62-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:27.951282 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:27.951249    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b856z\" (UniqueName: \"kubernetes.io/projected/b34ce6ae-5bb1-4f95-905a-736cae472b62-kube-api-access-b856z\") pod \"maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:28.052589 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:28.052557    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-metrics-certs\") pod \"maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:28.052777 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:28.052660    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34ce6ae-5bb1-4f95-905a-736cae472b62-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:28.052777 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:28.052686    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b856z\" (UniqueName: \"kubernetes.io/projected/b34ce6ae-5bb1-4f95-905a-736cae472b62-kube-api-access-b856z\") pod \"maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:28.052777 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:28.052738    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-maas-api-tls\") pod \"maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:28.052898 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:32:28.052843    5450 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-serving-cert: secret "maas-api-e2e-extmod-a-493b10-serving-cert" not found
Nov 04 02:32:28.052931 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:32:28.052905    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-maas-api-tls podName:b34ce6ae-5bb1-4f95-905a-736cae472b62 nodeName:}" failed. No retries permitted until 2026-11-04 02:32:28.552888781 +0000 UTC m=+944.056829266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-maas-api-tls") pod "maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs" (UID: "b34ce6ae-5bb1-4f95-905a-736cae472b62") : secret "maas-api-e2e-extmod-a-493b10-serving-cert" not found
Nov 04 02:32:28.053394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:28.053368    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34ce6ae-5bb1-4f95-905a-736cae472b62-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:28.055075 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:28.055055    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-metrics-certs\") pod \"maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:28.112369 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:28.112296    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b856z\" (UniqueName: \"kubernetes.io/projected/b34ce6ae-5bb1-4f95-905a-736cae472b62-kube-api-access-b856z\") pod \"maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:28.558074 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:28.558039    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-maas-api-tls\") pod \"maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:28.560367 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:28.560340    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-maas-api-tls\") pod \"maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:28.728999 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:28.728966    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:29.100099 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:29.100044    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"]
Nov 04 02:32:29.105110 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:32:29.105084    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34ce6ae_5bb1_4f95_905a_736cae472b62.slice/crio-35f84f9626b5143a32affadabdb65b060fac304d42353744f86620d37cd8a7c4 WatchSource:0}: Error finding container 35f84f9626b5143a32affadabdb65b060fac304d42353744f86620d37cd8a7c4: Status 404 returned error can't find the container with id 35f84f9626b5143a32affadabdb65b060fac304d42353744f86620d37cd8a7c4
Nov 04 02:32:29.325001 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:29.324970    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs" event={"ID":"b34ce6ae-5bb1-4f95-905a-736cae472b62","Type":"ContainerStarted","Data":"35f84f9626b5143a32affadabdb65b060fac304d42353744f86620d37cd8a7c4"}
Nov 04 02:32:30.331980 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:30.331949    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs" event={"ID":"b34ce6ae-5bb1-4f95-905a-736cae472b62","Type":"ContainerStarted","Data":"672e747cb50cd2cdb02b0e5a4e67ace0a9f3a028997b45fe1e6014e1b06c2f34"}
Nov 04 02:32:30.332442 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:30.332080    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:30.481465 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:30.481375    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs" podStartSLOduration=2.388491524 podStartE2EDuration="3.481360731s" totalImagesPullingTime="1.092869207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:32:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:32:30.480561766 +0000 UTC m=+945.984502262" watchObservedRunningTime="2026-11-04 02:32:30.481360731 +0000 UTC m=+945.985301274"
Nov 04 02:32:35.303238 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:35.303211    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"
Nov 04 02:32:35.303659 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:35.303627    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"
Nov 04 02:32:36.343499 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:36.343463    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:32:42.138454 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:42.138415    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:32:45.095307 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.095278    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"]
Nov 04 02:32:45.100989 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.100962    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.127585 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.127558    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.127714 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.127592    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.127714 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.127665    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.127714 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.127698    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.127816 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.127724    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.127816 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.127787    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.127878 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.127832    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.127954 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.127935    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.127996 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.127985    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7dlq\" (UniqueName: \"kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-kube-api-access-t7dlq\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.151562 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.151539    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-a18c43-openshift-default-dockercfg-4h4hv\""
Nov 04 02:32:45.201581 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.201553    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"]
Nov 04 02:32:45.228561 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.228532    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7dlq\" (UniqueName: \"kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-kube-api-access-t7dlq\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.228718 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.228583    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.228718 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.228634    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.228718 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.228652    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.228718 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.228681    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.228718 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.228706    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.228986 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.228726    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.228986 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.228761    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.228986 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.228842    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.229143 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.229084    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.229200 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.229147    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.229253 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.229210    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.229253 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.229229    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.229444 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.229425    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.230892 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.230871    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.231114 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.231096    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.287366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.287333    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.287621 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.287578    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7dlq\" (UniqueName: \"kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-kube-api-access-t7dlq\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.414631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.414532    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:45.842893 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.842859    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"]
Nov 04 02:32:45.848619 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:32:45.848568    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ff1c4a_3d73_45b2_adb9_44fd034306b6.slice/crio-c6587dda17441b017a15a1b1e0448e1e9096fd513f01cab8a17c6e0550c642cc WatchSource:0}: Error finding container c6587dda17441b017a15a1b1e0448e1e9096fd513f01cab8a17c6e0550c642cc: Status 404 returned error can't find the container with id c6587dda17441b017a15a1b1e0448e1e9096fd513f01cab8a17c6e0550c642cc
Nov 04 02:32:45.850949 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.850915    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:32:45.851029 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.850981    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:32:45.851029 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:45.851008    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:32:46.422115 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:46.422083    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv" event={"ID":"a0ff1c4a-3d73-45b2-adb9-44fd034306b6","Type":"ContainerStarted","Data":"1d9b6323c0c0bd031855d57f00d15ea0a9f60fefa58d040eeaf66efc4aa53055"}
Nov 04 02:32:46.422560 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:46.422137    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv" event={"ID":"a0ff1c4a-3d73-45b2-adb9-44fd034306b6","Type":"ContainerStarted","Data":"c6587dda17441b017a15a1b1e0448e1e9096fd513f01cab8a17c6e0550c642cc"}
Nov 04 02:32:46.612541 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:46.612484    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv" podStartSLOduration=1.6124690579999998 podStartE2EDuration="1.612469058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:32:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:32:46.586018741 +0000 UTC m=+962.089959242" watchObservedRunningTime="2026-11-04 02:32:46.612469058 +0000 UTC m=+962.116409620"
Nov 04 02:32:47.415055 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:47.415018    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:47.416882 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:47.416857    5450 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 04 02:32:47.417024 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:47.416910    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv" podUID="a0ff1c4a-3d73-45b2-adb9-44fd034306b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 04 02:32:47.766636 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:32:47.763978    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:32:48.415102 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:48.415066    5450 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 04 02:32:48.415281 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:48.415118    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv" podUID="a0ff1c4a-3d73-45b2-adb9-44fd034306b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 04 02:32:49.415340 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:49.415304    5450 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 04 02:32:49.415764 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:49.415369    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv" podUID="a0ff1c4a-3d73-45b2-adb9-44fd034306b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 04 02:32:50.415888 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:50.415851    5450 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 04 02:32:50.416268 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:50.415908    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv" podUID="a0ff1c4a-3d73-45b2-adb9-44fd034306b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 04 02:32:51.415231 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:51.415195    5450 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 04 02:32:51.415396 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:51.415261    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv" podUID="a0ff1c4a-3d73-45b2-adb9-44fd034306b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 04 02:32:52.415114 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:52.415081    5450 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 04 02:32:52.415529 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:52.415140    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv" podUID="a0ff1c4a-3d73-45b2-adb9-44fd034306b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 04 02:32:53.419546 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:53.419511    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:53.419963 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:53.419807    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:53.420403 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:53.420386    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:32:57.463175 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:57.463141    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"]
Nov 04 02:32:57.463570 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:32:57.463341    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc" podUID="32649641-c2da-4603-b9da-356c285a805b" containerName="istio-proxy" containerID="cri-o://73fe0f34b8d4f1c0f89e727fb98f04cda9a7bd96e87dec0dc2fde853e61e4899" gracePeriod=30
Nov 04 02:33:00.351179 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.351144    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"]
Nov 04 02:33:00.355247 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.355227    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:00.407660 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.407629    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-a-31626a-serving-cert\""
Nov 04 02:33:00.457858 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.457826    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"]
Nov 04 02:33:00.517563 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.517532    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb98692-871b-453d-9677-4f87f884754e-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:00.517762 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.517718    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-maas-api-tls\") pod \"maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:00.517825 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.517777    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-metrics-certs\") pod \"maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:00.517913 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.517889    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8njc\" (UniqueName: \"kubernetes.io/projected/ecb98692-871b-453d-9677-4f87f884754e-kube-api-access-k8njc\") pod \"maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:00.619172 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.619078    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-maas-api-tls\") pod \"maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:00.619172 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.619158    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-metrics-certs\") pod \"maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:00.619419 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.619246    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8njc\" (UniqueName: \"kubernetes.io/projected/ecb98692-871b-453d-9677-4f87f884754e-kube-api-access-k8njc\") pod \"maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:00.619419 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:33:00.619265    5450 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-serving-cert: secret "maas-api-e2e-extmod-a-31626a-serving-cert" not found
Nov 04 02:33:00.619419 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.619323    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb98692-871b-453d-9677-4f87f884754e-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:00.619419 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:33:00.619370    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-maas-api-tls podName:ecb98692-871b-453d-9677-4f87f884754e nodeName:}" failed. No retries permitted until 2026-11-04 02:33:01.119346316 +0000 UTC m=+976.623286792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-maas-api-tls") pod "maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg" (UID: "ecb98692-871b-453d-9677-4f87f884754e") : secret "maas-api-e2e-extmod-a-31626a-serving-cert" not found
Nov 04 02:33:00.620272 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.620241    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb98692-871b-453d-9677-4f87f884754e-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:00.636460 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.636420    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-metrics-certs\") pod \"maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:00.680375 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:00.680347    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8njc\" (UniqueName: \"kubernetes.io/projected/ecb98692-871b-453d-9677-4f87f884754e-kube-api-access-k8njc\") pod \"maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:01.125071 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:01.125041    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-maas-api-tls\") pod \"maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:01.127376 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:01.127355    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-maas-api-tls\") pod \"maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:01.268342 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:01.268309    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:01.640735 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:01.640704    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"]
Nov 04 02:33:01.646140 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:33:01.646112    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb98692_871b_453d_9677_4f87f884754e.slice/crio-033630c06b475e1f2103b2a28db773cd79a11b3d9faa38830f962739597d577d WatchSource:0}: Error finding container 033630c06b475e1f2103b2a28db773cd79a11b3d9faa38830f962739597d577d: Status 404 returned error can't find the container with id 033630c06b475e1f2103b2a28db773cd79a11b3d9faa38830f962739597d577d
Nov 04 02:33:01.647710 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:01.647691    5450 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:33:02.514292 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.514263    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg" event={"ID":"ecb98692-871b-453d-9677-4f87f884754e","Type":"ContainerStarted","Data":"033630c06b475e1f2103b2a28db773cd79a11b3d9faa38830f962739597d577d"}
Nov 04 02:33:02.714530 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.714507    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:33:02.845243 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.845214    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-istio-token\" (UniqueName: \"kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-istio-token\") pod \"32649641-c2da-4603-b9da-356c285a805b\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") "
Nov 04 02:33:02.845429 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.845308    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-certs\") pod \"32649641-c2da-4603-b9da-356c285a805b\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") "
Nov 04 02:33:02.845429 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.845373    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/32649641-c2da-4603-b9da-356c285a805b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32649641-c2da-4603-b9da-356c285a805b-istio-podinfo\") pod \"32649641-c2da-4603-b9da-356c285a805b\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") "
Nov 04 02:33:02.845429 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.845401    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-envoy\") pod \"32649641-c2da-4603-b9da-356c285a805b\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") "
Nov 04 02:33:02.845608 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.845438    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-kube-api-access-8lfd6\" (UniqueName: \"kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-kube-api-access-8lfd6\") pod \"32649641-c2da-4603-b9da-356c285a805b\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") "
Nov 04 02:33:02.845608 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.845515    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-socket\") pod \"32649641-c2da-4603-b9da-356c285a805b\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") "
Nov 04 02:33:02.845608 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.845548    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-data\") pod \"32649641-c2da-4603-b9da-356c285a805b\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") "
Nov 04 02:33:02.845759 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.845659    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-certs" pod "32649641-c2da-4603-b9da-356c285a805b" (UID: "32649641-c2da-4603-b9da-356c285a805b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:33:02.845759 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.845677    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-credential-socket\") pod \"32649641-c2da-4603-b9da-356c285a805b\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") "
Nov 04 02:33:02.845759 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.845717    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/32649641-c2da-4603-b9da-356c285a805b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32649641-c2da-4603-b9da-356c285a805b-istiod-ca-cert\") pod \"32649641-c2da-4603-b9da-356c285a805b\" (UID: \"32649641-c2da-4603-b9da-356c285a805b\") "
Nov 04 02:33:02.845917 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.845895    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-data" pod "32649641-c2da-4603-b9da-356c285a805b" (UID: "32649641-c2da-4603-b9da-356c285a805b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:33:02.846103 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.846079    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-socket" pod "32649641-c2da-4603-b9da-356c285a805b" (UID: "32649641-c2da-4603-b9da-356c285a805b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:33:02.846176 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.846098    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-credential-socket" pod "32649641-c2da-4603-b9da-356c285a805b" (UID: "32649641-c2da-4603-b9da-356c285a805b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:33:02.846227 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.846208    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32649641-c2da-4603-b9da-356c285a805b-istiod-ca-cert" pod "32649641-c2da-4603-b9da-356c285a805b" (UID: "32649641-c2da-4603-b9da-356c285a805b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:33:02.846477 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.846358    5450 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:02.846477 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.846387    5450 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-workload-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:02.846477 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.846401    5450 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-data\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:02.846477 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.846452    5450 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-credential-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:02.848409 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.848365    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32649641-c2da-4603-b9da-356c285a805b-istio-podinfo" pod "32649641-c2da-4603-b9da-356c285a805b" (UID: "32649641-c2da-4603-b9da-356c285a805b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:33:02.850720 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.850698    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-envoy" pod "32649641-c2da-4603-b9da-356c285a805b" (UID: "32649641-c2da-4603-b9da-356c285a805b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:33:02.850825 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.850738    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-istio-token" pod "32649641-c2da-4603-b9da-356c285a805b" (UID: "32649641-c2da-4603-b9da-356c285a805b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:33:02.850825 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.850768    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-kube-api-access-8lfd6" pod "32649641-c2da-4603-b9da-356c285a805b" (UID: "32649641-c2da-4603-b9da-356c285a805b"). InnerVolumeSpecName "kube-api-access-8lfd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:33:02.947550 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.947510    5450 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32649641-c2da-4603-b9da-356c285a805b-istio-podinfo\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:02.947550 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.947547    5450 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32649641-c2da-4603-b9da-356c285a805b-istio-envoy\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:02.947740 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.947562    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lfd6\" (UniqueName: \"kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-kube-api-access-8lfd6\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:02.947740 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.947576    5450 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32649641-c2da-4603-b9da-356c285a805b-istiod-ca-cert\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:02.947740 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:02.947590    5450 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32649641-c2da-4603-b9da-356c285a805b-istio-token\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:03.520954 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:03.520919    5450 generic.go:356] "Generic (PLEG): container finished" podID="32649641-c2da-4603-b9da-356c285a805b" containerID="73fe0f34b8d4f1c0f89e727fb98f04cda9a7bd96e87dec0dc2fde853e61e4899" exitCode=0
Nov 04 02:33:03.521122 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:03.520964    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"
Nov 04 02:33:03.521122 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:03.520998    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc" event={"ID":"32649641-c2da-4603-b9da-356c285a805b","Type":"ContainerDied","Data":"73fe0f34b8d4f1c0f89e727fb98f04cda9a7bd96e87dec0dc2fde853e61e4899"}
Nov 04 02:33:03.521122 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:03.521049    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc" event={"ID":"32649641-c2da-4603-b9da-356c285a805b","Type":"ContainerDied","Data":"ae3e1db62e51f2510baa77c8c1a431698f8ee2dd627fe0945b1684fe192b0fca"}
Nov 04 02:33:03.521122 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:03.521080    5450 scope.go:122] "RemoveContainer" containerID="73fe0f34b8d4f1c0f89e727fb98f04cda9a7bd96e87dec0dc2fde853e61e4899"
Nov 04 02:33:03.522806 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:03.522782    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg" event={"ID":"ecb98692-871b-453d-9677-4f87f884754e","Type":"ContainerStarted","Data":"a3a1a5b2970b8acedfe3324c3c7217725c95a3bf7784a05f549b615f6fb54155"}
Nov 04 02:33:03.522925 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:03.522835    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:03.531811 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:03.531797    5450 scope.go:122] "RemoveContainer" containerID="73fe0f34b8d4f1c0f89e727fb98f04cda9a7bd96e87dec0dc2fde853e61e4899"
Nov 04 02:33:03.532072 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:33:03.532054    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73fe0f34b8d4f1c0f89e727fb98f04cda9a7bd96e87dec0dc2fde853e61e4899\": container with ID starting with 73fe0f34b8d4f1c0f89e727fb98f04cda9a7bd96e87dec0dc2fde853e61e4899 not found: ID does not exist" containerID="73fe0f34b8d4f1c0f89e727fb98f04cda9a7bd96e87dec0dc2fde853e61e4899"
Nov 04 02:33:03.532123 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:03.532079    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73fe0f34b8d4f1c0f89e727fb98f04cda9a7bd96e87dec0dc2fde853e61e4899"} err="failed to get container status \"73fe0f34b8d4f1c0f89e727fb98f04cda9a7bd96e87dec0dc2fde853e61e4899\": rpc error: code = NotFound desc = could not find container \"73fe0f34b8d4f1c0f89e727fb98f04cda9a7bd96e87dec0dc2fde853e61e4899\": container with ID starting with 73fe0f34b8d4f1c0f89e727fb98f04cda9a7bd96e87dec0dc2fde853e61e4899 not found: ID does not exist"
Nov 04 02:33:03.733079 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:03.733016    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"]
Nov 04 02:33:03.778177 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:03.778099    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-jrkdc"]
Nov 04 02:33:03.849146 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:03.849097    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg" podStartSLOduration=2.942929226 podStartE2EDuration="3.849083114s" totalImagesPullingTime="906.153888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:03.847212381 +0000 UTC m=+979.351152875" watchObservedRunningTime="2026-11-04 02:33:03.849083114 +0000 UTC m=+979.353023608"
Nov 04 02:33:04.632870 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:04.632835    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="32649641-c2da-4603-b9da-356c285a805b" path="/var/lib/kubelet/pods/32649641-c2da-4603-b9da-356c285a805b/volumes"
Nov 04 02:33:05.387348 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.387311    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"]
Nov 04 02:33:05.388109 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.388087    5450 cpu_manager.go:414] "containerMap: removing container" podUID="32649641-c2da-4603-b9da-356c285a805b" containerName="istio-proxy"
Nov 04 02:33:05.388109 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.388108    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="32649641-c2da-4603-b9da-356c285a805b" containerName="istio-proxy"
Nov 04 02:33:05.388293 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.388279    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="32649641-c2da-4603-b9da-356c285a805b" containerName="istio-proxy"
Nov 04 02:33:05.393290 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.393267    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.444200 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.444170    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-ab53c1-openshift-default-dockercfg-xpzps\""
Nov 04 02:33:05.470256 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.470217    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jxvw\" (UniqueName: \"kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-kube-api-access-5jxvw\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.470406 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.470359    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.470478 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.470402    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.470478 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.470442    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.470556 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.470529    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.470624 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.470557    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.470624 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.470592    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.470696 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.470660    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50181e68-e458-41f6-81b2-910538ce6d3a-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.470744 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.470732    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50181e68-e458-41f6-81b2-910538ce6d3a-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.494435 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.494407    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"]
Nov 04 02:33:05.571488 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.571457    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50181e68-e458-41f6-81b2-910538ce6d3a-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.571631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.571499    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jxvw\" (UniqueName: \"kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-kube-api-access-5jxvw\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.571631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.571532    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.571631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.571555    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.571631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.571578    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.571631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.571611    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.571631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.571630    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.571930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.571681    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.571930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.571734    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50181e68-e458-41f6-81b2-910538ce6d3a-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.572144 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.572121    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.572224 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.572164    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.572274 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.572249    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.572328 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.572301    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50181e68-e458-41f6-81b2-910538ce6d3a-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.572374 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.572326    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.573878 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.573855    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.574092 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.574073    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50181e68-e458-41f6-81b2-910538ce6d3a-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.630211 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.630189    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.630329 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.630227    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jxvw\" (UniqueName: \"kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-kube-api-access-5jxvw\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:05.706424 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:05.706352    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:06.132415 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:06.132384    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"]
Nov 04 02:33:06.138835 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:33:06.138803    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50181e68_e458_41f6_81b2_910538ce6d3a.slice/crio-ed3ca578e5a1600f841dc8460bb63978f0f3ef0d411cd0956cd2afa37e912178 WatchSource:0}: Error finding container ed3ca578e5a1600f841dc8460bb63978f0f3ef0d411cd0956cd2afa37e912178: Status 404 returned error can't find the container with id ed3ca578e5a1600f841dc8460bb63978f0f3ef0d411cd0956cd2afa37e912178
Nov 04 02:33:06.141255 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:06.141222    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:33:06.141333 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:06.141300    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:33:06.141333 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:06.141328    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:33:06.544002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:06.543960    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf" event={"ID":"50181e68-e458-41f6-81b2-910538ce6d3a","Type":"ContainerStarted","Data":"cf9766d0b66d012d0bb1705ed729694f08980329ac6f4b9102fbeccd315fbc6e"}
Nov 04 02:33:06.544382 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:06.544025    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf" event={"ID":"50181e68-e458-41f6-81b2-910538ce6d3a","Type":"ContainerStarted","Data":"ed3ca578e5a1600f841dc8460bb63978f0f3ef0d411cd0956cd2afa37e912178"}
Nov 04 02:33:06.660793 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:06.660741    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf" podStartSLOduration=1.660715374 podStartE2EDuration="1.660715374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:06.659363226 +0000 UTC m=+982.163303718" watchObservedRunningTime="2026-11-04 02:33:06.660715374 +0000 UTC m=+982.164655868"
Nov 04 02:33:06.706698 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:06.706663    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:07.709062 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:07.709028    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 04 02:33:07.709424 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:07.709083    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf" podUID="50181e68-e458-41f6-81b2-910538ce6d3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 04 02:33:08.707216 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:08.707180    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 04 02:33:08.707357 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:08.707242    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf" podUID="50181e68-e458-41f6-81b2-910538ce6d3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 04 02:33:09.535976 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:09.535949    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:33:09.707567 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:09.707529    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 04 02:33:09.707756 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:09.707585    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf" podUID="50181e68-e458-41f6-81b2-910538ce6d3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 04 02:33:10.707161 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:10.707125    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 04 02:33:10.707698 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:10.707209    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf" podUID="50181e68-e458-41f6-81b2-910538ce6d3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 04 02:33:11.608394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.608358    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"]
Nov 04 02:33:11.613327 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.613299    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"
Nov 04 02:33:11.636939 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.636909    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9af097c5-120a-4b81-a86b-241101d0cbce-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4\" (UID: \"9af097c5-120a-4b81-a86b-241101d0cbce\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"
Nov 04 02:33:11.637058 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.636951    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjxv5\" (UniqueName: \"kubernetes.io/projected/9af097c5-120a-4b81-a86b-241101d0cbce-kube-api-access-gjxv5\") pod \"payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4\" (UID: \"9af097c5-120a-4b81-a86b-241101d0cbce\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"
Nov 04 02:33:11.702010 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.701238    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-a-80b404\""
Nov 04 02:33:11.706633 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.706176    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"]
Nov 04 02:33:11.706824 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.706792    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 04 02:33:11.706900 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.706862    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf" podUID="50181e68-e458-41f6-81b2-910538ce6d3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 04 02:33:11.712633 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.710526    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-a-80b404-dockercfg-xrdrv\""
Nov 04 02:33:11.738215 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.738175    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9af097c5-120a-4b81-a86b-241101d0cbce-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4\" (UID: \"9af097c5-120a-4b81-a86b-241101d0cbce\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"
Nov 04 02:33:11.738374 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.738226    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjxv5\" (UniqueName: \"kubernetes.io/projected/9af097c5-120a-4b81-a86b-241101d0cbce-kube-api-access-gjxv5\") pod \"payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4\" (UID: \"9af097c5-120a-4b81-a86b-241101d0cbce\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"
Nov 04 02:33:11.739082 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.739059    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9af097c5-120a-4b81-a86b-241101d0cbce-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4\" (UID: \"9af097c5-120a-4b81-a86b-241101d0cbce\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"
Nov 04 02:33:11.759565 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.759539    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"]
Nov 04 02:33:11.784712 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.779854    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"
Nov 04 02:33:11.799254 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.799231    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjxv5\" (UniqueName: \"kubernetes.io/projected/9af097c5-120a-4b81-a86b-241101d0cbce-kube-api-access-gjxv5\") pod \"payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4\" (UID: \"9af097c5-120a-4b81-a86b-241101d0cbce\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"
Nov 04 02:33:11.818065 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.818031    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"]
Nov 04 02:33:11.863210 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.863118    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eb7183f-c331-4c13-898c-bf6085376df2-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm\" (UID: \"0eb7183f-c331-4c13-898c-bf6085376df2\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"
Nov 04 02:33:11.863521 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.863499    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfvrb\" (UniqueName: \"kubernetes.io/projected/0eb7183f-c331-4c13-898c-bf6085376df2-kube-api-access-lfvrb\") pod \"payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm\" (UID: \"0eb7183f-c331-4c13-898c-bf6085376df2\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"
Nov 04 02:33:11.927837 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.927798    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"
Nov 04 02:33:11.969121 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.969083    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eb7183f-c331-4c13-898c-bf6085376df2-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm\" (UID: \"0eb7183f-c331-4c13-898c-bf6085376df2\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"
Nov 04 02:33:11.969274 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.969236    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfvrb\" (UniqueName: \"kubernetes.io/projected/0eb7183f-c331-4c13-898c-bf6085376df2-kube-api-access-lfvrb\") pod \"payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm\" (UID: \"0eb7183f-c331-4c13-898c-bf6085376df2\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"
Nov 04 02:33:11.969828 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:11.969807    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eb7183f-c331-4c13-898c-bf6085376df2-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm\" (UID: \"0eb7183f-c331-4c13-898c-bf6085376df2\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"
Nov 04 02:33:12.030836 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:12.030807    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfvrb\" (UniqueName: \"kubernetes.io/projected/0eb7183f-c331-4c13-898c-bf6085376df2-kube-api-access-lfvrb\") pod \"payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm\" (UID: \"0eb7183f-c331-4c13-898c-bf6085376df2\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"
Nov 04 02:33:12.104050 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:12.104019    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"
Nov 04 02:33:12.311670 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:12.311632    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"]
Nov 04 02:33:12.316756 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:33:12.316731    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af097c5_120a_4b81_a86b_241101d0cbce.slice/crio-a040a74c497350f9a1d6f60ae0916b0e3e72473af6ffe00ebc9620dc2f328ac3 WatchSource:0}: Error finding container a040a74c497350f9a1d6f60ae0916b0e3e72473af6ffe00ebc9620dc2f328ac3: Status 404 returned error can't find the container with id a040a74c497350f9a1d6f60ae0916b0e3e72473af6ffe00ebc9620dc2f328ac3
Nov 04 02:33:12.485184 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:12.485149    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"]
Nov 04 02:33:12.488958 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:33:12.488930    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb7183f_c331_4c13_898c_bf6085376df2.slice/crio-d26eb387dcdcec1a6b9a290f0307b8a1b63efac9f182065023f4f6b5e84fa191 WatchSource:0}: Error finding container d26eb387dcdcec1a6b9a290f0307b8a1b63efac9f182065023f4f6b5e84fa191: Status 404 returned error can't find the container with id d26eb387dcdcec1a6b9a290f0307b8a1b63efac9f182065023f4f6b5e84fa191
Nov 04 02:33:12.600638 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:12.600587    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm" event={"ID":"0eb7183f-c331-4c13-898c-bf6085376df2","Type":"ContainerStarted","Data":"c57e733df611248db648b50f9f636636a905856fad9bf5676332b6537ee611e5"}
Nov 04 02:33:12.600760 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:12.600670    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"
Nov 04 02:33:12.600760 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:12.600689    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm" event={"ID":"0eb7183f-c331-4c13-898c-bf6085376df2","Type":"ContainerStarted","Data":"d26eb387dcdcec1a6b9a290f0307b8a1b63efac9f182065023f4f6b5e84fa191"}
Nov 04 02:33:12.602208 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:12.602175    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4" event={"ID":"9af097c5-120a-4b81-a86b-241101d0cbce","Type":"ContainerStarted","Data":"fe0176fbf53481c1e51f1e47c6667374bc4f61eae5a2d472fadcb1be26f48e41"}
Nov 04 02:33:12.602319 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:12.602228    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4" event={"ID":"9af097c5-120a-4b81-a86b-241101d0cbce","Type":"ContainerStarted","Data":"a040a74c497350f9a1d6f60ae0916b0e3e72473af6ffe00ebc9620dc2f328ac3"}
Nov 04 02:33:12.602319 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:12.602265    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"
Nov 04 02:33:12.714032 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:12.713932    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm" podStartSLOduration=1.713917492 podStartE2EDuration="1.713917492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:12.712252423 +0000 UTC m=+988.216192918" watchObservedRunningTime="2026-11-04 02:33:12.713917492 +0000 UTC m=+988.217857985"
Nov 04 02:33:12.823205 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:12.823155    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4" podStartSLOduration=1.823141395 podStartE2EDuration="1.823141395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:12.823118388 +0000 UTC m=+988.327058878" watchObservedRunningTime="2026-11-04 02:33:12.823141395 +0000 UTC m=+988.327081889"
Nov 04 02:33:13.061729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:13.061694    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:13.062310 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:13.062099    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:13.062974 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:13.062953    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:33:14.978840 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:14.978808    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:33:17.764292 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:33:17.764257    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:33:23.611825 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:23.611753    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"
Nov 04 02:33:23.611825 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:23.611822    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"
Nov 04 02:33:27.694297 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:27.694262    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"]
Nov 04 02:33:27.694721 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:27.694431    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2" podUID="a0d4ff8b-2780-4d97-93c1-cc03b58ac272" containerName="istio-proxy" containerID="cri-o://542c0abc88fc8a35cf108770a0fa49251333bdb6a10fa7a8705422a5642bf436" gracePeriod=30
Nov 04 02:33:31.391310 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.391278    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"]
Nov 04 02:33:31.395644 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.395622    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"
Nov 04 02:33:31.446421 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.446366    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-b-ab61a8\""
Nov 04 02:33:31.496626 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.496563    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-b-ab61a8-dockercfg-gr76s\""
Nov 04 02:33:31.498509 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.498483    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"]
Nov 04 02:33:31.544589 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.544552    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"]
Nov 04 02:33:31.548977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.548954    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"
Nov 04 02:33:31.569195 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.569171    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77s7h\" (UniqueName: \"kubernetes.io/projected/efc4ec72-d671-44b7-9965-8b35438ce8be-kube-api-access-77s7h\") pod \"payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp\" (UID: \"efc4ec72-d671-44b7-9965-8b35438ce8be\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"
Nov 04 02:33:31.569303 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.569209    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc4ec72-d671-44b7-9965-8b35438ce8be-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp\" (UID: \"efc4ec72-d671-44b7-9965-8b35438ce8be\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"
Nov 04 02:33:31.600573 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.600552    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"]
Nov 04 02:33:31.670261 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.670210    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77s7h\" (UniqueName: \"kubernetes.io/projected/efc4ec72-d671-44b7-9965-8b35438ce8be-kube-api-access-77s7h\") pod \"payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp\" (UID: \"efc4ec72-d671-44b7-9965-8b35438ce8be\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"
Nov 04 02:33:31.670261 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.670244    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjdsp\" (UniqueName: \"kubernetes.io/projected/efa87d42-019e-4814-baf9-ec8577de13a3-kube-api-access-gjdsp\") pod \"payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt\" (UID: \"efa87d42-019e-4814-baf9-ec8577de13a3\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"
Nov 04 02:33:31.670404 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.670266    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc4ec72-d671-44b7-9965-8b35438ce8be-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp\" (UID: \"efc4ec72-d671-44b7-9965-8b35438ce8be\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"
Nov 04 02:33:31.670404 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.670356    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efa87d42-019e-4814-baf9-ec8577de13a3-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt\" (UID: \"efa87d42-019e-4814-baf9-ec8577de13a3\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"
Nov 04 02:33:31.671006 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.670987    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc4ec72-d671-44b7-9965-8b35438ce8be-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp\" (UID: \"efc4ec72-d671-44b7-9965-8b35438ce8be\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"
Nov 04 02:33:31.729214 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.729182    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77s7h\" (UniqueName: \"kubernetes.io/projected/efc4ec72-d671-44b7-9965-8b35438ce8be-kube-api-access-77s7h\") pod \"payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp\" (UID: \"efc4ec72-d671-44b7-9965-8b35438ce8be\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"
Nov 04 02:33:31.771021 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.770995    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjdsp\" (UniqueName: \"kubernetes.io/projected/efa87d42-019e-4814-baf9-ec8577de13a3-kube-api-access-gjdsp\") pod \"payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt\" (UID: \"efa87d42-019e-4814-baf9-ec8577de13a3\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"
Nov 04 02:33:31.771110 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.771030    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efa87d42-019e-4814-baf9-ec8577de13a3-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt\" (UID: \"efa87d42-019e-4814-baf9-ec8577de13a3\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"
Nov 04 02:33:31.771711 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.771693    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efa87d42-019e-4814-baf9-ec8577de13a3-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt\" (UID: \"efa87d42-019e-4814-baf9-ec8577de13a3\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"
Nov 04 02:33:31.829465 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.829441    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjdsp\" (UniqueName: \"kubernetes.io/projected/efa87d42-019e-4814-baf9-ec8577de13a3-kube-api-access-gjdsp\") pod \"payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt\" (UID: \"efa87d42-019e-4814-baf9-ec8577de13a3\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"
Nov 04 02:33:31.862936 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:31.862915    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"
Nov 04 02:33:32.010142 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:32.010116    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"
Nov 04 02:33:32.233818 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:32.233786    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"]
Nov 04 02:33:32.238405 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:33:32.238380    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa87d42_019e_4814_baf9_ec8577de13a3.slice/crio-e1e000b28f8e9a058e4dcbedd7c27badaa5fdce43f90bbcac42f0277a6157dba WatchSource:0}: Error finding container e1e000b28f8e9a058e4dcbedd7c27badaa5fdce43f90bbcac42f0277a6157dba: Status 404 returned error can't find the container with id e1e000b28f8e9a058e4dcbedd7c27badaa5fdce43f90bbcac42f0277a6157dba
Nov 04 02:33:32.379894 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:32.379870    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"]
Nov 04 02:33:32.385092 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:33:32.385065    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc4ec72_d671_44b7_9965_8b35438ce8be.slice/crio-19ef4b04a3ddf50326cc0fb6b1986fb8d5bec24db4c30bed53c1b95ce0bc0d91 WatchSource:0}: Error finding container 19ef4b04a3ddf50326cc0fb6b1986fb8d5bec24db4c30bed53c1b95ce0bc0d91: Status 404 returned error can't find the container with id 19ef4b04a3ddf50326cc0fb6b1986fb8d5bec24db4c30bed53c1b95ce0bc0d91
Nov 04 02:33:32.716385 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:32.716356    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp" event={"ID":"efc4ec72-d671-44b7-9965-8b35438ce8be","Type":"ContainerStarted","Data":"eca88f50cc3e49f5a22cf0722089bc37249f1bfb360c6b3a5c4427d4f8c4f3f3"}
Nov 04 02:33:32.716743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:32.716406    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp" event={"ID":"efc4ec72-d671-44b7-9965-8b35438ce8be","Type":"ContainerStarted","Data":"19ef4b04a3ddf50326cc0fb6b1986fb8d5bec24db4c30bed53c1b95ce0bc0d91"}
Nov 04 02:33:32.716743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:32.716430    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"
Nov 04 02:33:32.718066 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:32.718037    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt" event={"ID":"efa87d42-019e-4814-baf9-ec8577de13a3","Type":"ContainerStarted","Data":"c1f34624b9d2888b5d4934b928bcab30f791fe4312c854e51725377ba46c3e74"}
Nov 04 02:33:32.718145 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:32.718087    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt" event={"ID":"efa87d42-019e-4814-baf9-ec8577de13a3","Type":"ContainerStarted","Data":"e1e000b28f8e9a058e4dcbedd7c27badaa5fdce43f90bbcac42f0277a6157dba"}
Nov 04 02:33:32.718145 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:32.718116    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"
Nov 04 02:33:32.830363 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:32.830322    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp" podStartSLOduration=1.830308085 podStartE2EDuration="1.830308085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:32.828621901 +0000 UTC m=+1008.332562396" watchObservedRunningTime="2026-11-04 02:33:32.830308085 +0000 UTC m=+1008.334248579"
Nov 04 02:33:32.941544 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:32.941512    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:33:32.945518 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:32.945467    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt" podStartSLOduration=1.945455145 podStartE2EDuration="1.945455145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:32.942801442 +0000 UTC m=+1008.446741950" watchObservedRunningTime="2026-11-04 02:33:32.945455145 +0000 UTC m=+1008.449395652"
Nov 04 02:33:33.085367 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.085337    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-credential-socket\") pod \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") "
Nov 04 02:33:33.085558 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.085379    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-certs\") pod \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") "
Nov 04 02:33:33.085558 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.085418    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-socket\") pod \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") "
Nov 04 02:33:33.085558 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.085436    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istiod-ca-cert\") pod \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") "
Nov 04 02:33:33.085558 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.085523    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-data\") pod \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") "
Nov 04 02:33:33.085794 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.085576    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-kube-api-access-2tzsk\" (UniqueName: \"kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-kube-api-access-2tzsk\") pod \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") "
Nov 04 02:33:33.085794 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.085643    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-token\" (UniqueName: \"kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-token\") pod \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") "
Nov 04 02:33:33.085794 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.085678    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-credential-socket" pod "a0d4ff8b-2780-4d97-93c1-cc03b58ac272" (UID: "a0d4ff8b-2780-4d97-93c1-cc03b58ac272"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:33:33.085794 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.085696    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-certs" pod "a0d4ff8b-2780-4d97-93c1-cc03b58ac272" (UID: "a0d4ff8b-2780-4d97-93c1-cc03b58ac272"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:33:33.085794 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.085715    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-podinfo\") pod \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") "
Nov 04 02:33:33.085794 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.085771    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-envoy\") pod \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\" (UID: \"a0d4ff8b-2780-4d97-93c1-cc03b58ac272\") "
Nov 04 02:33:33.086099 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.085794    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-socket" pod "a0d4ff8b-2780-4d97-93c1-cc03b58ac272" (UID: "a0d4ff8b-2780-4d97-93c1-cc03b58ac272"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:33:33.086099 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.085906    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istiod-ca-cert" pod "a0d4ff8b-2780-4d97-93c1-cc03b58ac272" (UID: "a0d4ff8b-2780-4d97-93c1-cc03b58ac272"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:33:33.086256 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.086233    5450 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-credential-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:33.086321 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.086263    5450 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:33.086321 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.086278    5450 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-workload-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:33.086321 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.086291    5450 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istiod-ca-cert\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:33.088304 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.088276    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-kube-api-access-2tzsk" pod "a0d4ff8b-2780-4d97-93c1-cc03b58ac272" (UID: "a0d4ff8b-2780-4d97-93c1-cc03b58ac272"). InnerVolumeSpecName "kube-api-access-2tzsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:33:33.088862 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.088834    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-data" pod "a0d4ff8b-2780-4d97-93c1-cc03b58ac272" (UID: "a0d4ff8b-2780-4d97-93c1-cc03b58ac272"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:33:33.090726 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.090702    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-envoy" pod "a0d4ff8b-2780-4d97-93c1-cc03b58ac272" (UID: "a0d4ff8b-2780-4d97-93c1-cc03b58ac272"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:33:33.090726 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.090715    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-podinfo" pod "a0d4ff8b-2780-4d97-93c1-cc03b58ac272" (UID: "a0d4ff8b-2780-4d97-93c1-cc03b58ac272"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:33:33.090862 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.090718    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-token" pod "a0d4ff8b-2780-4d97-93c1-cc03b58ac272" (UID: "a0d4ff8b-2780-4d97-93c1-cc03b58ac272"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:33:33.187059 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.187037    5450 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-data\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:33.187150 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.187061    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tzsk\" (UniqueName: \"kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-kube-api-access-2tzsk\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:33.187150 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.187071    5450 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-token\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:33.187150 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.187079    5450 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-podinfo\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:33.187150 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.187088    5450 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d4ff8b-2780-4d97-93c1-cc03b58ac272-istio-envoy\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:33:33.724713 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.724679    5450 generic.go:356] "Generic (PLEG): container finished" podID="a0d4ff8b-2780-4d97-93c1-cc03b58ac272" containerID="542c0abc88fc8a35cf108770a0fa49251333bdb6a10fa7a8705422a5642bf436" exitCode=0
Nov 04 02:33:33.725153 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.724726    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"
Nov 04 02:33:33.725153 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.724768    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2" event={"ID":"a0d4ff8b-2780-4d97-93c1-cc03b58ac272","Type":"ContainerDied","Data":"542c0abc88fc8a35cf108770a0fa49251333bdb6a10fa7a8705422a5642bf436"}
Nov 04 02:33:33.725153 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.724827    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2" event={"ID":"a0d4ff8b-2780-4d97-93c1-cc03b58ac272","Type":"ContainerDied","Data":"7cc4f7acf2636924fd7c9846a4565046666f4522597c6f0718a1befdd11c2544"}
Nov 04 02:33:33.725153 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.724859    5450 scope.go:122] "RemoveContainer" containerID="542c0abc88fc8a35cf108770a0fa49251333bdb6a10fa7a8705422a5642bf436"
Nov 04 02:33:33.734497 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.734482    5450 scope.go:122] "RemoveContainer" containerID="542c0abc88fc8a35cf108770a0fa49251333bdb6a10fa7a8705422a5642bf436"
Nov 04 02:33:33.734846 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:33:33.734829    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"542c0abc88fc8a35cf108770a0fa49251333bdb6a10fa7a8705422a5642bf436\": container with ID starting with 542c0abc88fc8a35cf108770a0fa49251333bdb6a10fa7a8705422a5642bf436 not found: ID does not exist" containerID="542c0abc88fc8a35cf108770a0fa49251333bdb6a10fa7a8705422a5642bf436"
Nov 04 02:33:33.734899 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.734852    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"542c0abc88fc8a35cf108770a0fa49251333bdb6a10fa7a8705422a5642bf436"} err="failed to get container status \"542c0abc88fc8a35cf108770a0fa49251333bdb6a10fa7a8705422a5642bf436\": rpc error: code = NotFound desc = could not find container \"542c0abc88fc8a35cf108770a0fa49251333bdb6a10fa7a8705422a5642bf436\": container with ID starting with 542c0abc88fc8a35cf108770a0fa49251333bdb6a10fa7a8705422a5642bf436 not found: ID does not exist"
Nov 04 02:33:33.933142 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.933112    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"]
Nov 04 02:33:33.982326 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:33.982269    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-kzkx2"]
Nov 04 02:33:34.633075 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:34.633046    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0d4ff8b-2780-4d97-93c1-cc03b58ac272" path="/var/lib/kubelet/pods/a0d4ff8b-2780-4d97-93c1-cc03b58ac272/volumes"
Nov 04 02:33:43.727846 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:43.727816    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"
Nov 04 02:33:43.728257 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:43.727880    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"
Nov 04 02:33:47.763902 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:33:47.763864    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:33:50.760707 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.760679    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"]
Nov 04 02:33:50.761266 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.761254    5450 cpu_manager.go:414] "containerMap: removing container" podUID="a0d4ff8b-2780-4d97-93c1-cc03b58ac272" containerName="istio-proxy"
Nov 04 02:33:50.761309 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.761267    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0d4ff8b-2780-4d97-93c1-cc03b58ac272" containerName="istio-proxy"
Nov 04 02:33:50.761391 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.761375    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0d4ff8b-2780-4d97-93c1-cc03b58ac272" containerName="istio-proxy"
Nov 04 02:33:50.766722 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.766703    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:50.816944 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.816925    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-a-80b404-serving-cert\""
Nov 04 02:33:50.858021 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.857995    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-maas-api-tls\") pod \"maas-api-e2e-extmod-a-80b404-b7975487-slnhp\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:50.858165 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.858055    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-metrics-certs\") pod \"maas-api-e2e-extmod-a-80b404-b7975487-slnhp\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:50.858209 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.858190    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68gk5\" (UniqueName: \"kubernetes.io/projected/6a47414e-24ca-4b3a-873a-c90633787a51-kube-api-access-68gk5\") pod \"maas-api-e2e-extmod-a-80b404-b7975487-slnhp\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:50.858248 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.858225    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a47414e-24ca-4b3a-873a-c90633787a51-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-80b404-b7975487-slnhp\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:50.867109 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.867082    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"]
Nov 04 02:33:50.959544 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.959512    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-metrics-certs\") pod \"maas-api-e2e-extmod-a-80b404-b7975487-slnhp\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:50.959744 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.959650    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68gk5\" (UniqueName: \"kubernetes.io/projected/6a47414e-24ca-4b3a-873a-c90633787a51-kube-api-access-68gk5\") pod \"maas-api-e2e-extmod-a-80b404-b7975487-slnhp\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:50.959744 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.959689    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a47414e-24ca-4b3a-873a-c90633787a51-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-80b404-b7975487-slnhp\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:50.959869 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.959812    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-maas-api-tls\") pod \"maas-api-e2e-extmod-a-80b404-b7975487-slnhp\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:50.959949 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:33:50.959933    5450 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-serving-cert: secret "maas-api-e2e-extmod-a-80b404-serving-cert" not found
Nov 04 02:33:50.960039 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:33:50.960029    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-maas-api-tls podName:6a47414e-24ca-4b3a-873a-c90633787a51 nodeName:}" failed. No retries permitted until 2026-11-04 02:33:51.460013393 +0000 UTC m=+1026.963953870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-maas-api-tls") pod "maas-api-e2e-extmod-a-80b404-b7975487-slnhp" (UID: "6a47414e-24ca-4b3a-873a-c90633787a51") : secret "maas-api-e2e-extmod-a-80b404-serving-cert" not found
Nov 04 02:33:50.960321 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.960299    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a47414e-24ca-4b3a-873a-c90633787a51-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-80b404-b7975487-slnhp\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:50.961794 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:50.961778    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-metrics-certs\") pod \"maas-api-e2e-extmod-a-80b404-b7975487-slnhp\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:51.018930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:51.018861    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68gk5\" (UniqueName: \"kubernetes.io/projected/6a47414e-24ca-4b3a-873a-c90633787a51-kube-api-access-68gk5\") pod \"maas-api-e2e-extmod-a-80b404-b7975487-slnhp\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:51.466051 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:51.465958    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-maas-api-tls\") pod \"maas-api-e2e-extmod-a-80b404-b7975487-slnhp\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:51.468606 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:51.468576    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-maas-api-tls\") pod \"maas-api-e2e-extmod-a-80b404-b7975487-slnhp\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:51.679738 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:51.679558    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:52.052477 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:52.052442    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"]
Nov 04 02:33:52.058179 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:33:52.058147    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a47414e_24ca_4b3a_873a_c90633787a51.slice/crio-20c99b463a2487840b8f0ebc28830a31da0ed28056ab20a618dd8e0a34a6b56f WatchSource:0}: Error finding container 20c99b463a2487840b8f0ebc28830a31da0ed28056ab20a618dd8e0a34a6b56f: Status 404 returned error can't find the container with id 20c99b463a2487840b8f0ebc28830a31da0ed28056ab20a618dd8e0a34a6b56f
Nov 04 02:33:52.834724 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:52.834685    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp" event={"ID":"6a47414e-24ca-4b3a-873a-c90633787a51","Type":"ContainerStarted","Data":"20c99b463a2487840b8f0ebc28830a31da0ed28056ab20a618dd8e0a34a6b56f"}
Nov 04 02:33:53.842234 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:53.842201    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp" event={"ID":"6a47414e-24ca-4b3a-873a-c90633787a51","Type":"ContainerStarted","Data":"95cabf9da8027e1a7aecfefea935da8114fa52593d4a51a579bbaf3b7bdc7077"}
Nov 04 02:33:53.842656 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:53.842354    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:33:53.956236 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:53.956184    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp" podStartSLOduration=2.835561176 podStartE2EDuration="3.956170979s" totalImagesPullingTime="1.120609803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:53.955447421 +0000 UTC m=+1029.459387915" watchObservedRunningTime="2026-11-04 02:33:53.956170979 +0000 UTC m=+1029.460111473"
Nov 04 02:33:55.326271 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:55.326235    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:33:56.712518 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.712466    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"]
Nov 04 02:33:56.718155 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.718123    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:56.770282 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.770243    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"]
Nov 04 02:33:56.820326 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.820291    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-plugins\""
Nov 04 02:33:56.820553 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.820528    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"openshift-service-ca.crt\""
Nov 04 02:33:56.820696 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.820419    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"routing-overlay\""
Nov 04 02:33:56.820696 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.820473    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"agc-cred-a369bc8f7d56\""
Nov 04 02:33:56.820696 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.820337    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-dockercfg-btb9r\""
Nov 04 02:33:56.820848 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.820700    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"kube-root-ca.crt\""
Nov 04 02:33:56.826106 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.826079    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmrfq\" (UniqueName: \"kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-kube-api-access-rmrfq\") pod \"payload-processing-external-model-fc445457d-9qzxp\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") " pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:56.826229 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.826210    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-provider-credentials\") pod \"payload-processing-external-model-fc445457d-9qzxp\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") " pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:56.826293 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.826275    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-routing-overlay-volume\") pod \"payload-processing-external-model-fc445457d-9qzxp\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") " pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:56.826477 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.826457    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-plugins-config-volume\") pod \"payload-processing-external-model-fc445457d-9qzxp\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") " pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:56.929693 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.929652    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmrfq\" (UniqueName: \"kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-kube-api-access-rmrfq\") pod \"payload-processing-external-model-fc445457d-9qzxp\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") " pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:56.929880 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.929748    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-provider-credentials\") pod \"payload-processing-external-model-fc445457d-9qzxp\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") " pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:56.929880 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.929799    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-routing-overlay-volume\") pod \"payload-processing-external-model-fc445457d-9qzxp\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") " pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:56.929997 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.929910    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-plugins-config-volume\") pod \"payload-processing-external-model-fc445457d-9qzxp\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") " pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:56.930924 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.930888    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-plugins-config-volume\") pod \"payload-processing-external-model-fc445457d-9qzxp\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") " pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:56.937936 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.937367    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-provider-credentials\") pod \"payload-processing-external-model-fc445457d-9qzxp\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") " pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:56.938067 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.938022    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-routing-overlay-volume\") pod \"payload-processing-external-model-fc445457d-9qzxp\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") " pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:56.994235 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:56.994139    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmrfq\" (UniqueName: \"kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-kube-api-access-rmrfq\") pod \"payload-processing-external-model-fc445457d-9qzxp\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") " pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:57.035962 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:57.035919    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:57.424229 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:57.424191    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"]
Nov 04 02:33:57.429918 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:33:57.429886    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6038f634_c2b8_4a6b_8ebe_dedea694ca42.slice/crio-a07c08ba11e6a9229671545f92cc57224fe1a2ba7f9fcd9c9ce43f61f3192874 WatchSource:0}: Error finding container a07c08ba11e6a9229671545f92cc57224fe1a2ba7f9fcd9c9ce43f61f3192874: Status 404 returned error can't find the container with id a07c08ba11e6a9229671545f92cc57224fe1a2ba7f9fcd9c9ce43f61f3192874
Nov 04 02:33:57.867108 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:57.867064    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp" event={"ID":"6038f634-c2b8-4a6b-8ebe-dedea694ca42","Type":"ContainerStarted","Data":"65b3607c0b09162eda0e8d80c190af076ff9cd13dc80dc7d9c3a8271a92e3e3f"}
Nov 04 02:33:57.867488 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:57.867127    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp" event={"ID":"6038f634-c2b8-4a6b-8ebe-dedea694ca42","Type":"ContainerStarted","Data":"a07c08ba11e6a9229671545f92cc57224fe1a2ba7f9fcd9c9ce43f61f3192874"}
Nov 04 02:33:57.867488 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:57.867244    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:33:58.007327 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:58.007280    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp" podStartSLOduration=2.007265428 podStartE2EDuration="2.007265428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:58.006172108 +0000 UTC m=+1033.510112640" watchObservedRunningTime="2026-11-04 02:33:58.007265428 +0000 UTC m=+1033.511205922"
Nov 04 02:33:59.854286 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:33:59.854254    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:34:08.877812 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:08.877780    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:34:10.932007 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:10.931973    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"]
Nov 04 02:34:10.937444 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:10.937416    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"
Nov 04 02:34:10.982730 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:10.982677    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9wmr\" (UniqueName: \"kubernetes.io/projected/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-kube-api-access-j9wmr\") pod \"payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc\" (UID: \"dedb6bf3-bf24-42c9-987c-52c5acb56d7a\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"
Nov 04 02:34:10.982919 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:10.982759    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc\" (UID: \"dedb6bf3-bf24-42c9-987c-52c5acb56d7a\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"
Nov 04 02:34:10.990337 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:10.990306    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"]
Nov 04 02:34:11.035373 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.035339    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-b-d501fd\""
Nov 04 02:34:11.035538 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.035430    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-b-d501fd-dockercfg-w55sk\""
Nov 04 02:34:11.077897 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.077868    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"]
Nov 04 02:34:11.082095 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.082070    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"
Nov 04 02:34:11.083486 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.083466    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9wmr\" (UniqueName: \"kubernetes.io/projected/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-kube-api-access-j9wmr\") pod \"payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc\" (UID: \"dedb6bf3-bf24-42c9-987c-52c5acb56d7a\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"
Nov 04 02:34:11.083554 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.083536    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc\" (UID: \"dedb6bf3-bf24-42c9-987c-52c5acb56d7a\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"
Nov 04 02:34:11.084215 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.084196    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc\" (UID: \"dedb6bf3-bf24-42c9-987c-52c5acb56d7a\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"
Nov 04 02:34:11.135505 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.135472    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"]
Nov 04 02:34:11.142932 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.142898    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9wmr\" (UniqueName: \"kubernetes.io/projected/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-kube-api-access-j9wmr\") pod \"payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc\" (UID: \"dedb6bf3-bf24-42c9-987c-52c5acb56d7a\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"
Nov 04 02:34:11.185151 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.185070    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8tnl\" (UniqueName: \"kubernetes.io/projected/97fc2fa4-e688-47b1-a958-97a545c16860-kube-api-access-q8tnl\") pod \"payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4\" (UID: \"97fc2fa4-e688-47b1-a958-97a545c16860\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"
Nov 04 02:34:11.185300 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.185185    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97fc2fa4-e688-47b1-a958-97a545c16860-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4\" (UID: \"97fc2fa4-e688-47b1-a958-97a545c16860\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"
Nov 04 02:34:11.251649 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.251592    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"
Nov 04 02:34:11.285937 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.285903    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8tnl\" (UniqueName: \"kubernetes.io/projected/97fc2fa4-e688-47b1-a958-97a545c16860-kube-api-access-q8tnl\") pod \"payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4\" (UID: \"97fc2fa4-e688-47b1-a958-97a545c16860\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"
Nov 04 02:34:11.286094 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.285984    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97fc2fa4-e688-47b1-a958-97a545c16860-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4\" (UID: \"97fc2fa4-e688-47b1-a958-97a545c16860\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"
Nov 04 02:34:11.286881 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.286858    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97fc2fa4-e688-47b1-a958-97a545c16860-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4\" (UID: \"97fc2fa4-e688-47b1-a958-97a545c16860\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"
Nov 04 02:34:11.346121 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.346079    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8tnl\" (UniqueName: \"kubernetes.io/projected/97fc2fa4-e688-47b1-a958-97a545c16860-kube-api-access-q8tnl\") pod \"payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4\" (UID: \"97fc2fa4-e688-47b1-a958-97a545c16860\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"
Nov 04 02:34:11.395785 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.395754    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"
Nov 04 02:34:11.630900 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.630874    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"]
Nov 04 02:34:11.634164 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:34:11.634135    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddedb6bf3_bf24_42c9_987c_52c5acb56d7a.slice/crio-8be87e4c5af028684833dd47e796844516610fa1ea3e892be22bf7b2e2d70508 WatchSource:0}: Error finding container 8be87e4c5af028684833dd47e796844516610fa1ea3e892be22bf7b2e2d70508: Status 404 returned error can't find the container with id 8be87e4c5af028684833dd47e796844516610fa1ea3e892be22bf7b2e2d70508
Nov 04 02:34:11.769692 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.769642    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"]
Nov 04 02:34:11.775230 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:34:11.775199    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fc2fa4_e688_47b1_a958_97a545c16860.slice/crio-b2ffcbe7544b90d38638c9f0d7ae8db0c82133efb65934e8dcfa0be879a57d89 WatchSource:0}: Error finding container b2ffcbe7544b90d38638c9f0d7ae8db0c82133efb65934e8dcfa0be879a57d89: Status 404 returned error can't find the container with id b2ffcbe7544b90d38638c9f0d7ae8db0c82133efb65934e8dcfa0be879a57d89
Nov 04 02:34:11.968571 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.968460    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4" event={"ID":"97fc2fa4-e688-47b1-a958-97a545c16860","Type":"ContainerStarted","Data":"e9a7077a968dfaabc4749f949c979bcb7b7f324248660ec4f83aad5f588e4613"}
Nov 04 02:34:11.968571 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.968535    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4" event={"ID":"97fc2fa4-e688-47b1-a958-97a545c16860","Type":"ContainerStarted","Data":"b2ffcbe7544b90d38638c9f0d7ae8db0c82133efb65934e8dcfa0be879a57d89"}
Nov 04 02:34:11.969092 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.968621    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"
Nov 04 02:34:11.971113 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.971081    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc" event={"ID":"dedb6bf3-bf24-42c9-987c-52c5acb56d7a","Type":"ContainerStarted","Data":"51214ea9c1e0158d62407e15a51422f8e7d6fb08efc68a2b60807f6a5502209d"}
Nov 04 02:34:11.971297 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.971135    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc" event={"ID":"dedb6bf3-bf24-42c9-987c-52c5acb56d7a","Type":"ContainerStarted","Data":"8be87e4c5af028684833dd47e796844516610fa1ea3e892be22bf7b2e2d70508"}
Nov 04 02:34:11.971297 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:11.971182    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"
Nov 04 02:34:12.082342 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:12.082290    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4" podStartSLOduration=1.082275287 podStartE2EDuration="1.082275287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:12.080152219 +0000 UTC m=+1047.584092726" watchObservedRunningTime="2026-11-04 02:34:12.082275287 +0000 UTC m=+1047.586215777"
Nov 04 02:34:12.193066 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:12.193010    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc" podStartSLOduration=2.192995715 podStartE2EDuration="2.192995715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:12.191932163 +0000 UTC m=+1047.695872659" watchObservedRunningTime="2026-11-04 02:34:12.192995715 +0000 UTC m=+1047.696936249"
Nov 04 02:34:12.796515 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:12.796476    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"]
Nov 04 02:34:12.801179 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:12.801156    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:12.852334 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:12.852305    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"agc-cred-63866b33446b\""
Nov 04 02:34:12.855443 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:12.855412    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"]
Nov 04 02:34:12.903338 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:12.903308    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6m9r\" (UniqueName: \"kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-kube-api-access-l6m9r\") pod \"payload-processing-external-model-66ccc7f677-72xcm\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") " pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:12.903510 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:12.903349    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials\") pod \"payload-processing-external-model-66ccc7f677-72xcm\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") " pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:12.903510 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:12.903417    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-plugins-config-volume\") pod \"payload-processing-external-model-66ccc7f677-72xcm\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") " pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:12.903510 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:12.903480    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-routing-overlay-volume\") pod \"payload-processing-external-model-66ccc7f677-72xcm\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") " pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:13.004523 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.004488    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6m9r\" (UniqueName: \"kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-kube-api-access-l6m9r\") pod \"payload-processing-external-model-66ccc7f677-72xcm\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") " pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:13.005059 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.004543    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials\") pod \"payload-processing-external-model-66ccc7f677-72xcm\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") " pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:13.005059 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.004576    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-plugins-config-volume\") pod \"payload-processing-external-model-66ccc7f677-72xcm\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") " pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:13.005059 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.004683    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-routing-overlay-volume\") pod \"payload-processing-external-model-66ccc7f677-72xcm\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") " pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:13.005685 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.005664    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-routing-overlay-volume\") pod \"payload-processing-external-model-66ccc7f677-72xcm\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") " pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:13.005732 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.005682    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-plugins-config-volume\") pod \"payload-processing-external-model-66ccc7f677-72xcm\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") " pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:13.007098 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.007081    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials\") pod \"payload-processing-external-model-66ccc7f677-72xcm\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") " pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:13.073055 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.072975    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6m9r\" (UniqueName: \"kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-kube-api-access-l6m9r\") pod \"payload-processing-external-model-66ccc7f677-72xcm\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") " pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:13.093151 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.093113    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"]
Nov 04 02:34:13.097784 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.097759    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.115126 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.115102    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:13.154065 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.151074    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gflvh\""
Nov 04 02:34:13.156860 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.156830    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"]
Nov 04 02:34:13.206529 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.206497    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.206717 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.206690    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.206790 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.206767    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgj52\" (UniqueName: \"kubernetes.io/projected/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-kube-api-access-fgj52\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.206845 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.206804    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.206935 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.206919    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.207030 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.207007    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.207075 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.207054    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.207148 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.207134    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.207212 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.207192    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.308378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.308339    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.308378 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.308373    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.308663 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.308424    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.308663 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.308478    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.308663 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.308501    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgj52\" (UniqueName: \"kubernetes.io/projected/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-kube-api-access-fgj52\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.308663 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.308524    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.308663 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.308608    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.308663 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.308655    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.308937 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.308684    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.309067 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.309042    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.309136 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.309108    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.309248 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.309227    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.309285 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.309256    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.309453 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.309435    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.311269 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.311249    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.311379 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.311328    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.368137 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.368071    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.368260 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.368221    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgj52\" (UniqueName: \"kubernetes.io/projected/7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d-kube-api-access-fgj52\") pod \"maas-default-gateway-openshift-default-fd4b99879-xdcsw\" (UID: \"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.412528 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.412487    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:13.499699 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.499661    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"]
Nov 04 02:34:13.504686 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:34:13.504651    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205307f9_b34c_4a63_925e_425314b48e36.slice/crio-da21dd8520aa3f51bb99c3ab2c2414d9e720d20c7cd88da12b6ede488ad595f5 WatchSource:0}: Error finding container da21dd8520aa3f51bb99c3ab2c2414d9e720d20c7cd88da12b6ede488ad595f5: Status 404 returned error can't find the container with id da21dd8520aa3f51bb99c3ab2c2414d9e720d20c7cd88da12b6ede488ad595f5
Nov 04 02:34:13.795090 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.795047    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"]
Nov 04 02:34:13.799936 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:34:13.799906    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd47d53_fc21_4b2d_8e8a_4396bb8bfa5d.slice/crio-48b8a78a9fc1fdba9092425b667f50853bb3ba9928d90fb09864fe1154531948 WatchSource:0}: Error finding container 48b8a78a9fc1fdba9092425b667f50853bb3ba9928d90fb09864fe1154531948: Status 404 returned error can't find the container with id 48b8a78a9fc1fdba9092425b667f50853bb3ba9928d90fb09864fe1154531948
Nov 04 02:34:13.802737 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.802705    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:34:13.802815 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.802775    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:34:13.802815 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.802802    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:34:13.985220 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.985185    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm" event={"ID":"205307f9-b34c-4a63-925e-425314b48e36","Type":"ContainerStarted","Data":"f57492731111cdef819054a4046b1c3df13ad7614c113f0bda39e361e9f0f388"}
Nov 04 02:34:13.985429 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.985238    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm" event={"ID":"205307f9-b34c-4a63-925e-425314b48e36","Type":"ContainerStarted","Data":"da21dd8520aa3f51bb99c3ab2c2414d9e720d20c7cd88da12b6ede488ad595f5"}
Nov 04 02:34:13.985429 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.985299    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:13.986991 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.986970    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw" event={"ID":"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d","Type":"ContainerStarted","Data":"fbaf8d1971c6f22b95251185e480042ccec492f0eb061951d5696d3ad70d2081"}
Nov 04 02:34:13.987105 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:13.987018    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw" event={"ID":"7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d","Type":"ContainerStarted","Data":"48b8a78a9fc1fdba9092425b667f50853bb3ba9928d90fb09864fe1154531948"}
Nov 04 02:34:14.099996 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:14.099899    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm" podStartSLOduration=2.099884804 podStartE2EDuration="2.099884804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:14.09936795 +0000 UTC m=+1049.603308455" watchObservedRunningTime="2026-11-04 02:34:14.099884804 +0000 UTC m=+1049.603825297"
Nov 04 02:34:14.217645 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:14.217557    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw" podStartSLOduration=1.217538682 podStartE2EDuration="1.217538682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:14.215561378 +0000 UTC m=+1049.719501896" watchObservedRunningTime="2026-11-04 02:34:14.217538682 +0000 UTC m=+1049.721479177"
Nov 04 02:34:14.413408 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:14.413309    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:14.415320 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:14.415293    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-xdcsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:14.415461 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:14.415344    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw" podUID="7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 02:34:15.413737 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:15.413702    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-xdcsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:15.414142 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:15.413763    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw" podUID="7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 02:34:16.414118 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:16.414085    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-xdcsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:16.414509 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:16.414137    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw" podUID="7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 02:34:17.413588 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:17.413550    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-xdcsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:17.413779 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:17.413620    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw" podUID="7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 02:34:17.771641 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:34:17.769770    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:34:18.414115 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:18.414080    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-xdcsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:18.414291 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:18.414137    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw" podUID="7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 02:34:19.089762 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.089723    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"]
Nov 04 02:34:19.095966 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.095939    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:19.144455 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.144422    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"]
Nov 04 02:34:19.188941 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.188903    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-b-ab61a8-serving-cert\""
Nov 04 02:34:19.199671 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.199636    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c6989de-d851-49f9-94b3-6ea0133407b7-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:19.199848 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.199681    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chkwc\" (UniqueName: \"kubernetes.io/projected/3c6989de-d851-49f9-94b3-6ea0133407b7-kube-api-access-chkwc\") pod \"maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:19.199974 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.199950    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-metrics-certs\") pod \"maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:19.200030 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.200012    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-maas-api-tls\") pod \"maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:19.301268 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.301237    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-metrics-certs\") pod \"maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:19.301449 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.301283    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-maas-api-tls\") pod \"maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:19.301449 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.301337    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c6989de-d851-49f9-94b3-6ea0133407b7-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:19.301449 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.301354    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chkwc\" (UniqueName: \"kubernetes.io/projected/3c6989de-d851-49f9-94b3-6ea0133407b7-kube-api-access-chkwc\") pod \"maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:19.301630 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:34:19.301454    5450 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-serving-cert: secret "maas-api-e2e-extmod-b-ab61a8-serving-cert" not found
Nov 04 02:34:19.301630 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:34:19.301529    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-maas-api-tls podName:3c6989de-d851-49f9-94b3-6ea0133407b7 nodeName:}" failed. No retries permitted until 2026-11-04 02:34:19.801510143 +0000 UTC m=+1055.305450641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-maas-api-tls") pod "maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs" (UID: "3c6989de-d851-49f9-94b3-6ea0133407b7") : secret "maas-api-e2e-extmod-b-ab61a8-serving-cert" not found
Nov 04 02:34:19.302079 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.302055    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c6989de-d851-49f9-94b3-6ea0133407b7-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:19.303735 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.303713    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-metrics-certs\") pod \"maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:19.360960 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.360893    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chkwc\" (UniqueName: \"kubernetes.io/projected/3c6989de-d851-49f9-94b3-6ea0133407b7-kube-api-access-chkwc\") pod \"maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:19.414243 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.414201    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-xdcsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:19.414420 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.414261    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw" podUID="7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 02:34:19.806838 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.806803    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-maas-api-tls\") pod \"maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:19.809050 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:19.809024    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-maas-api-tls\") pod \"maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:20.010273 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.010236    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:20.400741 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.400655    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"]
Nov 04 02:34:20.406701 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:34:20.406667    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c6989de_d851_49f9_94b3_6ea0133407b7.slice/crio-47abe033d9daa024dd99ab92843bb745e73a8a217fa63892031870d609d76d34 WatchSource:0}: Error finding container 47abe033d9daa024dd99ab92843bb745e73a8a217fa63892031870d609d76d34: Status 404 returned error can't find the container with id 47abe033d9daa024dd99ab92843bb745e73a8a217fa63892031870d609d76d34
Nov 04 02:34:20.413380 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.413355    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-xdcsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:20.413482 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.413399    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw" podUID="7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 02:34:20.450072 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.450031    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"]
Nov 04 02:34:20.459995 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.459963    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.536085 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.536050    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"]
Nov 04 02:34:20.617974 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.617935    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.618233 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.618205    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.618369 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.618248    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.618442 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.618369    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsczb\" (UniqueName: \"kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-kube-api-access-tsczb\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.618442 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.618423    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.618565 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.618502    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.618565 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.618532    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.618720 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.618661    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.618781 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.618765    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.719446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.719354    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.719635 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.719451    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.719635 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.719490    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.719803 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.719766    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.719898 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.719879    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsczb\" (UniqueName: \"kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-kube-api-access-tsczb\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.719956 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.719919    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.720018 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.719986    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.720072 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.720024    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.720072 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.720029    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.720180 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.720095    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.720180 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.720140    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.720304 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.720272    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.720440 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.720402    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.720543 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.720522    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.721955 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.721933    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.722440 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.722423    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.778833 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.778798    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:20.779061 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:20.779036    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsczb\" (UniqueName: \"kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-kube-api-access-tsczb\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:21.033907 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:21.033864    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs" event={"ID":"3c6989de-d851-49f9-94b3-6ea0133407b7","Type":"ContainerStarted","Data":"47abe033d9daa024dd99ab92843bb745e73a8a217fa63892031870d609d76d34"}
Nov 04 02:34:21.077362 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:21.077316    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:21.414171 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:21.414071    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-xdcsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:21.414171 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:21.414148    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw" podUID="7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 02:34:21.507012 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:21.506976    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"]
Nov 04 02:34:21.511829 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:34:21.511794    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e41f76_88b7_495d_ba6f_9dc2b0640de1.slice/crio-42286f9c05a2438bcaea9d066b4c483be32d345b42b22c85159da9cab5658b68 WatchSource:0}: Error finding container 42286f9c05a2438bcaea9d066b4c483be32d345b42b22c85159da9cab5658b68: Status 404 returned error can't find the container with id 42286f9c05a2438bcaea9d066b4c483be32d345b42b22c85159da9cab5658b68
Nov 04 02:34:21.520856 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:21.520814    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:34:21.520932 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:21.520915    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:34:21.520978 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:21.520962    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:34:22.043952 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.043914    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs" event={"ID":"3c6989de-d851-49f9-94b3-6ea0133407b7","Type":"ContainerStarted","Data":"aad46384cd08b9469134838ed694c6dc6954f498ab46afe031dd8386a4c6a1dd"}
Nov 04 02:34:22.044219 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.044196    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:22.046342 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.046314    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4" event={"ID":"70e41f76-88b7-495d-ba6f-9dc2b0640de1","Type":"ContainerStarted","Data":"a4c22fe60f5303b19f055b5d490b911cf633b480b9b48dc0679aa351d8a408ec"}
Nov 04 02:34:22.046466 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.046364    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4" event={"ID":"70e41f76-88b7-495d-ba6f-9dc2b0640de1","Type":"ContainerStarted","Data":"42286f9c05a2438bcaea9d066b4c483be32d345b42b22c85159da9cab5658b68"}
Nov 04 02:34:22.082508 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.082467    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:22.082739 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.082651    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 04 02:34:22.082739 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.082708    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4" podUID="70e41f76-88b7-495d-ba6f-9dc2b0640de1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 04 02:34:22.184619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.184261    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs" podStartSLOduration=2.072240758 podStartE2EDuration="3.184240228s" totalImagesPullingTime="1.11199947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:22.164168762 +0000 UTC m=+1057.668109256" watchObservedRunningTime="2026-11-04 02:34:22.184240228 +0000 UTC m=+1057.688180726"
Nov 04 02:34:22.307115 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.296456    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4" podStartSLOduration=2.296436289 podStartE2EDuration="2.296436289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:22.294027016 +0000 UTC m=+1057.797967509" watchObservedRunningTime="2026-11-04 02:34:22.296436289 +0000 UTC m=+1057.800376784"
Nov 04 02:34:22.532746 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.532710    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:22.533370 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.533332    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:22.534330 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.534311    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-xdcsw"
Nov 04 02:34:22.989948 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.989916    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"
Nov 04 02:34:22.990145 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:22.990005    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"
Nov 04 02:34:23.082507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:23.082025    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 04 02:34:23.082507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:23.082105    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4" podUID="70e41f76-88b7-495d-ba6f-9dc2b0640de1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 04 02:34:24.088623 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:24.079680    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 04 02:34:24.088623 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:24.079738    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4" podUID="70e41f76-88b7-495d-ba6f-9dc2b0640de1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 04 02:34:24.997025 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:24.996996    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:34:25.088801 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:25.088755    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 04 02:34:25.089277 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:25.088815    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4" podUID="70e41f76-88b7-495d-ba6f-9dc2b0640de1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 04 02:34:25.161865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:25.161828    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"]
Nov 04 02:34:26.088652 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:26.086062    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 04 02:34:26.088652 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:26.086125    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4" podUID="70e41f76-88b7-495d-ba6f-9dc2b0640de1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 04 02:34:27.086622 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:27.079141    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 04 02:34:27.086622 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:27.079206    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4" podUID="70e41f76-88b7-495d-ba6f-9dc2b0640de1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 04 02:34:28.060214 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.060187    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:34:28.078508 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.078473    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 04 02:34:28.078660 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.078519    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4" podUID="70e41f76-88b7-495d-ba6f-9dc2b0640de1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 04 02:34:28.229364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.229334    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"]
Nov 04 02:34:28.233826 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.233803    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.323550 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.323466    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"]
Nov 04 02:34:28.334068 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.334034    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.334773 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.334113    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.334773 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.334146    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frz6s\" (UniqueName: \"kubernetes.io/projected/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-kube-api-access-frz6s\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.334773 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.334225    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.334773 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.334259    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.334773 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.334283    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.334773 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.334362    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.334773 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.334404    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.334773 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.334489    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.435206 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.435166    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.435377 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.435217    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.435377 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.435240    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.435377 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.435306    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.435560 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.435476    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.435973 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.435703    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.436065 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.435983    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.436065 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.436040    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.436065 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.436051    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.436241 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.435856    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.436241 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.435743    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.436241 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.436201    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.436241 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.436221    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.436588 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.436561    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frz6s\" (UniqueName: \"kubernetes.io/projected/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-kube-api-access-frz6s\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.438369 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.438346    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.438624 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.438588    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.494951 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.494917    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.495170 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.495066    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frz6s\" (UniqueName: \"kubernetes.io/projected/acd18f37-52e9-45bb-8b81-ae4f8f64fbcc-kube-api-access-frz6s\") pod \"maas-default-gateway-openshift-default-fd4b99879-785jm\" (UID: \"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:28.550195 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:28.550164    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:29.005205 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:29.004079    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"]
Nov 04 02:34:29.008657 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:34:29.008629    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd18f37_52e9_45bb_8b81_ae4f8f64fbcc.slice/crio-bf4b68c88802b2e6ea5057a2caa6492dcdcb7749b49c747f524ffc3ddfe64849 WatchSource:0}: Error finding container bf4b68c88802b2e6ea5057a2caa6492dcdcb7749b49c747f524ffc3ddfe64849: Status 404 returned error can't find the container with id bf4b68c88802b2e6ea5057a2caa6492dcdcb7749b49c747f524ffc3ddfe64849
Nov 04 02:34:29.011255 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:29.011224    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:34:29.011323 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:29.011286    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:34:29.011323 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:29.011315    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:34:29.083441 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:29.083418    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:29.083845 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:29.083819    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:29.084545 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:29.084530    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:34:29.117925 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:29.117891    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm" event={"ID":"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc","Type":"ContainerStarted","Data":"00168e6a8903713b164636dcee12eb3776499cc8d3d663089f7a5ba3154709aa"}
Nov 04 02:34:29.118092 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:29.117950    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm" event={"ID":"acd18f37-52e9-45bb-8b81-ae4f8f64fbcc","Type":"ContainerStarted","Data":"bf4b68c88802b2e6ea5057a2caa6492dcdcb7749b49c747f524ffc3ddfe64849"}
Nov 04 02:34:29.435640 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:29.435496    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm" podStartSLOduration=1.435422555 podStartE2EDuration="1.435422555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:29.434515464 +0000 UTC m=+1064.938455996" watchObservedRunningTime="2026-11-04 02:34:29.435422555 +0000 UTC m=+1064.939363049"
Nov 04 02:34:29.550982 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:29.550951    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:30.162214 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.162145    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp" podUID="6038f634-c2b8-4a6b-8ebe-dedea694ca42" containerName="payload-processing" containerID="cri-o://65b3607c0b09162eda0e8d80c190af076ff9cd13dc80dc7d9c3a8271a92e3e3f" gracePeriod=25
Nov 04 02:34:30.504562 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.504527    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:34:30.553051 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.553013    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-785jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:30.553246 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.553076    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm" podUID="acd18f37-52e9-45bb-8b81-ae4f8f64fbcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 04 02:34:30.689093 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.689060    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-kube-api-access-rmrfq\" (UniqueName: \"kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-kube-api-access-rmrfq\") pod \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") "
Nov 04 02:34:30.689278 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.689252    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-routing-overlay-volume\") pod \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") "
Nov 04 02:34:30.689363 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.689330    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-plugins-config-volume\") pod \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") "
Nov 04 02:34:30.689425 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.689381    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-provider-credentials\" (UniqueName: \"kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-provider-credentials\") pod \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\" (UID: \"6038f634-c2b8-4a6b-8ebe-dedea694ca42\") "
Nov 04 02:34:30.689901 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.689681    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-routing-overlay-volume" pod "6038f634-c2b8-4a6b-8ebe-dedea694ca42" (UID: "6038f634-c2b8-4a6b-8ebe-dedea694ca42"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:34:30.689901 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.689860    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-plugins-config-volume" pod "6038f634-c2b8-4a6b-8ebe-dedea694ca42" (UID: "6038f634-c2b8-4a6b-8ebe-dedea694ca42"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:34:30.690080 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.690057    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:34:30.690126 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.690086    5450 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/6038f634-c2b8-4a6b-8ebe-dedea694ca42-routing-overlay-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:34:30.691500 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.691469    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-kube-api-access-rmrfq" pod "6038f634-c2b8-4a6b-8ebe-dedea694ca42" (UID: "6038f634-c2b8-4a6b-8ebe-dedea694ca42"). InnerVolumeSpecName "kube-api-access-rmrfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:34:30.691632 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.691577    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-provider-credentials" pod "6038f634-c2b8-4a6b-8ebe-dedea694ca42" (UID: "6038f634-c2b8-4a6b-8ebe-dedea694ca42"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:34:30.792224 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.791751    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmrfq\" (UniqueName: \"kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-kube-api-access-rmrfq\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:34:30.792224 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:30.791787    5450 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/6038f634-c2b8-4a6b-8ebe-dedea694ca42-provider-credentials\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:34:31.132949 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:31.132906    5450 generic.go:356] "Generic (PLEG): container finished" podID="6038f634-c2b8-4a6b-8ebe-dedea694ca42" containerID="65b3607c0b09162eda0e8d80c190af076ff9cd13dc80dc7d9c3a8271a92e3e3f" exitCode=0
Nov 04 02:34:31.133158 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:31.132953    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"
Nov 04 02:34:31.133158 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:31.132990    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp" event={"ID":"6038f634-c2b8-4a6b-8ebe-dedea694ca42","Type":"ContainerDied","Data":"65b3607c0b09162eda0e8d80c190af076ff9cd13dc80dc7d9c3a8271a92e3e3f"}
Nov 04 02:34:31.133158 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:31.133059    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-fc445457d-9qzxp" event={"ID":"6038f634-c2b8-4a6b-8ebe-dedea694ca42","Type":"ContainerDied","Data":"a07c08ba11e6a9229671545f92cc57224fe1a2ba7f9fcd9c9ce43f61f3192874"}
Nov 04 02:34:31.133158 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:31.133090    5450 scope.go:122] "RemoveContainer" containerID="65b3607c0b09162eda0e8d80c190af076ff9cd13dc80dc7d9c3a8271a92e3e3f"
Nov 04 02:34:31.143399 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:31.143384    5450 scope.go:122] "RemoveContainer" containerID="65b3607c0b09162eda0e8d80c190af076ff9cd13dc80dc7d9c3a8271a92e3e3f"
Nov 04 02:34:31.143685 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:34:31.143669    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65b3607c0b09162eda0e8d80c190af076ff9cd13dc80dc7d9c3a8271a92e3e3f\": container with ID starting with 65b3607c0b09162eda0e8d80c190af076ff9cd13dc80dc7d9c3a8271a92e3e3f not found: ID does not exist" containerID="65b3607c0b09162eda0e8d80c190af076ff9cd13dc80dc7d9c3a8271a92e3e3f"
Nov 04 02:34:31.143741 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:31.143692    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65b3607c0b09162eda0e8d80c190af076ff9cd13dc80dc7d9c3a8271a92e3e3f"} err="failed to get container status \"65b3607c0b09162eda0e8d80c190af076ff9cd13dc80dc7d9c3a8271a92e3e3f\": rpc error: code = NotFound desc = could not find container \"65b3607c0b09162eda0e8d80c190af076ff9cd13dc80dc7d9c3a8271a92e3e3f\": container with ID starting with 65b3607c0b09162eda0e8d80c190af076ff9cd13dc80dc7d9c3a8271a92e3e3f not found: ID does not exist"
Nov 04 02:34:31.296748 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:31.296714    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"]
Nov 04 02:34:31.344429 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:31.344398    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["models-as-a-service/payload-processing-external-model-fc445457d-9qzxp"]
Nov 04 02:34:31.551485 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:31.551452    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-785jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:31.551687 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:31.551509    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm" podUID="acd18f37-52e9-45bb-8b81-ae4f8f64fbcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 04 02:34:32.550822 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:32.550788    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-785jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:32.551219 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:32.550841    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm" podUID="acd18f37-52e9-45bb-8b81-ae4f8f64fbcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 04 02:34:32.633358 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:32.633323    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6038f634-c2b8-4a6b-8ebe-dedea694ca42" path="/var/lib/kubelet/pods/6038f634-c2b8-4a6b-8ebe-dedea694ca42/volumes"
Nov 04 02:34:33.551005 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:33.550970    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-785jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:33.551370 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:33.551025    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm" podUID="acd18f37-52e9-45bb-8b81-ae4f8f64fbcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 04 02:34:34.550882 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:34.550846    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-785jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:34.551061 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:34.550904    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm" podUID="acd18f37-52e9-45bb-8b81-ae4f8f64fbcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 04 02:34:35.551412 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:35.551377    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-785jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:35.551827 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:35.551430    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm" podUID="acd18f37-52e9-45bb-8b81-ae4f8f64fbcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 04 02:34:36.551012 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:36.550975    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-785jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:36.551192 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:36.551028    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm" podUID="acd18f37-52e9-45bb-8b81-ae4f8f64fbcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 04 02:34:37.640082 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:37.640047    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:37.640696 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:37.640675    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:37.641571 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:37.641549    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-785jm"
Nov 04 02:34:39.322513 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.322481    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"]
Nov 04 02:34:39.323251 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.323228    5450 cpu_manager.go:414] "containerMap: removing container" podUID="6038f634-c2b8-4a6b-8ebe-dedea694ca42" containerName="payload-processing"
Nov 04 02:34:39.323251 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.323249    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6038f634-c2b8-4a6b-8ebe-dedea694ca42" containerName="payload-processing"
Nov 04 02:34:39.323453 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.323435    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="6038f634-c2b8-4a6b-8ebe-dedea694ca42" containerName="payload-processing"
Nov 04 02:34:39.328573 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.328555    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:39.382815 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.382783    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"]
Nov 04 02:34:39.395266 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.395232    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-plugins-config-volume\") pod \"payload-processing-external-model-6945776df8-p4k5q\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") " pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:39.395454 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.395436    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-provider-credentials\") pod \"payload-processing-external-model-6945776df8-p4k5q\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") " pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:39.395558 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.395540    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqm64\" (UniqueName: \"kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-kube-api-access-hqm64\") pod \"payload-processing-external-model-6945776df8-p4k5q\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") " pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:39.395651 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.395577    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-routing-overlay-volume\") pod \"payload-processing-external-model-6945776df8-p4k5q\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") " pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:39.496334 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.496294    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-provider-credentials\") pod \"payload-processing-external-model-6945776df8-p4k5q\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") " pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:39.496544 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.496355    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqm64\" (UniqueName: \"kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-kube-api-access-hqm64\") pod \"payload-processing-external-model-6945776df8-p4k5q\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") " pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:39.496544 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.496379    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-routing-overlay-volume\") pod \"payload-processing-external-model-6945776df8-p4k5q\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") " pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:39.496544 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.496490    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-plugins-config-volume\") pod \"payload-processing-external-model-6945776df8-p4k5q\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") " pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:39.497137 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.497114    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-routing-overlay-volume\") pod \"payload-processing-external-model-6945776df8-p4k5q\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") " pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:39.497195 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.497166    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-plugins-config-volume\") pod \"payload-processing-external-model-6945776df8-p4k5q\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") " pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:39.498796 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.498763    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-provider-credentials\") pod \"payload-processing-external-model-6945776df8-p4k5q\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") " pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:39.566056 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.566019    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqm64\" (UniqueName: \"kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-kube-api-access-hqm64\") pod \"payload-processing-external-model-6945776df8-p4k5q\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") " pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:39.641928 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:39.641847    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:40.015516 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:40.015478    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"]
Nov 04 02:34:40.020469 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:34:40.020440    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2901ec24_f190_44a2_a184_567d846d4b2e.slice/crio-78b4d50d94010f2922abdc736fec19fe375b26ebf02e1760f6eaf24ca8e34ee9 WatchSource:0}: Error finding container 78b4d50d94010f2922abdc736fec19fe375b26ebf02e1760f6eaf24ca8e34ee9: Status 404 returned error can't find the container with id 78b4d50d94010f2922abdc736fec19fe375b26ebf02e1760f6eaf24ca8e34ee9
Nov 04 02:34:40.194979 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:40.194942    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" event={"ID":"2901ec24-f190-44a2-a184-567d846d4b2e","Type":"ContainerStarted","Data":"db7b42ab1b15193bc8339e8f3f0bfb8f48b7e63b732b87e01a08584afd8924db"}
Nov 04 02:34:40.195149 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:40.194993    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" event={"ID":"2901ec24-f190-44a2-a184-567d846d4b2e","Type":"ContainerStarted","Data":"78b4d50d94010f2922abdc736fec19fe375b26ebf02e1760f6eaf24ca8e34ee9"}
Nov 04 02:34:40.195149 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:40.195029    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:34:40.311049 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:40.310956    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podStartSLOduration=1.310942405 podStartE2EDuration="1.310942405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:40.308868337 +0000 UTC m=+1075.812808831" watchObservedRunningTime="2026-11-04 02:34:40.310942405 +0000 UTC m=+1075.814882898"
Nov 04 02:34:47.765223 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:34:47.765190    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:34:50.145171 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:50.145135    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:34:51.204439 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:51.204407    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:34:58.166461 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.166374    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"]
Nov 04 02:34:58.176573 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.176540    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:58.188648 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.188619    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gnlr\" (UniqueName: \"kubernetes.io/projected/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-kube-api-access-8gnlr\") pod \"maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:58.188779 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.188748    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-metrics-certs\") pod \"maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:58.188845 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.188822    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-maas-api-tls\") pod \"maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:58.188908 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.188897    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:58.229955 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.229925    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-b-d501fd-serving-cert\""
Nov 04 02:34:58.280819 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.280788    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"]
Nov 04 02:34:58.290169 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.290143    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-metrics-certs\") pod \"maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:58.290313 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.290201    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-maas-api-tls\") pod \"maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:58.290313 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.290303    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:58.290422 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:34:58.290386    5450 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-serving-cert: secret "maas-api-e2e-extmod-b-d501fd-serving-cert" not found
Nov 04 02:34:58.290422 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.290395    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gnlr\" (UniqueName: \"kubernetes.io/projected/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-kube-api-access-8gnlr\") pod \"maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:58.290523 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:34:58.290447    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-maas-api-tls podName:6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01 nodeName:}" failed. No retries permitted until 2026-11-04 02:34:58.790427314 +0000 UTC m=+1094.294367805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-maas-api-tls") pod "maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9" (UID: "6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01") : secret "maas-api-e2e-extmod-b-d501fd-serving-cert" not found
Nov 04 02:34:58.291055 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.291037    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:58.292579 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.292562    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-metrics-certs\") pod \"maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:58.366092 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.366054    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gnlr\" (UniqueName: \"kubernetes.io/projected/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-kube-api-access-8gnlr\") pod \"maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:58.796765 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.796730    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-maas-api-tls\") pod \"maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:58.799127 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:58.799099    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-maas-api-tls\") pod \"maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:59.091631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:59.091544    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:34:59.465392 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:34:59.465305    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"]
Nov 04 02:34:59.470128 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:34:59.470101    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa1a4af_491d_4f1e_bd95_e3e02d0c9c01.slice/crio-ec9426300b6f5b31a04bd259edf16538ca968f6588d11ef3e997c342711db836 WatchSource:0}: Error finding container ec9426300b6f5b31a04bd259edf16538ca968f6588d11ef3e997c342711db836: Status 404 returned error can't find the container with id ec9426300b6f5b31a04bd259edf16538ca968f6588d11ef3e997c342711db836
Nov 04 02:35:00.376811 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:00.376777    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9" event={"ID":"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01","Type":"ContainerStarted","Data":"ec9426300b6f5b31a04bd259edf16538ca968f6588d11ef3e997c342711db836"}
Nov 04 02:35:01.202933 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:01.202894    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:35:01.395320 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:01.395276    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9" event={"ID":"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01","Type":"ContainerStarted","Data":"7ecfa042124b085470cd8561a93eadb43f21adc00e04e7d6cc7522694f25cac6"}
Nov 04 02:35:01.395507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:01.395384    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:35:01.514416 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:01.514362    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9" podStartSLOduration=2.458092868 podStartE2EDuration="3.514347654s" totalImagesPullingTime="1.056254786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:35:01.511612836 +0000 UTC m=+1097.015553329" watchObservedRunningTime="2026-11-04 02:35:01.514347654 +0000 UTC m=+1097.018288147"
Nov 04 02:35:07.407950 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:07.407918    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:35:11.202746 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:11.202703    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:35:13.577936 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.577903    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"]
Nov 04 02:35:13.584107 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.584080    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.667884 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.667852    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.668042 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.667958    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.668042 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.667988    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.668042 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.668008    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.668209 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.668119    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.668209 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.668177    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.668309 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.668240    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.668361 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.668350    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.668413 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.668390    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2s7h\" (UniqueName: \"kubernetes.io/projected/3a57cd78-39fc-48ca-b789-a64ea82c12dd-kube-api-access-d2s7h\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.769236 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.769201    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.769413 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.769248    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2s7h\" (UniqueName: \"kubernetes.io/projected/3a57cd78-39fc-48ca-b789-a64ea82c12dd-kube-api-access-d2s7h\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.769413 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.769285    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.769413 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.769335    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.769413 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.769368    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.769729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.769412    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.769729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.769503    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.769729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.769564    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.769729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.769624    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.769937 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.769721    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.769937 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.769763    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.769937 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.769804    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.770066 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.769959    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.770259 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.770233    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.771813 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.771793    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.771910 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.771855    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.782155 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.782133    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"]
Nov 04 02:35:13.829239 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.829177    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a57cd78-39fc-48ca-b789-a64ea82c12dd-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.829408 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.829385    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2s7h\" (UniqueName: \"kubernetes.io/projected/3a57cd78-39fc-48ca-b789-a64ea82c12dd-kube-api-access-d2s7h\") pod \"maas-default-gateway-openshift-default-fd4b99879-gdn98\" (UID: \"3a57cd78-39fc-48ca-b789-a64ea82c12dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:13.898246 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:13.898219    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:14.327088 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:14.327059    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"]
Nov 04 02:35:14.331098 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:35:14.331067    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a57cd78_39fc_48ca_b789_a64ea82c12dd.slice/crio-8ff70c217ce544750c0edfc978cce5b1d0c9c8f137f6e1b2661df9ea18185b35 WatchSource:0}: Error finding container 8ff70c217ce544750c0edfc978cce5b1d0c9c8f137f6e1b2661df9ea18185b35: Status 404 returned error can't find the container with id 8ff70c217ce544750c0edfc978cce5b1d0c9c8f137f6e1b2661df9ea18185b35
Nov 04 02:35:14.333454 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:14.333412    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:35:14.333534 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:14.333502    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:35:14.333569 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:14.333534    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:35:14.482284 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:14.482242    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98" event={"ID":"3a57cd78-39fc-48ca-b789-a64ea82c12dd","Type":"ContainerStarted","Data":"91e31d562df1ba6fcb1b7bcba60fe9568f6cde68e0ed928d7f528d6b9bf9e60c"}
Nov 04 02:35:14.482471 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:14.482299    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98" event={"ID":"3a57cd78-39fc-48ca-b789-a64ea82c12dd","Type":"ContainerStarted","Data":"8ff70c217ce544750c0edfc978cce5b1d0c9c8f137f6e1b2661df9ea18185b35"}
Nov 04 02:35:14.604652 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:14.604528    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98" podStartSLOduration=1.604514747 podStartE2EDuration="1.604514747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:35:14.602128207 +0000 UTC m=+1110.106068737" watchObservedRunningTime="2026-11-04 02:35:14.604514747 +0000 UTC m=+1110.108455240"
Nov 04 02:35:14.898743 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:14.898663    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:15.900337 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:15.900301    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-gdn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Nov 04 02:35:15.900762 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:15.900359    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98" podUID="3a57cd78-39fc-48ca-b789-a64ea82c12dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Nov 04 02:35:16.898580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:16.898544    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-gdn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Nov 04 02:35:16.898754 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:16.898610    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98" podUID="3a57cd78-39fc-48ca-b789-a64ea82c12dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Nov 04 02:35:17.773933 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:17.773892    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:35:17.898908 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:17.898874    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-gdn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Nov 04 02:35:17.899081 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:17.898934    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98" podUID="3a57cd78-39fc-48ca-b789-a64ea82c12dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Nov 04 02:35:18.898715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:18.898679    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-gdn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Nov 04 02:35:18.899092 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:18.898731    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98" podUID="3a57cd78-39fc-48ca-b789-a64ea82c12dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Nov 04 02:35:19.898574 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:19.898538    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-gdn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Nov 04 02:35:19.898775 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:19.898615    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98" podUID="3a57cd78-39fc-48ca-b789-a64ea82c12dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Nov 04 02:35:20.898853 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:20.898814    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-gdn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Nov 04 02:35:20.899342 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:20.898871    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98" podUID="3a57cd78-39fc-48ca-b789-a64ea82c12dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Nov 04 02:35:21.202456 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:21.202376    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:35:21.899135 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:21.899102    5450 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-gdn98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Nov 04 02:35:21.899520 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:21.899159    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98" podUID="3a57cd78-39fc-48ca-b789-a64ea82c12dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Nov 04 02:35:23.034855 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:23.034821    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:23.035362 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:23.035299    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:23.036053 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:23.036033    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-gdn98"
Nov 04 02:35:31.202707 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.202670    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:35:31.383760 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.383721    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"]
Nov 04 02:35:31.388508 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.388490    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.495242 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.495154    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.495404 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.495321    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4zzz\" (UniqueName: \"kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-kube-api-access-d4zzz\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.495404 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.495363    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.495404 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.495390    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.495660 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.495485    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.495660 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.495524    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.495791 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.495685    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.495791 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.495754    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.495900 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.495789    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.502335 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.502311    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"]
Nov 04 02:35:31.596718 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.596687    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.596877 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.596756    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.596877 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.596788    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.596877 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.596821    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.597010 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.596902    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4zzz\" (UniqueName: \"kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-kube-api-access-d4zzz\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.597010 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.596929    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.597010 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.596956    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.597151 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.597113    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.597210 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.597178    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.597288 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.597265    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.597671 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.597635    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.597816 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.597686    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.597892 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.597831    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.597959 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.597940    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.599388 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.599349    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.599714 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.599689    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.661716 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.661688    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.661888 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.661690    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4zzz\" (UniqueName: \"kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-kube-api-access-d4zzz\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:31.702893 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:31.702852    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:32.152963 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:32.152877    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"]
Nov 04 02:35:32.156727 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:35:32.156697    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d094a5_ed9d_4d2f_821d_72c8826994e0.slice/crio-272d301bfd19eb9f0e0e83d8482019ef32f3c6d66b926dca5555aa0882017ad2 WatchSource:0}: Error finding container 272d301bfd19eb9f0e0e83d8482019ef32f3c6d66b926dca5555aa0882017ad2: Status 404 returned error can't find the container with id 272d301bfd19eb9f0e0e83d8482019ef32f3c6d66b926dca5555aa0882017ad2
Nov 04 02:35:32.159305 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:32.159274    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:35:32.159386 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:32.159335    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:35:32.159386 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:32.159364    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:35:32.615909 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:32.615873    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4" event={"ID":"c7d094a5-ed9d-4d2f-821d-72c8826994e0","Type":"ContainerStarted","Data":"6b747cb73f48be7f98b9d8f16482a68e8b101263935b16231e333256e3cf8f1d"}
Nov 04 02:35:32.616270 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:32.615929    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4" event={"ID":"c7d094a5-ed9d-4d2f-821d-72c8826994e0","Type":"ContainerStarted","Data":"272d301bfd19eb9f0e0e83d8482019ef32f3c6d66b926dca5555aa0882017ad2"}
Nov 04 02:35:32.703251 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:32.703208    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:32.746608 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:32.746548    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4" podStartSLOduration=1.74652933 podStartE2EDuration="1.74652933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:35:32.7461357 +0000 UTC m=+1128.250076233" watchObservedRunningTime="2026-11-04 02:35:32.74652933 +0000 UTC m=+1128.250469828"
Nov 04 02:35:33.705699 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:33.705656    5450 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:33.706104 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:33.705716    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4" podUID="c7d094a5-ed9d-4d2f-821d-72c8826994e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 04 02:35:34.703349 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:34.703313    5450 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:34.703533 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:34.703377    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4" podUID="c7d094a5-ed9d-4d2f-821d-72c8826994e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 04 02:35:35.704025 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:35.703989    5450 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:35.704516 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:35.704049    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4" podUID="c7d094a5-ed9d-4d2f-821d-72c8826994e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 04 02:35:36.703442 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:36.703407    5450 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:36.703642 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:36.703459    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4" podUID="c7d094a5-ed9d-4d2f-821d-72c8826994e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 04 02:35:37.703336 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:37.703303    5450 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:37.703814 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:37.703352    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4" podUID="c7d094a5-ed9d-4d2f-821d-72c8826994e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 04 02:35:38.703638 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:38.703608    5450 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:38.704016 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:38.703661    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4" podUID="c7d094a5-ed9d-4d2f-821d-72c8826994e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 04 02:35:39.720326 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:39.720292    5450 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-a369bc8f7d56: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:39.720326 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:39.720322    5450 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:39.720897 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:39.720393    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials podName:205307f9-b34c-4a63-925e-425314b48e36 nodeName:}" failed. No retries permitted until 2026-11-04 02:35:40.220372596 +0000 UTC m=+1135.724313068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials") pod "payload-processing-external-model-66ccc7f677-72xcm" (UID: "205307f9-b34c-4a63-925e-425314b48e36") : secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:40.226579 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:40.226542    5450 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-a369bc8f7d56: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:40.226579 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:40.226572    5450 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:40.229040 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:40.226664    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials podName:205307f9-b34c-4a63-925e-425314b48e36 nodeName:}" failed. No retries permitted until 2026-11-04 02:35:41.226640538 +0000 UTC m=+1136.730581030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials") pod "payload-processing-external-model-66ccc7f677-72xcm" (UID: "205307f9-b34c-4a63-925e-425314b48e36") : secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:40.704771 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:40.704727    5450 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 02:35:40.704959 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:40.704805    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4" podUID="c7d094a5-ed9d-4d2f-821d-72c8826994e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:35:40.715500 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:40.715466    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:40.715931 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:40.715883    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:40.716635 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:40.716616    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:41.202819 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:41.202776    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:35:41.238784 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:41.238754    5450 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-a369bc8f7d56: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:41.238784 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:41.238778    5450 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:41.238973 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:41.238828    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials podName:205307f9-b34c-4a63-925e-425314b48e36 nodeName:}" failed. No retries permitted until 2026-11-04 02:35:43.238812124 +0000 UTC m=+1138.742752596 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials") pod "payload-processing-external-model-66ccc7f677-72xcm" (UID: "205307f9-b34c-4a63-925e-425314b48e36") : secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:43.262703 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:43.262673    5450 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-a369bc8f7d56: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:43.262703 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:43.262697    5450 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:43.263122 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:43.262752    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials podName:205307f9-b34c-4a63-925e-425314b48e36 nodeName:}" failed. No retries permitted until 2026-11-04 02:35:47.262739707 +0000 UTC m=+1142.766680179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials") pod "payload-processing-external-model-66ccc7f677-72xcm" (UID: "205307f9-b34c-4a63-925e-425314b48e36") : secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:43.627264 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:43.627176    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:35:46.451318 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.451282    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:35:46.491829 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.491793    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"]
Nov 04 02:35:46.497053 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.497030    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.562154 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.562119    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"]
Nov 04 02:35:46.604386 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.604354    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.604386 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.604398    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.604592 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.604523    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.604592 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.604548    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.604592 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.604568    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.604700 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.604659    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.604736 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.604718    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36d70e82-e32d-4b63-a95e-009eb6439f25-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.604769 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.604743    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dckm\" (UniqueName: \"kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-kube-api-access-6dckm\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.604802 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.604777    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.706114 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.706018    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.706114 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.706079    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.706362 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.706114    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.706362 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.706211    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.706362 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.706240    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36d70e82-e32d-4b63-a95e-009eb6439f25-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.706362 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.706296    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dckm\" (UniqueName: \"kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-kube-api-access-6dckm\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.706569 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.706366    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.706569 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.706493    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.706569 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.706561    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.706772 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.706590    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.706772 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.706678    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.706958 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.706931    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.707244 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.707221    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.707827 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.707807    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36d70e82-e32d-4b63-a95e-009eb6439f25-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.708975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.708948    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.709178 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.709160    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.765716 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.765687    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.765975 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.765955    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dckm\" (UniqueName: \"kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-kube-api-access-6dckm\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.812535 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.812512    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:46.917780 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.917747    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"]
Nov 04 02:35:46.918052 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.917991    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv" podUID="a0ff1c4a-3d73-45b2-adb9-44fd034306b6" containerName="istio-proxy" containerID="cri-o://1d9b6323c0c0bd031855d57f00d15ea0a9f60fefa58d040eeaf66efc4aa53055" gracePeriod=30
Nov 04 02:35:46.925608 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.925414    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"]
Nov 04 02:35:46.926564 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.926532    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4" podUID="c7d094a5-ed9d-4d2f-821d-72c8826994e0" containerName="istio-proxy" containerID="cri-o://6b747cb73f48be7f98b9d8f16482a68e8b101263935b16231e333256e3cf8f1d" gracePeriod=30
Nov 04 02:35:46.949396 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:46.949363    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"]
Nov 04 02:35:47.249131 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:47.249102    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"]
Nov 04 02:35:47.254181 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:35:47.254156    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d70e82_e32d_4b63_a95e_009eb6439f25.slice/crio-c2e37f0d59475600c51c795fe005754182dd01eec23497741aebb5cc5c7f024d WatchSource:0}: Error finding container c2e37f0d59475600c51c795fe005754182dd01eec23497741aebb5cc5c7f024d: Status 404 returned error can't find the container with id c2e37f0d59475600c51c795fe005754182dd01eec23497741aebb5cc5c7f024d
Nov 04 02:35:47.256911 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:47.256867    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:35:47.257022 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:47.256962    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:35:47.257022 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:47.257005    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:35:47.315760 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:47.315734    5450 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-a369bc8f7d56: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:47.315760 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:47.315761    5450 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:47.315993 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:47.315834    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials podName:205307f9-b34c-4a63-925e-425314b48e36 nodeName:}" failed. No retries permitted until 2026-11-04 02:35:55.315813543 +0000 UTC m=+1150.819754036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials") pod "payload-processing-external-model-66ccc7f677-72xcm" (UID: "205307f9-b34c-4a63-925e-425314b48e36") : secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:47.751616 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:47.750335    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6" event={"ID":"36d70e82-e32d-4b63-a95e-009eb6439f25","Type":"ContainerStarted","Data":"57fc108b5c848a390726cb998e3b6f505e643c1efb55089fa3e5f7bfa325163d"}
Nov 04 02:35:47.751616 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:47.750402    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6" event={"ID":"36d70e82-e32d-4b63-a95e-009eb6439f25","Type":"ContainerStarted","Data":"c2e37f0d59475600c51c795fe005754182dd01eec23497741aebb5cc5c7f024d"}
Nov 04 02:35:47.751616 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:47.750564    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6" podUID="36d70e82-e32d-4b63-a95e-009eb6439f25" containerName="istio-proxy" containerID="cri-o://57fc108b5c848a390726cb998e3b6f505e643c1efb55089fa3e5f7bfa325163d" gracePeriod=30
Nov 04 02:35:47.792269 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:47.792187    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:35:47.872531 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:47.872461    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6" podStartSLOduration=1.872439348 podStartE2EDuration="1.872439348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:35:47.868737371 +0000 UTC m=+1143.372677878" watchObservedRunningTime="2026-11-04 02:35:47.872439348 +0000 UTC m=+1143.376379843"
Nov 04 02:35:52.216065 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.216041    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:52.222068 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.222047    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:35:52.301749 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.301722    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-socket\") pod \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") "
Nov 04 02:35:52.301889 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.301763    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-envoy\") pod \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") "
Nov 04 02:35:52.301889 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.301784    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-data\") pod \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") "
Nov 04 02:35:52.301889 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.301842    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-credential-socket\") pod \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") "
Nov 04 02:35:52.301889 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.301880    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-token\" (UniqueName: \"kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-token\") pod \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") "
Nov 04 02:35:52.302093 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.301952    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-data\") pod \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") "
Nov 04 02:35:52.302093 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.301983    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-token\" (UniqueName: \"kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-token\") pod \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") "
Nov 04 02:35:52.302093 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.301991    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-socket" pod "c7d094a5-ed9d-4d2f-821d-72c8826994e0" (UID: "c7d094a5-ed9d-4d2f-821d-72c8826994e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.302093 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.302037    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istiod-ca-cert\") pod \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") "
Nov 04 02:35:52.302317 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.302118    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-envoy\") pod \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") "
Nov 04 02:35:52.302317 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.302191    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-data" pod "a0ff1c4a-3d73-45b2-adb9-44fd034306b6" (UID: "a0ff1c4a-3d73-45b2-adb9-44fd034306b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.302317 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.302201    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-podinfo\") pod \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") "
Nov 04 02:35:52.302317 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.302235    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-kube-api-access-d4zzz\" (UniqueName: \"kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-kube-api-access-d4zzz\") pod \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") "
Nov 04 02:35:52.302317 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.302292    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-certs\") pod \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") "
Nov 04 02:35:52.302555 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.302501    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-kube-api-access-t7dlq\" (UniqueName: \"kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-kube-api-access-t7dlq\") pod \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") "
Nov 04 02:35:52.302633 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.302559    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-certs\") pod \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") "
Nov 04 02:35:52.302633 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.302588    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-credential-socket\") pod \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") "
Nov 04 02:35:52.302748 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.302635    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-podinfo\") pod \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\" (UID: \"c7d094a5-ed9d-4d2f-821d-72c8826994e0\") "
Nov 04 02:35:52.302748 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.302689    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istiod-ca-cert\") pod \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") "
Nov 04 02:35:52.302848 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.302749    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-socket\") pod \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\" (UID: \"a0ff1c4a-3d73-45b2-adb9-44fd034306b6\") "
Nov 04 02:35:52.303136 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.303079    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-credential-socket" pod "a0ff1c4a-3d73-45b2-adb9-44fd034306b6" (UID: "a0ff1c4a-3d73-45b2-adb9-44fd034306b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.303316 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.303291    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-certs" pod "a0ff1c4a-3d73-45b2-adb9-44fd034306b6" (UID: "a0ff1c4a-3d73-45b2-adb9-44fd034306b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.303430 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.303302    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-socket" pod "a0ff1c4a-3d73-45b2-adb9-44fd034306b6" (UID: "a0ff1c4a-3d73-45b2-adb9-44fd034306b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.303578 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.303559    5450 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-data\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.303700 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.303583    5450 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.303700 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.303635    5450 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-credential-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.303700 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.303653    5450 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-workload-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.303700 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.303667    5450 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.303700 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.303580    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istiod-ca-cert" pod "a0ff1c4a-3d73-45b2-adb9-44fd034306b6" (UID: "a0ff1c4a-3d73-45b2-adb9-44fd034306b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:52.304450 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.304425    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-envoy" pod "c7d094a5-ed9d-4d2f-821d-72c8826994e0" (UID: "c7d094a5-ed9d-4d2f-821d-72c8826994e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.304613 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.304577    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-envoy" pod "a0ff1c4a-3d73-45b2-adb9-44fd034306b6" (UID: "a0ff1c4a-3d73-45b2-adb9-44fd034306b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.304745 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.304730    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-podinfo" pod "a0ff1c4a-3d73-45b2-adb9-44fd034306b6" (UID: "a0ff1c4a-3d73-45b2-adb9-44fd034306b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:35:52.304833 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.304809    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-credential-socket" pod "c7d094a5-ed9d-4d2f-821d-72c8826994e0" (UID: "c7d094a5-ed9d-4d2f-821d-72c8826994e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.305047 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.305007    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-data" pod "c7d094a5-ed9d-4d2f-821d-72c8826994e0" (UID: "c7d094a5-ed9d-4d2f-821d-72c8826994e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.305186 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.305140    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-certs" pod "c7d094a5-ed9d-4d2f-821d-72c8826994e0" (UID: "c7d094a5-ed9d-4d2f-821d-72c8826994e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.305281 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.305183    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istiod-ca-cert" pod "c7d094a5-ed9d-4d2f-821d-72c8826994e0" (UID: "c7d094a5-ed9d-4d2f-821d-72c8826994e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:52.305281 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.305246    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-token" pod "a0ff1c4a-3d73-45b2-adb9-44fd034306b6" (UID: "a0ff1c4a-3d73-45b2-adb9-44fd034306b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.305615 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.305572    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-kube-api-access-t7dlq" pod "a0ff1c4a-3d73-45b2-adb9-44fd034306b6" (UID: "a0ff1c4a-3d73-45b2-adb9-44fd034306b6"). InnerVolumeSpecName "kube-api-access-t7dlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.306780 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.306760    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-podinfo" pod "c7d094a5-ed9d-4d2f-821d-72c8826994e0" (UID: "c7d094a5-ed9d-4d2f-821d-72c8826994e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:35:52.306874 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.306856    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-kube-api-access-d4zzz" pod "c7d094a5-ed9d-4d2f-821d-72c8826994e0" (UID: "c7d094a5-ed9d-4d2f-821d-72c8826994e0"). InnerVolumeSpecName "kube-api-access-d4zzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.307080 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.307064    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-token" pod "c7d094a5-ed9d-4d2f-821d-72c8826994e0" (UID: "c7d094a5-ed9d-4d2f-821d-72c8826994e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.405342 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.405305    5450 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istiod-ca-cert\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.405342 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.405343    5450 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-envoy\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.405584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.405358    5450 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-podinfo\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.405584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.405388    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4zzz\" (UniqueName: \"kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-kube-api-access-d4zzz\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.405584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.405406    5450 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-workload-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.405584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.405420    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7dlq\" (UniqueName: \"kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-kube-api-access-t7dlq\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.405584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.405432    5450 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-podinfo\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.405584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.405445    5450 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istiod-ca-cert\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.405584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.405465    5450 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-envoy\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.405584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.405478    5450 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-data\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.405584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.405491    5450 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7d094a5-ed9d-4d2f-821d-72c8826994e0-credential-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.405584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.405506    5450 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0ff1c4a-3d73-45b2-adb9-44fd034306b6-istio-token\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.405584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.405518    5450 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7d094a5-ed9d-4d2f-821d-72c8826994e0-istio-token\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.785459 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.785420    5450 generic.go:356] "Generic (PLEG): container finished" podID="a0ff1c4a-3d73-45b2-adb9-44fd034306b6" containerID="1d9b6323c0c0bd031855d57f00d15ea0a9f60fefa58d040eeaf66efc4aa53055" exitCode=0
Nov 04 02:35:52.785675 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.785489    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"
Nov 04 02:35:52.785675 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.785493    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv" event={"ID":"a0ff1c4a-3d73-45b2-adb9-44fd034306b6","Type":"ContainerDied","Data":"1d9b6323c0c0bd031855d57f00d15ea0a9f60fefa58d040eeaf66efc4aa53055"}
Nov 04 02:35:52.785675 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.785555    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv" event={"ID":"a0ff1c4a-3d73-45b2-adb9-44fd034306b6","Type":"ContainerDied","Data":"c6587dda17441b017a15a1b1e0448e1e9096fd513f01cab8a17c6e0550c642cc"}
Nov 04 02:35:52.785675 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.785571    5450 scope.go:122] "RemoveContainer" containerID="1d9b6323c0c0bd031855d57f00d15ea0a9f60fefa58d040eeaf66efc4aa53055"
Nov 04 02:35:52.787286 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.787258    5450 generic.go:356] "Generic (PLEG): container finished" podID="c7d094a5-ed9d-4d2f-821d-72c8826994e0" containerID="6b747cb73f48be7f98b9d8f16482a68e8b101263935b16231e333256e3cf8f1d" exitCode=0
Nov 04 02:35:52.787397 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.787293    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"
Nov 04 02:35:52.787397 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.787342    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4" event={"ID":"c7d094a5-ed9d-4d2f-821d-72c8826994e0","Type":"ContainerDied","Data":"6b747cb73f48be7f98b9d8f16482a68e8b101263935b16231e333256e3cf8f1d"}
Nov 04 02:35:52.787397 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.787382    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4" event={"ID":"c7d094a5-ed9d-4d2f-821d-72c8826994e0","Type":"ContainerDied","Data":"272d301bfd19eb9f0e0e83d8482019ef32f3c6d66b926dca5555aa0882017ad2"}
Nov 04 02:35:52.864835 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.864814    5450 scope.go:122] "RemoveContainer" containerID="1d9b6323c0c0bd031855d57f00d15ea0a9f60fefa58d040eeaf66efc4aa53055"
Nov 04 02:35:52.865181 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:52.865161    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d9b6323c0c0bd031855d57f00d15ea0a9f60fefa58d040eeaf66efc4aa53055\": container with ID starting with 1d9b6323c0c0bd031855d57f00d15ea0a9f60fefa58d040eeaf66efc4aa53055 not found: ID does not exist" containerID="1d9b6323c0c0bd031855d57f00d15ea0a9f60fefa58d040eeaf66efc4aa53055"
Nov 04 02:35:52.865229 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.865191    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9b6323c0c0bd031855d57f00d15ea0a9f60fefa58d040eeaf66efc4aa53055"} err="failed to get container status \"1d9b6323c0c0bd031855d57f00d15ea0a9f60fefa58d040eeaf66efc4aa53055\": rpc error: code = NotFound desc = could not find container \"1d9b6323c0c0bd031855d57f00d15ea0a9f60fefa58d040eeaf66efc4aa53055\": container with ID starting with 1d9b6323c0c0bd031855d57f00d15ea0a9f60fefa58d040eeaf66efc4aa53055 not found: ID does not exist"
Nov 04 02:35:52.865229 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.865209    5450 scope.go:122] "RemoveContainer" containerID="6b747cb73f48be7f98b9d8f16482a68e8b101263935b16231e333256e3cf8f1d"
Nov 04 02:35:52.874827 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.874805    5450 scope.go:122] "RemoveContainer" containerID="6b747cb73f48be7f98b9d8f16482a68e8b101263935b16231e333256e3cf8f1d"
Nov 04 02:35:52.875135 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:52.875117    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b747cb73f48be7f98b9d8f16482a68e8b101263935b16231e333256e3cf8f1d\": container with ID starting with 6b747cb73f48be7f98b9d8f16482a68e8b101263935b16231e333256e3cf8f1d not found: ID does not exist" containerID="6b747cb73f48be7f98b9d8f16482a68e8b101263935b16231e333256e3cf8f1d"
Nov 04 02:35:52.875197 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.875143    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b747cb73f48be7f98b9d8f16482a68e8b101263935b16231e333256e3cf8f1d"} err="failed to get container status \"6b747cb73f48be7f98b9d8f16482a68e8b101263935b16231e333256e3cf8f1d\": rpc error: code = NotFound desc = could not find container \"6b747cb73f48be7f98b9d8f16482a68e8b101263935b16231e333256e3cf8f1d\": container with ID starting with 6b747cb73f48be7f98b9d8f16482a68e8b101263935b16231e333256e3cf8f1d not found: ID does not exist"
Nov 04 02:35:52.951053 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.951017    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"]
Nov 04 02:35:52.979364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:52.967425    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4s2mv"]
Nov 04 02:35:53.019829 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.019805    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:53.062501 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.062465    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"]
Nov 04 02:35:53.070910 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.070885    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-x5dz4"]
Nov 04 02:35:53.115924 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.115894    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-token\" (UniqueName: \"kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-token\") pod \"36d70e82-e32d-4b63-a95e-009eb6439f25\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") "
Nov 04 02:35:53.116051 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.115937    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-socket\") pod \"36d70e82-e32d-4b63-a95e-009eb6439f25\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") "
Nov 04 02:35:53.116051 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.115988    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-credential-socket\") pod \"36d70e82-e32d-4b63-a95e-009eb6439f25\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") "
Nov 04 02:35:53.116051 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116025    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-certs\") pod \"36d70e82-e32d-4b63-a95e-009eb6439f25\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") "
Nov 04 02:35:53.116198 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116094    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-data\") pod \"36d70e82-e32d-4b63-a95e-009eb6439f25\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") "
Nov 04 02:35:53.116198 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116135    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-envoy\") pod \"36d70e82-e32d-4b63-a95e-009eb6439f25\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") "
Nov 04 02:35:53.116198 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116168    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-podinfo\") pod \"36d70e82-e32d-4b63-a95e-009eb6439f25\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") "
Nov 04 02:35:53.116346 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116196    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-kube-api-access-6dckm\" (UniqueName: \"kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-kube-api-access-6dckm\") pod \"36d70e82-e32d-4b63-a95e-009eb6439f25\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") "
Nov 04 02:35:53.116346 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116235    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36d70e82-e32d-4b63-a95e-009eb6439f25-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36d70e82-e32d-4b63-a95e-009eb6439f25-istiod-ca-cert\") pod \"36d70e82-e32d-4b63-a95e-009eb6439f25\" (UID: \"36d70e82-e32d-4b63-a95e-009eb6439f25\") "
Nov 04 02:35:53.116346 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116270    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-socket" pod "36d70e82-e32d-4b63-a95e-009eb6439f25" (UID: "36d70e82-e32d-4b63-a95e-009eb6439f25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:53.116346 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116259    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-credential-socket" pod "36d70e82-e32d-4b63-a95e-009eb6439f25" (UID: "36d70e82-e32d-4b63-a95e-009eb6439f25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:53.116536 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116340    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-certs" pod "36d70e82-e32d-4b63-a95e-009eb6439f25" (UID: "36d70e82-e32d-4b63-a95e-009eb6439f25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:53.116536 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116418    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-data" pod "36d70e82-e32d-4b63-a95e-009eb6439f25" (UID: "36d70e82-e32d-4b63-a95e-009eb6439f25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:53.116693 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116673    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36d70e82-e32d-4b63-a95e-009eb6439f25-istiod-ca-cert" pod "36d70e82-e32d-4b63-a95e-009eb6439f25" (UID: "36d70e82-e32d-4b63-a95e-009eb6439f25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:53.116914 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116892    5450 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.116978 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116920    5450 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-credential-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.116978 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116936    5450 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-workload-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.116978 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116950    5450 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-data\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.116978 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.116967    5450 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36d70e82-e32d-4b63-a95e-009eb6439f25-istiod-ca-cert\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.118250 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.118224    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-envoy" pod "36d70e82-e32d-4b63-a95e-009eb6439f25" (UID: "36d70e82-e32d-4b63-a95e-009eb6439f25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:53.118344 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.118288    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-kube-api-access-6dckm" pod "36d70e82-e32d-4b63-a95e-009eb6439f25" (UID: "36d70e82-e32d-4b63-a95e-009eb6439f25"). InnerVolumeSpecName "kube-api-access-6dckm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:53.118492 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.118474    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-token" pod "36d70e82-e32d-4b63-a95e-009eb6439f25" (UID: "36d70e82-e32d-4b63-a95e-009eb6439f25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:53.118527 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.118505    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-podinfo" pod "36d70e82-e32d-4b63-a95e-009eb6439f25" (UID: "36d70e82-e32d-4b63-a95e-009eb6439f25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:35:53.219223 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.219122    5450 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-token\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.219223 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.219165    5450 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-envoy\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.219223 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.219179    5450 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36d70e82-e32d-4b63-a95e-009eb6439f25-istio-podinfo\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.219223 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.219193    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dckm\" (UniqueName: \"kubernetes.io/projected/36d70e82-e32d-4b63-a95e-009eb6439f25-kube-api-access-6dckm\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.627713 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.627673    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:35:53.795531 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.795493    5450 generic.go:356] "Generic (PLEG): container finished" podID="36d70e82-e32d-4b63-a95e-009eb6439f25" containerID="57fc108b5c848a390726cb998e3b6f505e643c1efb55089fa3e5f7bfa325163d" exitCode=0
Nov 04 02:35:53.795739 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.795546    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"
Nov 04 02:35:53.795739 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.795583    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6" event={"ID":"36d70e82-e32d-4b63-a95e-009eb6439f25","Type":"ContainerDied","Data":"57fc108b5c848a390726cb998e3b6f505e643c1efb55089fa3e5f7bfa325163d"}
Nov 04 02:35:53.795739 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.795652    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6" event={"ID":"36d70e82-e32d-4b63-a95e-009eb6439f25","Type":"ContainerDied","Data":"c2e37f0d59475600c51c795fe005754182dd01eec23497741aebb5cc5c7f024d"}
Nov 04 02:35:53.795739 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.795679    5450 scope.go:122] "RemoveContainer" containerID="57fc108b5c848a390726cb998e3b6f505e643c1efb55089fa3e5f7bfa325163d"
Nov 04 02:35:53.806567 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.806551    5450 scope.go:122] "RemoveContainer" containerID="57fc108b5c848a390726cb998e3b6f505e643c1efb55089fa3e5f7bfa325163d"
Nov 04 02:35:53.806838 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:53.806821    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57fc108b5c848a390726cb998e3b6f505e643c1efb55089fa3e5f7bfa325163d\": container with ID starting with 57fc108b5c848a390726cb998e3b6f505e643c1efb55089fa3e5f7bfa325163d not found: ID does not exist" containerID="57fc108b5c848a390726cb998e3b6f505e643c1efb55089fa3e5f7bfa325163d"
Nov 04 02:35:53.806916 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.806848    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57fc108b5c848a390726cb998e3b6f505e643c1efb55089fa3e5f7bfa325163d"} err="failed to get container status \"57fc108b5c848a390726cb998e3b6f505e643c1efb55089fa3e5f7bfa325163d\": rpc error: code = NotFound desc = could not find container \"57fc108b5c848a390726cb998e3b6f505e643c1efb55089fa3e5f7bfa325163d\": container with ID starting with 57fc108b5c848a390726cb998e3b6f505e643c1efb55089fa3e5f7bfa325163d not found: ID does not exist"
Nov 04 02:35:53.962823 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.962740    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"]
Nov 04 02:35:53.967658 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:53.967633    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4sll6"]
Nov 04 02:35:54.634830 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:54.634796    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36d70e82-e32d-4b63-a95e-009eb6439f25" path="/var/lib/kubelet/pods/36d70e82-e32d-4b63-a95e-009eb6439f25/volumes"
Nov 04 02:35:54.635285 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:54.635271    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0ff1c4a-3d73-45b2-adb9-44fd034306b6" path="/var/lib/kubelet/pods/a0ff1c4a-3d73-45b2-adb9-44fd034306b6/volumes"
Nov 04 02:35:54.635698 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:35:54.635685    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c7d094a5-ed9d-4d2f-821d-72c8826994e0" path="/var/lib/kubelet/pods/c7d094a5-ed9d-4d2f-821d-72c8826994e0/volumes"
Nov 04 02:35:55.345829 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:55.345801    5450 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-a369bc8f7d56: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:55.345829 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:55.345822    5450 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:35:55.346034 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:35:55.345894    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials podName:205307f9-b34c-4a63-925e-425314b48e36 nodeName:}" failed. No retries permitted until 2026-11-04 02:36:11.345867686 +0000 UTC m=+1166.849808158 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials") pod "payload-processing-external-model-66ccc7f677-72xcm" (UID: "205307f9-b34c-4a63-925e-425314b48e36") : secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:36:03.627508 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:36:03.627465    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:36:11.355767 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:36:11.355734    5450 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-a369bc8f7d56: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:36:11.355767 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:36:11.355760    5450 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:36:11.356290 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:36:11.355812    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials podName:205307f9-b34c-4a63-925e-425314b48e36 nodeName:}" failed. No retries permitted until 2026-11-04 02:36:43.355799351 +0000 UTC m=+1198.859739835 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials") pod "payload-processing-external-model-66ccc7f677-72xcm" (UID: "205307f9-b34c-4a63-925e-425314b48e36") : secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:36:13.627389 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:36:13.627352    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:36:17.764546 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:36:17.764505    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:36:23.627452 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:36:23.627364    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:36:29.063659 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:36:29.063629    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:36:33.627776 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:36:33.627740    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:36:43.437872 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:36:43.437833    5450 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-a369bc8f7d56: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:36:43.437872 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:36:43.437862    5450 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:36:43.438383 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:36:43.437939    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials podName:205307f9-b34c-4a63-925e-425314b48e36 nodeName:}" failed. No retries permitted until 2026-11-04 02:37:47.437925276 +0000 UTC m=+1262.941865748 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials") pod "payload-processing-external-model-66ccc7f677-72xcm" (UID: "205307f9-b34c-4a63-925e-425314b48e36") : secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:36:43.627606 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:36:43.627570    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:36:44.785807 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:36:44.785767    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:36:44.787257 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:36:44.787239    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:36:47.766970 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:36:47.766932    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:36:50.429614 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:36:50.429572    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:36:53.627449 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:36:53.627409    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:37:03.627761 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:03.627725    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:37:05.627090 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:05.627057    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:37:15.627971 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:15.627936    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:37:17.764973 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:37:17.764937    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:37:19.536014 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:19.535984    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:37:25.627284 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:25.627242    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:37:33.607745 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:33.607707    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"]
Nov 04 02:37:33.716694 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:33.716662    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"]
Nov 04 02:37:35.627234 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:35.627194    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:37:38.608835 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:38.608800    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw" podUID="0503b120-75d9-4173-a709-c4fd3af91b26" containerName="payload-processing" containerID="cri-o://6836a58225538334c00c20f2175ba7a1990b298638ae8dd707aa58e7df7eb6d0" gracePeriod=25
Nov 04 02:37:38.717745 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:38.717711    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx" podUID="a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04" containerName="payload-pre-processing" containerID="cri-o://a4c818af98223ef531935e4fc403e11f3bfaf594deb2c7eb8342ee54e1c118dd" gracePeriod=25
Nov 04 02:37:38.890627 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:38.890239    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"
Nov 04 02:37:38.971575 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:38.971550    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"
Nov 04 02:37:39.014964 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.014937    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0503b120-75d9-4173-a709-c4fd3af91b26-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0503b120-75d9-4173-a709-c4fd3af91b26-plugins-config-volume\") pod \"0503b120-75d9-4173-a709-c4fd3af91b26\" (UID: \"0503b120-75d9-4173-a709-c4fd3af91b26\") "
Nov 04 02:37:39.015104 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.014970    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0503b120-75d9-4173-a709-c4fd3af91b26-kube-api-access-8w25c\" (UniqueName: \"kubernetes.io/projected/0503b120-75d9-4173-a709-c4fd3af91b26-kube-api-access-8w25c\") pod \"0503b120-75d9-4173-a709-c4fd3af91b26\" (UID: \"0503b120-75d9-4173-a709-c4fd3af91b26\") "
Nov 04 02:37:39.015280 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.015256    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0503b120-75d9-4173-a709-c4fd3af91b26-plugins-config-volume" pod "0503b120-75d9-4173-a709-c4fd3af91b26" (UID: "0503b120-75d9-4173-a709-c4fd3af91b26"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:37:39.015375 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.015362    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0503b120-75d9-4173-a709-c4fd3af91b26-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:39.016915 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.016897    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0503b120-75d9-4173-a709-c4fd3af91b26-kube-api-access-8w25c" pod "0503b120-75d9-4173-a709-c4fd3af91b26" (UID: "0503b120-75d9-4173-a709-c4fd3af91b26"). InnerVolumeSpecName "kube-api-access-8w25c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:37:39.116217 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.116188    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-plugins-config-volume\") pod \"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04\" (UID: \"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04\") "
Nov 04 02:37:39.116376 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.116331    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-kube-api-access-dxvzp\" (UniqueName: \"kubernetes.io/projected/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-kube-api-access-dxvzp\") pod \"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04\" (UID: \"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04\") "
Nov 04 02:37:39.116574 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.116553    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-plugins-config-volume" pod "a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04" (UID: "a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:37:39.116913 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.116894    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:39.116913 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.116913    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w25c\" (UniqueName: \"kubernetes.io/projected/0503b120-75d9-4173-a709-c4fd3af91b26-kube-api-access-8w25c\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:39.118419 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.118366    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-kube-api-access-dxvzp" pod "a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04" (UID: "a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04"). InnerVolumeSpecName "kube-api-access-dxvzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:37:39.218077 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.218044    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxvzp\" (UniqueName: \"kubernetes.io/projected/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04-kube-api-access-dxvzp\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:39.472418 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.472331    5450 generic.go:356] "Generic (PLEG): container finished" podID="0503b120-75d9-4173-a709-c4fd3af91b26" containerID="6836a58225538334c00c20f2175ba7a1990b298638ae8dd707aa58e7df7eb6d0" exitCode=0
Nov 04 02:37:39.472418 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.472391    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"
Nov 04 02:37:39.472641 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.472416    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw" event={"ID":"0503b120-75d9-4173-a709-c4fd3af91b26","Type":"ContainerDied","Data":"6836a58225538334c00c20f2175ba7a1990b298638ae8dd707aa58e7df7eb6d0"}
Nov 04 02:37:39.472641 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.472498    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw" event={"ID":"0503b120-75d9-4173-a709-c4fd3af91b26","Type":"ContainerDied","Data":"4c71da42bd988d100f326397709ed445b6fc02d857c76fe9963f447e653b9258"}
Nov 04 02:37:39.472641 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.472529    5450 scope.go:122] "RemoveContainer" containerID="6836a58225538334c00c20f2175ba7a1990b298638ae8dd707aa58e7df7eb6d0"
Nov 04 02:37:39.473831 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.473809    5450 generic.go:356] "Generic (PLEG): container finished" podID="a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04" containerID="a4c818af98223ef531935e4fc403e11f3bfaf594deb2c7eb8342ee54e1c118dd" exitCode=0
Nov 04 02:37:39.473957 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.473864    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"
Nov 04 02:37:39.473957 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.473935    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx" event={"ID":"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04","Type":"ContainerDied","Data":"a4c818af98223ef531935e4fc403e11f3bfaf594deb2c7eb8342ee54e1c118dd"}
Nov 04 02:37:39.474070 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.473979    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx" event={"ID":"a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04","Type":"ContainerDied","Data":"92904a9757f201273f1c62e2716ba919448daa073f2afa8fa5d2a8bdad2bf89f"}
Nov 04 02:37:39.483450 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.483429    5450 scope.go:122] "RemoveContainer" containerID="6836a58225538334c00c20f2175ba7a1990b298638ae8dd707aa58e7df7eb6d0"
Nov 04 02:37:39.483746 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:37:39.483718    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6836a58225538334c00c20f2175ba7a1990b298638ae8dd707aa58e7df7eb6d0\": container with ID starting with 6836a58225538334c00c20f2175ba7a1990b298638ae8dd707aa58e7df7eb6d0 not found: ID does not exist" containerID="6836a58225538334c00c20f2175ba7a1990b298638ae8dd707aa58e7df7eb6d0"
Nov 04 02:37:39.483824 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.483755    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6836a58225538334c00c20f2175ba7a1990b298638ae8dd707aa58e7df7eb6d0"} err="failed to get container status \"6836a58225538334c00c20f2175ba7a1990b298638ae8dd707aa58e7df7eb6d0\": rpc error: code = NotFound desc = could not find container \"6836a58225538334c00c20f2175ba7a1990b298638ae8dd707aa58e7df7eb6d0\": container with ID starting with 6836a58225538334c00c20f2175ba7a1990b298638ae8dd707aa58e7df7eb6d0 not found: ID does not exist"
Nov 04 02:37:39.483824 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.483775    5450 scope.go:122] "RemoveContainer" containerID="a4c818af98223ef531935e4fc403e11f3bfaf594deb2c7eb8342ee54e1c118dd"
Nov 04 02:37:39.492485 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.492467    5450 scope.go:122] "RemoveContainer" containerID="a4c818af98223ef531935e4fc403e11f3bfaf594deb2c7eb8342ee54e1c118dd"
Nov 04 02:37:39.492769 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:37:39.492750    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4c818af98223ef531935e4fc403e11f3bfaf594deb2c7eb8342ee54e1c118dd\": container with ID starting with a4c818af98223ef531935e4fc403e11f3bfaf594deb2c7eb8342ee54e1c118dd not found: ID does not exist" containerID="a4c818af98223ef531935e4fc403e11f3bfaf594deb2c7eb8342ee54e1c118dd"
Nov 04 02:37:39.492828 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.492776    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4c818af98223ef531935e4fc403e11f3bfaf594deb2c7eb8342ee54e1c118dd"} err="failed to get container status \"a4c818af98223ef531935e4fc403e11f3bfaf594deb2c7eb8342ee54e1c118dd\": rpc error: code = NotFound desc = could not find container \"a4c818af98223ef531935e4fc403e11f3bfaf594deb2c7eb8342ee54e1c118dd\": container with ID starting with a4c818af98223ef531935e4fc403e11f3bfaf594deb2c7eb8342ee54e1c118dd not found: ID does not exist"
Nov 04 02:37:39.639934 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.639907    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"]
Nov 04 02:37:39.687712 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.687683    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-493b10-6cfd49f99-jqbxx"]
Nov 04 02:37:39.754540 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.754517    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"]
Nov 04 02:37:39.765868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:39.765840    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-493b10-54d94b558-4tkmw"]
Nov 04 02:37:40.633398 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:40.633358    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0503b120-75d9-4173-a709-c4fd3af91b26" path="/var/lib/kubelet/pods/0503b120-75d9-4173-a709-c4fd3af91b26/volumes"
Nov 04 02:37:40.633904 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:40.633883    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04" path="/var/lib/kubelet/pods/a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04/volumes"
Nov 04 02:37:45.083647 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:45.083546    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"]
Nov 04 02:37:45.189242 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:45.189211    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"]
Nov 04 02:37:45.627610 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:45.627561    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:37:47.517472 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:37:47.517423    5450 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-a369bc8f7d56: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:37:47.517472 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:37:47.517471    5450 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm: secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:37:47.517952 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:37:47.517561    5450 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials podName:205307f9-b34c-4a63-925e-425314b48e36 nodeName:}" failed. No retries permitted until 2026-11-04 02:39:49.517537693 +0000 UTC m=+1385.021478185 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials") pod "payload-processing-external-model-66ccc7f677-72xcm" (UID: "205307f9-b34c-4a63-925e-425314b48e36") : secret "agc-cred-a369bc8f7d56" not found
Nov 04 02:37:47.764254 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:37:47.764216    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:37:50.084199 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:50.084140    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz" podUID="17692d26-e7ea-4ce5-b182-10e51eeeaebc" containerName="payload-processing" containerID="cri-o://7ed6f0a448699cbb81d454ce3517d016cf45373ccec3b5f525aa7174013c34ea" gracePeriod=25
Nov 04 02:37:50.189687 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:50.189631    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q" podUID="170a5ee7-56d5-4218-90db-9e3d495e9247" containerName="payload-pre-processing" containerID="cri-o://65829759ea4de193548b150a8944b56ba4da556f41b61358a91a25c116c3283d" gracePeriod=25
Nov 04 02:37:53.163103 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:53.163016    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:37:55.301275 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:55.301210    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q" podUID="170a5ee7-56d5-4218-90db-9e3d495e9247" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:37:55.301683 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:55.301217    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz" podUID="17692d26-e7ea-4ce5-b182-10e51eeeaebc" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:37:55.627301 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:37:55.627224    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:38:05.302003 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:05.301964    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz" podUID="17692d26-e7ea-4ce5-b182-10e51eeeaebc" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:38:05.302474 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:05.301997    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q" podUID="170a5ee7-56d5-4218-90db-9e3d495e9247" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:38:05.627325 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:05.627236    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:38:09.621184 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:09.621149    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"]
Nov 04 02:38:09.621697 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:09.621437    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs" podUID="b34ce6ae-5bb1-4f95-905a-736cae472b62" containerName="maas-api" containerID="cri-o://672e747cb50cd2cdb02b0e5a4e67ace0a9f3a028997b45fe1e6014e1b06c2f34" gracePeriod=30
Nov 04 02:38:09.888462 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:09.888396    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:38:09.979964 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:09.979929    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-metrics-certs\") pod \"b34ce6ae-5bb1-4f95-905a-736cae472b62\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") "
Nov 04 02:38:09.980149 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:09.980048    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b34ce6ae-5bb1-4f95-905a-736cae472b62-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34ce6ae-5bb1-4f95-905a-736cae472b62-openshift-service-ca\") pod \"b34ce6ae-5bb1-4f95-905a-736cae472b62\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") "
Nov 04 02:38:09.980149 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:09.980097    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b34ce6ae-5bb1-4f95-905a-736cae472b62-kube-api-access-b856z\" (UniqueName: \"kubernetes.io/projected/b34ce6ae-5bb1-4f95-905a-736cae472b62-kube-api-access-b856z\") pod \"b34ce6ae-5bb1-4f95-905a-736cae472b62\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") "
Nov 04 02:38:09.980253 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:09.980151    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-maas-api-tls\") pod \"b34ce6ae-5bb1-4f95-905a-736cae472b62\" (UID: \"b34ce6ae-5bb1-4f95-905a-736cae472b62\") "
Nov 04 02:38:09.980432 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:09.980402    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b34ce6ae-5bb1-4f95-905a-736cae472b62-openshift-service-ca" pod "b34ce6ae-5bb1-4f95-905a-736cae472b62" (UID: "b34ce6ae-5bb1-4f95-905a-736cae472b62"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:09.980673 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:09.980656    5450 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34ce6ae-5bb1-4f95-905a-736cae472b62-openshift-service-ca\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:09.982561 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:09.982535    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-maas-api-tls" pod "b34ce6ae-5bb1-4f95-905a-736cae472b62" (UID: "b34ce6ae-5bb1-4f95-905a-736cae472b62"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:38:09.982561 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:09.982551    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-metrics-certs" pod "b34ce6ae-5bb1-4f95-905a-736cae472b62" (UID: "b34ce6ae-5bb1-4f95-905a-736cae472b62"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:38:09.982693 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:09.982567    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b34ce6ae-5bb1-4f95-905a-736cae472b62-kube-api-access-b856z" pod "b34ce6ae-5bb1-4f95-905a-736cae472b62" (UID: "b34ce6ae-5bb1-4f95-905a-736cae472b62"). InnerVolumeSpecName "kube-api-access-b856z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:10.082330 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.082296    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b856z\" (UniqueName: \"kubernetes.io/projected/b34ce6ae-5bb1-4f95-905a-736cae472b62-kube-api-access-b856z\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:10.082330 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.082321    5450 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-maas-api-tls\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:10.082330 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.082330    5450 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b34ce6ae-5bb1-4f95-905a-736cae472b62-metrics-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:10.337949 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.337922    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"
Nov 04 02:38:10.385630 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.385587    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17692d26-e7ea-4ce5-b182-10e51eeeaebc-kube-api-access-7tddg\" (UniqueName: \"kubernetes.io/projected/17692d26-e7ea-4ce5-b182-10e51eeeaebc-kube-api-access-7tddg\") pod \"17692d26-e7ea-4ce5-b182-10e51eeeaebc\" (UID: \"17692d26-e7ea-4ce5-b182-10e51eeeaebc\") "
Nov 04 02:38:10.385834 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.385787    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/17692d26-e7ea-4ce5-b182-10e51eeeaebc-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17692d26-e7ea-4ce5-b182-10e51eeeaebc-plugins-config-volume\") pod \"17692d26-e7ea-4ce5-b182-10e51eeeaebc\" (UID: \"17692d26-e7ea-4ce5-b182-10e51eeeaebc\") "
Nov 04 02:38:10.386399 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.386359    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17692d26-e7ea-4ce5-b182-10e51eeeaebc-plugins-config-volume" pod "17692d26-e7ea-4ce5-b182-10e51eeeaebc" (UID: "17692d26-e7ea-4ce5-b182-10e51eeeaebc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:10.388804 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.388772    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17692d26-e7ea-4ce5-b182-10e51eeeaebc-kube-api-access-7tddg" pod "17692d26-e7ea-4ce5-b182-10e51eeeaebc" (UID: "17692d26-e7ea-4ce5-b182-10e51eeeaebc"). InnerVolumeSpecName "kube-api-access-7tddg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:10.436294 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.436268    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"
Nov 04 02:38:10.487566 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.487485    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/170a5ee7-56d5-4218-90db-9e3d495e9247-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/170a5ee7-56d5-4218-90db-9e3d495e9247-plugins-config-volume\") pod \"170a5ee7-56d5-4218-90db-9e3d495e9247\" (UID: \"170a5ee7-56d5-4218-90db-9e3d495e9247\") "
Nov 04 02:38:10.487728 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.487581    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/170a5ee7-56d5-4218-90db-9e3d495e9247-kube-api-access-jxl9x\" (UniqueName: \"kubernetes.io/projected/170a5ee7-56d5-4218-90db-9e3d495e9247-kube-api-access-jxl9x\") pod \"170a5ee7-56d5-4218-90db-9e3d495e9247\" (UID: \"170a5ee7-56d5-4218-90db-9e3d495e9247\") "
Nov 04 02:38:10.487986 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.487949    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/170a5ee7-56d5-4218-90db-9e3d495e9247-plugins-config-volume" pod "170a5ee7-56d5-4218-90db-9e3d495e9247" (UID: "170a5ee7-56d5-4218-90db-9e3d495e9247"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:10.488265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.488245    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tddg\" (UniqueName: \"kubernetes.io/projected/17692d26-e7ea-4ce5-b182-10e51eeeaebc-kube-api-access-7tddg\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:10.488313 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.488272    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/170a5ee7-56d5-4218-90db-9e3d495e9247-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:10.488313 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.488289    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17692d26-e7ea-4ce5-b182-10e51eeeaebc-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:10.489643 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.489619    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/170a5ee7-56d5-4218-90db-9e3d495e9247-kube-api-access-jxl9x" pod "170a5ee7-56d5-4218-90db-9e3d495e9247" (UID: "170a5ee7-56d5-4218-90db-9e3d495e9247"). InnerVolumeSpecName "kube-api-access-jxl9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:10.589756 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.589723    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxl9x\" (UniqueName: \"kubernetes.io/projected/170a5ee7-56d5-4218-90db-9e3d495e9247-kube-api-access-jxl9x\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:10.720094 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.720057    5450 generic.go:356] "Generic (PLEG): container finished" podID="17692d26-e7ea-4ce5-b182-10e51eeeaebc" containerID="7ed6f0a448699cbb81d454ce3517d016cf45373ccec3b5f525aa7174013c34ea" exitCode=0
Nov 04 02:38:10.720764 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.720098    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"
Nov 04 02:38:10.720764 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.720133    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz" event={"ID":"17692d26-e7ea-4ce5-b182-10e51eeeaebc","Type":"ContainerDied","Data":"7ed6f0a448699cbb81d454ce3517d016cf45373ccec3b5f525aa7174013c34ea"}
Nov 04 02:38:10.720764 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.720193    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz" event={"ID":"17692d26-e7ea-4ce5-b182-10e51eeeaebc","Type":"ContainerDied","Data":"c27a795b4ac12b4108413c25f674f22f2592efa501ea8ae3c0e8125178d7fcd4"}
Nov 04 02:38:10.720764 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.720222    5450 scope.go:122] "RemoveContainer" containerID="7ed6f0a448699cbb81d454ce3517d016cf45373ccec3b5f525aa7174013c34ea"
Nov 04 02:38:10.722720 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.722534    5450 generic.go:356] "Generic (PLEG): container finished" podID="170a5ee7-56d5-4218-90db-9e3d495e9247" containerID="65829759ea4de193548b150a8944b56ba4da556f41b61358a91a25c116c3283d" exitCode=0
Nov 04 02:38:10.722926 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.722900    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q" event={"ID":"170a5ee7-56d5-4218-90db-9e3d495e9247","Type":"ContainerDied","Data":"65829759ea4de193548b150a8944b56ba4da556f41b61358a91a25c116c3283d"}
Nov 04 02:38:10.723042 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.722951    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q" event={"ID":"170a5ee7-56d5-4218-90db-9e3d495e9247","Type":"ContainerDied","Data":"70f7ee5b9fab44503d77c17aa2b285ca3dea91545616d75cad1f9b0d66f71c6d"}
Nov 04 02:38:10.723042 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.723016    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"
Nov 04 02:38:10.725937 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.725176    5450 generic.go:356] "Generic (PLEG): container finished" podID="b34ce6ae-5bb1-4f95-905a-736cae472b62" containerID="672e747cb50cd2cdb02b0e5a4e67ace0a9f3a028997b45fe1e6014e1b06c2f34" exitCode=0
Nov 04 02:38:10.725937 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.725235    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs" event={"ID":"b34ce6ae-5bb1-4f95-905a-736cae472b62","Type":"ContainerDied","Data":"672e747cb50cd2cdb02b0e5a4e67ace0a9f3a028997b45fe1e6014e1b06c2f34"}
Nov 04 02:38:10.725937 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.725271    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs" event={"ID":"b34ce6ae-5bb1-4f95-905a-736cae472b62","Type":"ContainerDied","Data":"35f84f9626b5143a32affadabdb65b060fac304d42353744f86620d37cd8a7c4"}
Nov 04 02:38:10.725937 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.725239    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"
Nov 04 02:38:10.734502 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.734475    5450 scope.go:122] "RemoveContainer" containerID="7ed6f0a448699cbb81d454ce3517d016cf45373ccec3b5f525aa7174013c34ea"
Nov 04 02:38:10.734805 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:38:10.734786    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed6f0a448699cbb81d454ce3517d016cf45373ccec3b5f525aa7174013c34ea\": container with ID starting with 7ed6f0a448699cbb81d454ce3517d016cf45373ccec3b5f525aa7174013c34ea not found: ID does not exist" containerID="7ed6f0a448699cbb81d454ce3517d016cf45373ccec3b5f525aa7174013c34ea"
Nov 04 02:38:10.734890 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.734815    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed6f0a448699cbb81d454ce3517d016cf45373ccec3b5f525aa7174013c34ea"} err="failed to get container status \"7ed6f0a448699cbb81d454ce3517d016cf45373ccec3b5f525aa7174013c34ea\": rpc error: code = NotFound desc = could not find container \"7ed6f0a448699cbb81d454ce3517d016cf45373ccec3b5f525aa7174013c34ea\": container with ID starting with 7ed6f0a448699cbb81d454ce3517d016cf45373ccec3b5f525aa7174013c34ea not found: ID does not exist"
Nov 04 02:38:10.734890 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.734840    5450 scope.go:122] "RemoveContainer" containerID="65829759ea4de193548b150a8944b56ba4da556f41b61358a91a25c116c3283d"
Nov 04 02:38:10.744814 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.744777    5450 scope.go:122] "RemoveContainer" containerID="65829759ea4de193548b150a8944b56ba4da556f41b61358a91a25c116c3283d"
Nov 04 02:38:10.745112 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:38:10.745085    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65829759ea4de193548b150a8944b56ba4da556f41b61358a91a25c116c3283d\": container with ID starting with 65829759ea4de193548b150a8944b56ba4da556f41b61358a91a25c116c3283d not found: ID does not exist" containerID="65829759ea4de193548b150a8944b56ba4da556f41b61358a91a25c116c3283d"
Nov 04 02:38:10.745193 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.745122    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65829759ea4de193548b150a8944b56ba4da556f41b61358a91a25c116c3283d"} err="failed to get container status \"65829759ea4de193548b150a8944b56ba4da556f41b61358a91a25c116c3283d\": rpc error: code = NotFound desc = could not find container \"65829759ea4de193548b150a8944b56ba4da556f41b61358a91a25c116c3283d\": container with ID starting with 65829759ea4de193548b150a8944b56ba4da556f41b61358a91a25c116c3283d not found: ID does not exist"
Nov 04 02:38:10.745193 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.745145    5450 scope.go:122] "RemoveContainer" containerID="672e747cb50cd2cdb02b0e5a4e67ace0a9f3a028997b45fe1e6014e1b06c2f34"
Nov 04 02:38:10.756018 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.755996    5450 scope.go:122] "RemoveContainer" containerID="672e747cb50cd2cdb02b0e5a4e67ace0a9f3a028997b45fe1e6014e1b06c2f34"
Nov 04 02:38:10.756298 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:38:10.756279    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"672e747cb50cd2cdb02b0e5a4e67ace0a9f3a028997b45fe1e6014e1b06c2f34\": container with ID starting with 672e747cb50cd2cdb02b0e5a4e67ace0a9f3a028997b45fe1e6014e1b06c2f34 not found: ID does not exist" containerID="672e747cb50cd2cdb02b0e5a4e67ace0a9f3a028997b45fe1e6014e1b06c2f34"
Nov 04 02:38:10.756364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.756308    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"672e747cb50cd2cdb02b0e5a4e67ace0a9f3a028997b45fe1e6014e1b06c2f34"} err="failed to get container status \"672e747cb50cd2cdb02b0e5a4e67ace0a9f3a028997b45fe1e6014e1b06c2f34\": rpc error: code = NotFound desc = could not find container \"672e747cb50cd2cdb02b0e5a4e67ace0a9f3a028997b45fe1e6014e1b06c2f34\": container with ID starting with 672e747cb50cd2cdb02b0e5a4e67ace0a9f3a028997b45fe1e6014e1b06c2f34 not found: ID does not exist"
Nov 04 02:38:10.878392 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.878353    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"]
Nov 04 02:38:10.882753 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.882727    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-31626a-55f9577c87-4dp9q"]
Nov 04 02:38:10.988312 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.988277    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"]
Nov 04 02:38:10.992670 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:10.992640    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-493b10-68dc47d4cd-6pkcs"]
Nov 04 02:38:11.098712 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:11.098681    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"]
Nov 04 02:38:11.104176 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:11.104152    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-31626a-595f9f84db-kvfjz"]
Nov 04 02:38:12.640383 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:12.640309    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="170a5ee7-56d5-4218-90db-9e3d495e9247" path="/var/lib/kubelet/pods/170a5ee7-56d5-4218-90db-9e3d495e9247/volumes"
Nov 04 02:38:12.641088 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:12.641067    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="17692d26-e7ea-4ce5-b182-10e51eeeaebc" path="/var/lib/kubelet/pods/17692d26-e7ea-4ce5-b182-10e51eeeaebc/volumes"
Nov 04 02:38:12.641480 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:12.641466    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b34ce6ae-5bb1-4f95-905a-736cae472b62" path="/var/lib/kubelet/pods/b34ce6ae-5bb1-4f95-905a-736cae472b62/volumes"
Nov 04 02:38:15.627908 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:15.627873    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:38:17.764530 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:38:17.764495    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:38:18.264887 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:18.264853    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:38:23.627246 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:23.627211    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:38:28.924795 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:28.924762    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"]
Nov 04 02:38:29.039005 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:29.038969    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"]
Nov 04 02:38:33.627996 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:33.627956    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:38:33.925551 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:33.925441    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt" podUID="efa87d42-019e-4814-baf9-ec8577de13a3" containerName="payload-processing" containerID="cri-o://c1f34624b9d2888b5d4934b928bcab30f791fe4312c854e51725377ba46c3e74" gracePeriod=25
Nov 04 02:38:34.039681 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.039621    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp" podUID="efc4ec72-d671-44b7-9965-8b35438ce8be" containerName="payload-pre-processing" containerID="cri-o://eca88f50cc3e49f5a22cf0722089bc37249f1bfb360c6b3a5c4427d4f8c4f3f3" gracePeriod=25
Nov 04 02:38:34.204566 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.204538    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"
Nov 04 02:38:34.279151 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.279119    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/efa87d42-019e-4814-baf9-ec8577de13a3-kube-api-access-gjdsp\" (UniqueName: \"kubernetes.io/projected/efa87d42-019e-4814-baf9-ec8577de13a3-kube-api-access-gjdsp\") pod \"efa87d42-019e-4814-baf9-ec8577de13a3\" (UID: \"efa87d42-019e-4814-baf9-ec8577de13a3\") "
Nov 04 02:38:34.279330 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.279307    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/efa87d42-019e-4814-baf9-ec8577de13a3-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efa87d42-019e-4814-baf9-ec8577de13a3-plugins-config-volume\") pod \"efa87d42-019e-4814-baf9-ec8577de13a3\" (UID: \"efa87d42-019e-4814-baf9-ec8577de13a3\") "
Nov 04 02:38:34.279784 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.279755    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa87d42-019e-4814-baf9-ec8577de13a3-plugins-config-volume" pod "efa87d42-019e-4814-baf9-ec8577de13a3" (UID: "efa87d42-019e-4814-baf9-ec8577de13a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:34.282396 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.282371    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa87d42-019e-4814-baf9-ec8577de13a3-kube-api-access-gjdsp" pod "efa87d42-019e-4814-baf9-ec8577de13a3" (UID: "efa87d42-019e-4814-baf9-ec8577de13a3"). InnerVolumeSpecName "kube-api-access-gjdsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:34.307464 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.307442    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"
Nov 04 02:38:34.380798 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.380766    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/efc4ec72-d671-44b7-9965-8b35438ce8be-kube-api-access-77s7h\" (UniqueName: \"kubernetes.io/projected/efc4ec72-d671-44b7-9965-8b35438ce8be-kube-api-access-77s7h\") pod \"efc4ec72-d671-44b7-9965-8b35438ce8be\" (UID: \"efc4ec72-d671-44b7-9965-8b35438ce8be\") "
Nov 04 02:38:34.380986 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.380824    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/efc4ec72-d671-44b7-9965-8b35438ce8be-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc4ec72-d671-44b7-9965-8b35438ce8be-plugins-config-volume\") pod \"efc4ec72-d671-44b7-9965-8b35438ce8be\" (UID: \"efc4ec72-d671-44b7-9965-8b35438ce8be\") "
Nov 04 02:38:34.381198 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.381178    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efc4ec72-d671-44b7-9965-8b35438ce8be-plugins-config-volume" pod "efc4ec72-d671-44b7-9965-8b35438ce8be" (UID: "efc4ec72-d671-44b7-9965-8b35438ce8be"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:34.381315 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.381301    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjdsp\" (UniqueName: \"kubernetes.io/projected/efa87d42-019e-4814-baf9-ec8577de13a3-kube-api-access-gjdsp\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:34.381364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.381317    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc4ec72-d671-44b7-9965-8b35438ce8be-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:34.381364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.381328    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efa87d42-019e-4814-baf9-ec8577de13a3-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:34.382769 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.382750    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc4ec72-d671-44b7-9965-8b35438ce8be-kube-api-access-77s7h" pod "efc4ec72-d671-44b7-9965-8b35438ce8be" (UID: "efc4ec72-d671-44b7-9965-8b35438ce8be"). InnerVolumeSpecName "kube-api-access-77s7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:34.482659 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.482560    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77s7h\" (UniqueName: \"kubernetes.io/projected/efc4ec72-d671-44b7-9965-8b35438ce8be-kube-api-access-77s7h\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:34.887912 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.887880    5450 generic.go:356] "Generic (PLEG): container finished" podID="efa87d42-019e-4814-baf9-ec8577de13a3" containerID="c1f34624b9d2888b5d4934b928bcab30f791fe4312c854e51725377ba46c3e74" exitCode=0
Nov 04 02:38:34.888385 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.887930    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"
Nov 04 02:38:34.888385 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.887964    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt" event={"ID":"efa87d42-019e-4814-baf9-ec8577de13a3","Type":"ContainerDied","Data":"c1f34624b9d2888b5d4934b928bcab30f791fe4312c854e51725377ba46c3e74"}
Nov 04 02:38:34.888385 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.888019    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt" event={"ID":"efa87d42-019e-4814-baf9-ec8577de13a3","Type":"ContainerDied","Data":"e1e000b28f8e9a058e4dcbedd7c27badaa5fdce43f90bbcac42f0277a6157dba"}
Nov 04 02:38:34.888385 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.888040    5450 scope.go:122] "RemoveContainer" containerID="c1f34624b9d2888b5d4934b928bcab30f791fe4312c854e51725377ba46c3e74"
Nov 04 02:38:34.889742 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.889713    5450 generic.go:356] "Generic (PLEG): container finished" podID="efc4ec72-d671-44b7-9965-8b35438ce8be" containerID="eca88f50cc3e49f5a22cf0722089bc37249f1bfb360c6b3a5c4427d4f8c4f3f3" exitCode=0
Nov 04 02:38:34.889897 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.889757    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"
Nov 04 02:38:34.889897 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.889804    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp" event={"ID":"efc4ec72-d671-44b7-9965-8b35438ce8be","Type":"ContainerDied","Data":"eca88f50cc3e49f5a22cf0722089bc37249f1bfb360c6b3a5c4427d4f8c4f3f3"}
Nov 04 02:38:34.889897 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.889845    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp" event={"ID":"efc4ec72-d671-44b7-9965-8b35438ce8be","Type":"ContainerDied","Data":"19ef4b04a3ddf50326cc0fb6b1986fb8d5bec24db4c30bed53c1b95ce0bc0d91"}
Nov 04 02:38:34.897725 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.897708    5450 scope.go:122] "RemoveContainer" containerID="c1f34624b9d2888b5d4934b928bcab30f791fe4312c854e51725377ba46c3e74"
Nov 04 02:38:34.897991 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:38:34.897972    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1f34624b9d2888b5d4934b928bcab30f791fe4312c854e51725377ba46c3e74\": container with ID starting with c1f34624b9d2888b5d4934b928bcab30f791fe4312c854e51725377ba46c3e74 not found: ID does not exist" containerID="c1f34624b9d2888b5d4934b928bcab30f791fe4312c854e51725377ba46c3e74"
Nov 04 02:38:34.898050 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.898000    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f34624b9d2888b5d4934b928bcab30f791fe4312c854e51725377ba46c3e74"} err="failed to get container status \"c1f34624b9d2888b5d4934b928bcab30f791fe4312c854e51725377ba46c3e74\": rpc error: code = NotFound desc = could not find container \"c1f34624b9d2888b5d4934b928bcab30f791fe4312c854e51725377ba46c3e74\": container with ID starting with c1f34624b9d2888b5d4934b928bcab30f791fe4312c854e51725377ba46c3e74 not found: ID does not exist"
Nov 04 02:38:34.898050 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.898019    5450 scope.go:122] "RemoveContainer" containerID="eca88f50cc3e49f5a22cf0722089bc37249f1bfb360c6b3a5c4427d4f8c4f3f3"
Nov 04 02:38:34.906536 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.906520    5450 scope.go:122] "RemoveContainer" containerID="eca88f50cc3e49f5a22cf0722089bc37249f1bfb360c6b3a5c4427d4f8c4f3f3"
Nov 04 02:38:34.906795 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:38:34.906777    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eca88f50cc3e49f5a22cf0722089bc37249f1bfb360c6b3a5c4427d4f8c4f3f3\": container with ID starting with eca88f50cc3e49f5a22cf0722089bc37249f1bfb360c6b3a5c4427d4f8c4f3f3 not found: ID does not exist" containerID="eca88f50cc3e49f5a22cf0722089bc37249f1bfb360c6b3a5c4427d4f8c4f3f3"
Nov 04 02:38:34.906854 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:34.906801    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eca88f50cc3e49f5a22cf0722089bc37249f1bfb360c6b3a5c4427d4f8c4f3f3"} err="failed to get container status \"eca88f50cc3e49f5a22cf0722089bc37249f1bfb360c6b3a5c4427d4f8c4f3f3\": rpc error: code = NotFound desc = could not find container \"eca88f50cc3e49f5a22cf0722089bc37249f1bfb360c6b3a5c4427d4f8c4f3f3\": container with ID starting with eca88f50cc3e49f5a22cf0722089bc37249f1bfb360c6b3a5c4427d4f8c4f3f3 not found: ID does not exist"
Nov 04 02:38:35.047646 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:35.047620    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"]
Nov 04 02:38:35.095394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:35.095367    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-ab61a8-859f89f868-l7vgt"]
Nov 04 02:38:35.157490 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:35.157396    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"]
Nov 04 02:38:35.159716 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:35.159694    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-ab61a8-6c47c5594c-8cdzp"]
Nov 04 02:38:36.641449 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:36.641415    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="efa87d42-019e-4814-baf9-ec8577de13a3" path="/var/lib/kubelet/pods/efa87d42-019e-4814-baf9-ec8577de13a3/volumes"
Nov 04 02:38:36.642011 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:36.641985    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="efc4ec72-d671-44b7-9965-8b35438ce8be" path="/var/lib/kubelet/pods/efc4ec72-d671-44b7-9965-8b35438ce8be/volumes"
Nov 04 02:38:39.231284 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.231246    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"]
Nov 04 02:38:39.231753 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.231449    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg" podUID="ecb98692-871b-453d-9677-4f87f884754e" containerName="maas-api" containerID="cri-o://a3a1a5b2970b8acedfe3324c3c7217725c95a3bf7784a05f549b615f6fb54155" gracePeriod=30
Nov 04 02:38:39.505542 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.505515    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:38:39.549304 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.549278    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-maas-api-tls\") pod \"ecb98692-871b-453d-9677-4f87f884754e\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") "
Nov 04 02:38:39.549449 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.549333    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ecb98692-871b-453d-9677-4f87f884754e-kube-api-access-k8njc\" (UniqueName: \"kubernetes.io/projected/ecb98692-871b-453d-9677-4f87f884754e-kube-api-access-k8njc\") pod \"ecb98692-871b-453d-9677-4f87f884754e\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") "
Nov 04 02:38:39.549449 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.549369    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-metrics-certs\") pod \"ecb98692-871b-453d-9677-4f87f884754e\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") "
Nov 04 02:38:39.549449 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.549385    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ecb98692-871b-453d-9677-4f87f884754e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb98692-871b-453d-9677-4f87f884754e-openshift-service-ca\") pod \"ecb98692-871b-453d-9677-4f87f884754e\" (UID: \"ecb98692-871b-453d-9677-4f87f884754e\") "
Nov 04 02:38:39.549904 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.549871    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecb98692-871b-453d-9677-4f87f884754e-openshift-service-ca" pod "ecb98692-871b-453d-9677-4f87f884754e" (UID: "ecb98692-871b-453d-9677-4f87f884754e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:39.551547 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.551519    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-metrics-certs" pod "ecb98692-871b-453d-9677-4f87f884754e" (UID: "ecb98692-871b-453d-9677-4f87f884754e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:38:39.551645 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.551547    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-maas-api-tls" pod "ecb98692-871b-453d-9677-4f87f884754e" (UID: "ecb98692-871b-453d-9677-4f87f884754e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:38:39.551645 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.551584    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb98692-871b-453d-9677-4f87f884754e-kube-api-access-k8njc" pod "ecb98692-871b-453d-9677-4f87f884754e" (UID: "ecb98692-871b-453d-9677-4f87f884754e"). InnerVolumeSpecName "kube-api-access-k8njc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:39.651119 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.651092    5450 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-maas-api-tls\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:39.651119 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.651117    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8njc\" (UniqueName: \"kubernetes.io/projected/ecb98692-871b-453d-9677-4f87f884754e-kube-api-access-k8njc\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:39.651310 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.651128    5450 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb98692-871b-453d-9677-4f87f884754e-metrics-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:39.651310 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.651137    5450 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb98692-871b-453d-9677-4f87f884754e-openshift-service-ca\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:39.923680 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.923644    5450 generic.go:356] "Generic (PLEG): container finished" podID="ecb98692-871b-453d-9677-4f87f884754e" containerID="a3a1a5b2970b8acedfe3324c3c7217725c95a3bf7784a05f549b615f6fb54155" exitCode=0
Nov 04 02:38:39.923849 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.923693    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"
Nov 04 02:38:39.923849 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.923731    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg" event={"ID":"ecb98692-871b-453d-9677-4f87f884754e","Type":"ContainerDied","Data":"a3a1a5b2970b8acedfe3324c3c7217725c95a3bf7784a05f549b615f6fb54155"}
Nov 04 02:38:39.923849 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.923786    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg" event={"ID":"ecb98692-871b-453d-9677-4f87f884754e","Type":"ContainerDied","Data":"033630c06b475e1f2103b2a28db773cd79a11b3d9faa38830f962739597d577d"}
Nov 04 02:38:39.923849 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.923809    5450 scope.go:122] "RemoveContainer" containerID="a3a1a5b2970b8acedfe3324c3c7217725c95a3bf7784a05f549b615f6fb54155"
Nov 04 02:38:39.937860 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.937839    5450 scope.go:122] "RemoveContainer" containerID="a3a1a5b2970b8acedfe3324c3c7217725c95a3bf7784a05f549b615f6fb54155"
Nov 04 02:38:39.938325 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:38:39.938306    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3a1a5b2970b8acedfe3324c3c7217725c95a3bf7784a05f549b615f6fb54155\": container with ID starting with a3a1a5b2970b8acedfe3324c3c7217725c95a3bf7784a05f549b615f6fb54155 not found: ID does not exist" containerID="a3a1a5b2970b8acedfe3324c3c7217725c95a3bf7784a05f549b615f6fb54155"
Nov 04 02:38:39.938400 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:39.938333    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a1a5b2970b8acedfe3324c3c7217725c95a3bf7784a05f549b615f6fb54155"} err="failed to get container status \"a3a1a5b2970b8acedfe3324c3c7217725c95a3bf7784a05f549b615f6fb54155\": rpc error: code = NotFound desc = could not find container \"a3a1a5b2970b8acedfe3324c3c7217725c95a3bf7784a05f549b615f6fb54155\": container with ID starting with a3a1a5b2970b8acedfe3324c3c7217725c95a3bf7784a05f549b615f6fb54155 not found: ID does not exist"
Nov 04 02:38:40.083223 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:40.083188    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"]
Nov 04 02:38:40.131031 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:40.130997    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-31626a-77c7b4d488-lfqfg"]
Nov 04 02:38:40.633709 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:40.633672    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ecb98692-871b-453d-9677-4f87f884754e" path="/var/lib/kubelet/pods/ecb98692-871b-453d-9677-4f87f884754e/volumes"
Nov 04 02:38:41.841785 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:41.841751    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:38:43.628026 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:43.627986    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:38:47.764639 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:38:47.764581    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:38:53.627526 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:53.627482    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:38:54.470855 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:54.470817    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"]
Nov 04 02:38:54.581350 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:54.581317    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"]
Nov 04 02:38:58.067960 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:58.067928    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"]
Nov 04 02:38:58.069279 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:58.069250    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:38:59.471503 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.471458    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4" podUID="97fc2fa4-e688-47b1-a958-97a545c16860" containerName="payload-processing" containerID="cri-o://e9a7077a968dfaabc4749f949c979bcb7b7f324248660ec4f83aad5f588e4613" gracePeriod=25
Nov 04 02:38:59.581942 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.581900    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc" podUID="dedb6bf3-bf24-42c9-987c-52c5acb56d7a" containerName="payload-pre-processing" containerID="cri-o://51214ea9c1e0158d62407e15a51422f8e7d6fb08efc68a2b60807f6a5502209d" gracePeriod=25
Nov 04 02:38:59.754762 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.754737    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"
Nov 04 02:38:59.781501 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.781455    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/97fc2fa4-e688-47b1-a958-97a545c16860-kube-api-access-q8tnl\" (UniqueName: \"kubernetes.io/projected/97fc2fa4-e688-47b1-a958-97a545c16860-kube-api-access-q8tnl\") pod \"97fc2fa4-e688-47b1-a958-97a545c16860\" (UID: \"97fc2fa4-e688-47b1-a958-97a545c16860\") "
Nov 04 02:38:59.781671 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.781615    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/97fc2fa4-e688-47b1-a958-97a545c16860-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97fc2fa4-e688-47b1-a958-97a545c16860-plugins-config-volume\") pod \"97fc2fa4-e688-47b1-a958-97a545c16860\" (UID: \"97fc2fa4-e688-47b1-a958-97a545c16860\") "
Nov 04 02:38:59.782090 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.782059    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97fc2fa4-e688-47b1-a958-97a545c16860-plugins-config-volume" pod "97fc2fa4-e688-47b1-a958-97a545c16860" (UID: "97fc2fa4-e688-47b1-a958-97a545c16860"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:59.782210 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.782165    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97fc2fa4-e688-47b1-a958-97a545c16860-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:59.788622 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.786742    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97fc2fa4-e688-47b1-a958-97a545c16860-kube-api-access-q8tnl" pod "97fc2fa4-e688-47b1-a958-97a545c16860" (UID: "97fc2fa4-e688-47b1-a958-97a545c16860"). InnerVolumeSpecName "kube-api-access-q8tnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:59.843869 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.843845    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"
Nov 04 02:38:59.883055 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.883020    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-plugins-config-volume\") pod \"dedb6bf3-bf24-42c9-987c-52c5acb56d7a\" (UID: \"dedb6bf3-bf24-42c9-987c-52c5acb56d7a\") "
Nov 04 02:38:59.883243 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.883086    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-kube-api-access-j9wmr\" (UniqueName: \"kubernetes.io/projected/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-kube-api-access-j9wmr\") pod \"dedb6bf3-bf24-42c9-987c-52c5acb56d7a\" (UID: \"dedb6bf3-bf24-42c9-987c-52c5acb56d7a\") "
Nov 04 02:38:59.883434 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.883414    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8tnl\" (UniqueName: \"kubernetes.io/projected/97fc2fa4-e688-47b1-a958-97a545c16860-kube-api-access-q8tnl\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:59.883546 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.883482    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-plugins-config-volume" pod "dedb6bf3-bf24-42c9-987c-52c5acb56d7a" (UID: "dedb6bf3-bf24-42c9-987c-52c5acb56d7a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:59.885186 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.885166    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-kube-api-access-j9wmr" pod "dedb6bf3-bf24-42c9-987c-52c5acb56d7a" (UID: "dedb6bf3-bf24-42c9-987c-52c5acb56d7a"). InnerVolumeSpecName "kube-api-access-j9wmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:59.985279 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.985243    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:59.985279 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:38:59.985279    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9wmr\" (UniqueName: \"kubernetes.io/projected/dedb6bf3-bf24-42c9-987c-52c5acb56d7a-kube-api-access-j9wmr\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:00.049877 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.049798    5450 generic.go:356] "Generic (PLEG): container finished" podID="dedb6bf3-bf24-42c9-987c-52c5acb56d7a" containerID="51214ea9c1e0158d62407e15a51422f8e7d6fb08efc68a2b60807f6a5502209d" exitCode=0
Nov 04 02:39:00.049877 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.049848    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"
Nov 04 02:39:00.050173 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.049877    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc" event={"ID":"dedb6bf3-bf24-42c9-987c-52c5acb56d7a","Type":"ContainerDied","Data":"51214ea9c1e0158d62407e15a51422f8e7d6fb08efc68a2b60807f6a5502209d"}
Nov 04 02:39:00.050173 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.049936    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc" event={"ID":"dedb6bf3-bf24-42c9-987c-52c5acb56d7a","Type":"ContainerDied","Data":"8be87e4c5af028684833dd47e796844516610fa1ea3e892be22bf7b2e2d70508"}
Nov 04 02:39:00.050173 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.049964    5450 scope.go:122] "RemoveContainer" containerID="51214ea9c1e0158d62407e15a51422f8e7d6fb08efc68a2b60807f6a5502209d"
Nov 04 02:39:00.051314 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.051291    5450 generic.go:356] "Generic (PLEG): container finished" podID="97fc2fa4-e688-47b1-a958-97a545c16860" containerID="e9a7077a968dfaabc4749f949c979bcb7b7f324248660ec4f83aad5f588e4613" exitCode=0
Nov 04 02:39:00.051438 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.051320    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4" event={"ID":"97fc2fa4-e688-47b1-a958-97a545c16860","Type":"ContainerDied","Data":"e9a7077a968dfaabc4749f949c979bcb7b7f324248660ec4f83aad5f588e4613"}
Nov 04 02:39:00.051438 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.051348    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"
Nov 04 02:39:00.051438 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.051373    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4" event={"ID":"97fc2fa4-e688-47b1-a958-97a545c16860","Type":"ContainerDied","Data":"b2ffcbe7544b90d38638c9f0d7ae8db0c82133efb65934e8dcfa0be879a57d89"}
Nov 04 02:39:00.063673 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.063651    5450 scope.go:122] "RemoveContainer" containerID="51214ea9c1e0158d62407e15a51422f8e7d6fb08efc68a2b60807f6a5502209d"
Nov 04 02:39:00.063964 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:39:00.063944    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51214ea9c1e0158d62407e15a51422f8e7d6fb08efc68a2b60807f6a5502209d\": container with ID starting with 51214ea9c1e0158d62407e15a51422f8e7d6fb08efc68a2b60807f6a5502209d not found: ID does not exist" containerID="51214ea9c1e0158d62407e15a51422f8e7d6fb08efc68a2b60807f6a5502209d"
Nov 04 02:39:00.064020 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.063974    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51214ea9c1e0158d62407e15a51422f8e7d6fb08efc68a2b60807f6a5502209d"} err="failed to get container status \"51214ea9c1e0158d62407e15a51422f8e7d6fb08efc68a2b60807f6a5502209d\": rpc error: code = NotFound desc = could not find container \"51214ea9c1e0158d62407e15a51422f8e7d6fb08efc68a2b60807f6a5502209d\": container with ID starting with 51214ea9c1e0158d62407e15a51422f8e7d6fb08efc68a2b60807f6a5502209d not found: ID does not exist"
Nov 04 02:39:00.064020 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.063994    5450 scope.go:122] "RemoveContainer" containerID="e9a7077a968dfaabc4749f949c979bcb7b7f324248660ec4f83aad5f588e4613"
Nov 04 02:39:00.072764 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.072736    5450 scope.go:122] "RemoveContainer" containerID="e9a7077a968dfaabc4749f949c979bcb7b7f324248660ec4f83aad5f588e4613"
Nov 04 02:39:00.073010 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:39:00.072989    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9a7077a968dfaabc4749f949c979bcb7b7f324248660ec4f83aad5f588e4613\": container with ID starting with e9a7077a968dfaabc4749f949c979bcb7b7f324248660ec4f83aad5f588e4613 not found: ID does not exist" containerID="e9a7077a968dfaabc4749f949c979bcb7b7f324248660ec4f83aad5f588e4613"
Nov 04 02:39:00.073073 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.073022    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9a7077a968dfaabc4749f949c979bcb7b7f324248660ec4f83aad5f588e4613"} err="failed to get container status \"e9a7077a968dfaabc4749f949c979bcb7b7f324248660ec4f83aad5f588e4613\": rpc error: code = NotFound desc = could not find container \"e9a7077a968dfaabc4749f949c979bcb7b7f324248660ec4f83aad5f588e4613\": container with ID starting with e9a7077a968dfaabc4749f949c979bcb7b7f324248660ec4f83aad5f588e4613 not found: ID does not exist"
Nov 04 02:39:00.208521 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.208487    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"]
Nov 04 02:39:00.214018 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.213988    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-d501fd-8546966659-x56fc"]
Nov 04 02:39:00.319121 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.319036    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"]
Nov 04 02:39:00.325887 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.325859    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-d501fd-6dd79696c4-pmlk4"]
Nov 04 02:39:00.633040 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.632962    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="97fc2fa4-e688-47b1-a958-97a545c16860" path="/var/lib/kubelet/pods/97fc2fa4-e688-47b1-a958-97a545c16860/volumes"
Nov 04 02:39:00.633408 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:00.633366    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dedb6bf3-bf24-42c9-987c-52c5acb56d7a" path="/var/lib/kubelet/pods/dedb6bf3-bf24-42c9-987c-52c5acb56d7a/volumes"
Nov 04 02:39:03.069009 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.068960    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing" containerID="cri-o://db7b42ab1b15193bc8339e8f3f0bfb8f48b7e63b732b87e01a08584afd8924db" gracePeriod=25
Nov 04 02:39:03.397162 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.397123    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:39:03.438382 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.438330    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-plugins-config-volume\") pod \"2901ec24-f190-44a2-a184-567d846d4b2e\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") "
Nov 04 02:39:03.438589 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.438487    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-routing-overlay-volume\") pod \"2901ec24-f190-44a2-a184-567d846d4b2e\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") "
Nov 04 02:39:03.438589 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.438584    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-kube-api-access-hqm64\" (UniqueName: \"kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-kube-api-access-hqm64\") pod \"2901ec24-f190-44a2-a184-567d846d4b2e\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") "
Nov 04 02:39:03.438772 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.438643    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-provider-credentials\" (UniqueName: \"kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-provider-credentials\") pod \"2901ec24-f190-44a2-a184-567d846d4b2e\" (UID: \"2901ec24-f190-44a2-a184-567d846d4b2e\") "
Nov 04 02:39:03.438913 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.438882    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-routing-overlay-volume" pod "2901ec24-f190-44a2-a184-567d846d4b2e" (UID: "2901ec24-f190-44a2-a184-567d846d4b2e"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:03.438913 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.438908    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-plugins-config-volume" pod "2901ec24-f190-44a2-a184-567d846d4b2e" (UID: "2901ec24-f190-44a2-a184-567d846d4b2e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:03.439265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.439238    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:03.439265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.439265    5450 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/2901ec24-f190-44a2-a184-567d846d4b2e-routing-overlay-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:03.440875 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.440850    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-kube-api-access-hqm64" pod "2901ec24-f190-44a2-a184-567d846d4b2e" (UID: "2901ec24-f190-44a2-a184-567d846d4b2e"). InnerVolumeSpecName "kube-api-access-hqm64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:03.441285 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.441261    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-provider-credentials" pod "2901ec24-f190-44a2-a184-567d846d4b2e" (UID: "2901ec24-f190-44a2-a184-567d846d4b2e"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:03.541190 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.541146    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqm64\" (UniqueName: \"kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-kube-api-access-hqm64\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:03.541190 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:03.541185    5450 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/2901ec24-f190-44a2-a184-567d846d4b2e-provider-credentials\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:04.139626 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:04.136512    5450 generic.go:356] "Generic (PLEG): container finished" podID="2901ec24-f190-44a2-a184-567d846d4b2e" containerID="db7b42ab1b15193bc8339e8f3f0bfb8f48b7e63b732b87e01a08584afd8924db" exitCode=0
Nov 04 02:39:04.139626 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:04.136698    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" event={"ID":"2901ec24-f190-44a2-a184-567d846d4b2e","Type":"ContainerDied","Data":"db7b42ab1b15193bc8339e8f3f0bfb8f48b7e63b732b87e01a08584afd8924db"}
Nov 04 02:39:04.139626 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:04.136752    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q" event={"ID":"2901ec24-f190-44a2-a184-567d846d4b2e","Type":"ContainerDied","Data":"78b4d50d94010f2922abdc736fec19fe375b26ebf02e1760f6eaf24ca8e34ee9"}
Nov 04 02:39:04.139626 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:04.136783    5450 scope.go:122] "RemoveContainer" containerID="db7b42ab1b15193bc8339e8f3f0bfb8f48b7e63b732b87e01a08584afd8924db"
Nov 04 02:39:04.139626 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:04.136929    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"
Nov 04 02:39:04.156293 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:04.156273    5450 scope.go:122] "RemoveContainer" containerID="db7b42ab1b15193bc8339e8f3f0bfb8f48b7e63b732b87e01a08584afd8924db"
Nov 04 02:39:04.156644 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:39:04.156622    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db7b42ab1b15193bc8339e8f3f0bfb8f48b7e63b732b87e01a08584afd8924db\": container with ID starting with db7b42ab1b15193bc8339e8f3f0bfb8f48b7e63b732b87e01a08584afd8924db not found: ID does not exist" containerID="db7b42ab1b15193bc8339e8f3f0bfb8f48b7e63b732b87e01a08584afd8924db"
Nov 04 02:39:04.156715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:04.156657    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7b42ab1b15193bc8339e8f3f0bfb8f48b7e63b732b87e01a08584afd8924db"} err="failed to get container status \"db7b42ab1b15193bc8339e8f3f0bfb8f48b7e63b732b87e01a08584afd8924db\": rpc error: code = NotFound desc = could not find container \"db7b42ab1b15193bc8339e8f3f0bfb8f48b7e63b732b87e01a08584afd8924db\": container with ID starting with db7b42ab1b15193bc8339e8f3f0bfb8f48b7e63b732b87e01a08584afd8924db not found: ID does not exist"
Nov 04 02:39:04.316619 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:04.315645    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"]
Nov 04 02:39:04.348622 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:04.330004    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["models-as-a-service/payload-processing-external-model-6945776df8-p4k5q"]
Nov 04 02:39:04.644733 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:04.644703    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" path="/var/lib/kubelet/pods/2901ec24-f190-44a2-a184-567d846d4b2e/volumes"
Nov 04 02:39:14.152205 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.152169    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"]
Nov 04 02:39:14.152627 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.152415    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs" podUID="3c6989de-d851-49f9-94b3-6ea0133407b7" containerName="maas-api" containerID="cri-o://aad46384cd08b9469134838ed694c6dc6954f498ab46afe031dd8386a4c6a1dd" gracePeriod=30
Nov 04 02:39:14.423031 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.422962    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:39:14.614912 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.614881    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-maas-api-tls\") pod \"3c6989de-d851-49f9-94b3-6ea0133407b7\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") "
Nov 04 02:39:14.615067 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.614968    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3c6989de-d851-49f9-94b3-6ea0133407b7-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c6989de-d851-49f9-94b3-6ea0133407b7-openshift-service-ca\") pod \"3c6989de-d851-49f9-94b3-6ea0133407b7\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") "
Nov 04 02:39:14.615067 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.615000    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c6989de-d851-49f9-94b3-6ea0133407b7-kube-api-access-chkwc\" (UniqueName: \"kubernetes.io/projected/3c6989de-d851-49f9-94b3-6ea0133407b7-kube-api-access-chkwc\") pod \"3c6989de-d851-49f9-94b3-6ea0133407b7\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") "
Nov 04 02:39:14.615188 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.615071    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-metrics-certs\") pod \"3c6989de-d851-49f9-94b3-6ea0133407b7\" (UID: \"3c6989de-d851-49f9-94b3-6ea0133407b7\") "
Nov 04 02:39:14.615394 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.615363    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c6989de-d851-49f9-94b3-6ea0133407b7-openshift-service-ca" pod "3c6989de-d851-49f9-94b3-6ea0133407b7" (UID: "3c6989de-d851-49f9-94b3-6ea0133407b7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:14.615734 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.615715    5450 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c6989de-d851-49f9-94b3-6ea0133407b7-openshift-service-ca\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:14.617054 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.617024    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-maas-api-tls" pod "3c6989de-d851-49f9-94b3-6ea0133407b7" (UID: "3c6989de-d851-49f9-94b3-6ea0133407b7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:39:14.617149 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.617049    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-metrics-certs" pod "3c6989de-d851-49f9-94b3-6ea0133407b7" (UID: "3c6989de-d851-49f9-94b3-6ea0133407b7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:39:14.617149 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.617067    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c6989de-d851-49f9-94b3-6ea0133407b7-kube-api-access-chkwc" pod "3c6989de-d851-49f9-94b3-6ea0133407b7" (UID: "3c6989de-d851-49f9-94b3-6ea0133407b7"). InnerVolumeSpecName "kube-api-access-chkwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:14.716710 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.716627    5450 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-maas-api-tls\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:14.716710 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.716658    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chkwc\" (UniqueName: \"kubernetes.io/projected/3c6989de-d851-49f9-94b3-6ea0133407b7-kube-api-access-chkwc\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:14.716710 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.716668    5450 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c6989de-d851-49f9-94b3-6ea0133407b7-metrics-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:14.952203 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:14.952167    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"]
Nov 04 02:39:15.211210 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:15.211163    5450 generic.go:356] "Generic (PLEG): container finished" podID="3c6989de-d851-49f9-94b3-6ea0133407b7" containerID="aad46384cd08b9469134838ed694c6dc6954f498ab46afe031dd8386a4c6a1dd" exitCode=0
Nov 04 02:39:15.211751 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:15.211221    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"
Nov 04 02:39:15.211751 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:15.211332    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs" event={"ID":"3c6989de-d851-49f9-94b3-6ea0133407b7","Type":"ContainerDied","Data":"aad46384cd08b9469134838ed694c6dc6954f498ab46afe031dd8386a4c6a1dd"}
Nov 04 02:39:15.211751 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:15.211381    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs" event={"ID":"3c6989de-d851-49f9-94b3-6ea0133407b7","Type":"ContainerDied","Data":"47abe033d9daa024dd99ab92843bb745e73a8a217fa63892031870d609d76d34"}
Nov 04 02:39:15.211751 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:15.211410    5450 scope.go:122] "RemoveContainer" containerID="aad46384cd08b9469134838ed694c6dc6954f498ab46afe031dd8386a4c6a1dd"
Nov 04 02:39:15.226981 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:15.226958    5450 scope.go:122] "RemoveContainer" containerID="aad46384cd08b9469134838ed694c6dc6954f498ab46afe031dd8386a4c6a1dd"
Nov 04 02:39:15.227374 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:39:15.227352    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aad46384cd08b9469134838ed694c6dc6954f498ab46afe031dd8386a4c6a1dd\": container with ID starting with aad46384cd08b9469134838ed694c6dc6954f498ab46afe031dd8386a4c6a1dd not found: ID does not exist" containerID="aad46384cd08b9469134838ed694c6dc6954f498ab46afe031dd8386a4c6a1dd"
Nov 04 02:39:15.227442 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:15.227384    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aad46384cd08b9469134838ed694c6dc6954f498ab46afe031dd8386a4c6a1dd"} err="failed to get container status \"aad46384cd08b9469134838ed694c6dc6954f498ab46afe031dd8386a4c6a1dd\": rpc error: code = NotFound desc = could not find container \"aad46384cd08b9469134838ed694c6dc6954f498ab46afe031dd8386a4c6a1dd\": container with ID starting with aad46384cd08b9469134838ed694c6dc6954f498ab46afe031dd8386a4c6a1dd not found: ID does not exist"
Nov 04 02:39:15.371382 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:15.371341    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"]
Nov 04 02:39:15.374660 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:15.374636    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-ab61a8-5d4c67cf5c-d69fs"]
Nov 04 02:39:16.633165 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:16.633133    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3c6989de-d851-49f9-94b3-6ea0133407b7" path="/var/lib/kubelet/pods/3c6989de-d851-49f9-94b3-6ea0133407b7/volumes"
Nov 04 02:39:17.765397 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:39:17.765357    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:39:20.215767 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.215720    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm" podUID="205307f9-b34c-4a63-925e-425314b48e36" containerName="payload-processing" containerID="cri-o://f57492731111cdef819054a4046b1c3df13ad7614c113f0bda39e361e9f0f388" gracePeriod=25
Nov 04 02:39:20.480997 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.480930    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:39:20.585024 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.584990    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials\" (UniqueName: \"kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials\") pod \"205307f9-b34c-4a63-925e-425314b48e36\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") "
Nov 04 02:39:20.585226 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.585064    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-plugins-config-volume\") pod \"205307f9-b34c-4a63-925e-425314b48e36\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") "
Nov 04 02:39:20.585226 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.585094    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-routing-overlay-volume\") pod \"205307f9-b34c-4a63-925e-425314b48e36\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") "
Nov 04 02:39:20.585226 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.585125    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-kube-api-access-l6m9r\" (UniqueName: \"kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-kube-api-access-l6m9r\") pod \"205307f9-b34c-4a63-925e-425314b48e36\" (UID: \"205307f9-b34c-4a63-925e-425314b48e36\") "
Nov 04 02:39:20.585441 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.585414    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-routing-overlay-volume" pod "205307f9-b34c-4a63-925e-425314b48e36" (UID: "205307f9-b34c-4a63-925e-425314b48e36"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:20.585538 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.585512    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-plugins-config-volume" pod "205307f9-b34c-4a63-925e-425314b48e36" (UID: "205307f9-b34c-4a63-925e-425314b48e36"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:20.585590 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.585519    5450 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-routing-overlay-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:20.587257 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.587234    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials" pod "205307f9-b34c-4a63-925e-425314b48e36" (UID: "205307f9-b34c-4a63-925e-425314b48e36"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:20.587317 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.587257    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-kube-api-access-l6m9r" pod "205307f9-b34c-4a63-925e-425314b48e36" (UID: "205307f9-b34c-4a63-925e-425314b48e36"). InnerVolumeSpecName "kube-api-access-l6m9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:20.686749 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.686716    5450 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-provider-credentials\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:20.686749 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.686746    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/205307f9-b34c-4a63-925e-425314b48e36-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:20.686749 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:20.686757    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6m9r\" (UniqueName: \"kubernetes.io/projected/205307f9-b34c-4a63-925e-425314b48e36-kube-api-access-l6m9r\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:21.249699 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:21.249658    5450 generic.go:356] "Generic (PLEG): container finished" podID="205307f9-b34c-4a63-925e-425314b48e36" containerID="f57492731111cdef819054a4046b1c3df13ad7614c113f0bda39e361e9f0f388" exitCode=0
Nov 04 02:39:21.249699 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:21.249701    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"
Nov 04 02:39:21.250289 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:21.249757    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm" event={"ID":"205307f9-b34c-4a63-925e-425314b48e36","Type":"ContainerDied","Data":"f57492731111cdef819054a4046b1c3df13ad7614c113f0bda39e361e9f0f388"}
Nov 04 02:39:21.250289 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:21.249820    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm" event={"ID":"205307f9-b34c-4a63-925e-425314b48e36","Type":"ContainerDied","Data":"da21dd8520aa3f51bb99c3ab2c2414d9e720d20c7cd88da12b6ede488ad595f5"}
Nov 04 02:39:21.250289 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:21.249856    5450 scope.go:122] "RemoveContainer" containerID="f57492731111cdef819054a4046b1c3df13ad7614c113f0bda39e361e9f0f388"
Nov 04 02:39:21.259089 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:21.259069    5450 scope.go:122] "RemoveContainer" containerID="f57492731111cdef819054a4046b1c3df13ad7614c113f0bda39e361e9f0f388"
Nov 04 02:39:21.259403 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:39:21.259382    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f57492731111cdef819054a4046b1c3df13ad7614c113f0bda39e361e9f0f388\": container with ID starting with f57492731111cdef819054a4046b1c3df13ad7614c113f0bda39e361e9f0f388 not found: ID does not exist" containerID="f57492731111cdef819054a4046b1c3df13ad7614c113f0bda39e361e9f0f388"
Nov 04 02:39:21.259500 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:21.259407    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f57492731111cdef819054a4046b1c3df13ad7614c113f0bda39e361e9f0f388"} err="failed to get container status \"f57492731111cdef819054a4046b1c3df13ad7614c113f0bda39e361e9f0f388\": rpc error: code = NotFound desc = could not find container \"f57492731111cdef819054a4046b1c3df13ad7614c113f0bda39e361e9f0f388\": container with ID starting with f57492731111cdef819054a4046b1c3df13ad7614c113f0bda39e361e9f0f388 not found: ID does not exist"
Nov 04 02:39:21.409800 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:21.409757    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"]
Nov 04 02:39:21.457758 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:21.457715    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["models-as-a-service/payload-processing-external-model-66ccc7f677-72xcm"]
Nov 04 02:39:22.632879 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:22.632802    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="205307f9-b34c-4a63-925e-425314b48e36" path="/var/lib/kubelet/pods/205307f9-b34c-4a63-925e-425314b48e36/volumes"
Nov 04 02:39:23.462208 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:23.462173    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:39:37.556825 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:37.556786    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"]
Nov 04 02:39:37.557300 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:37.556985    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf" podUID="50181e68-e458-41f6-81b2-910538ce6d3a" containerName="istio-proxy" containerID="cri-o://cf9766d0b66d012d0bb1705ed729694f08980329ac6f4b9102fbeccd315fbc6e" gracePeriod=30
Nov 04 02:39:37.805933 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:37.805894    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"]
Nov 04 02:39:37.806135 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:37.806114    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9" podUID="6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01" containerName="maas-api" containerID="cri-o://7ecfa042124b085470cd8561a93eadb43f21adc00e04e7d6cc7522694f25cac6" gracePeriod=30
Nov 04 02:39:38.059976 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.059948    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:39:38.202924 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.202848    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-openshift-service-ca\") pod \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") "
Nov 04 02:39:38.203079 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.203005    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-maas-api-tls\") pod \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") "
Nov 04 02:39:38.203079 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.203051    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-metrics-certs\") pod \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") "
Nov 04 02:39:38.203195 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.203112    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-kube-api-access-8gnlr\" (UniqueName: \"kubernetes.io/projected/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-kube-api-access-8gnlr\") pod \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\" (UID: \"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01\") "
Nov 04 02:39:38.203250 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.203222    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-openshift-service-ca" pod "6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01" (UID: "6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:38.203651 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.203627    5450 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-openshift-service-ca\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:38.205204 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.205177    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-maas-api-tls" pod "6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01" (UID: "6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:39:38.205538 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.205506    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-kube-api-access-8gnlr" pod "6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01" (UID: "6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01"). InnerVolumeSpecName "kube-api-access-8gnlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:38.205681 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.205614    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-metrics-certs" pod "6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01" (UID: "6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:39:38.304540 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.304510    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gnlr\" (UniqueName: \"kubernetes.io/projected/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-kube-api-access-8gnlr\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:38.304540 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.304537    5450 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-maas-api-tls\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:38.304540 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.304546    5450 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01-metrics-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:38.408240 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.408206    5450 generic.go:356] "Generic (PLEG): container finished" podID="6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01" containerID="7ecfa042124b085470cd8561a93eadb43f21adc00e04e7d6cc7522694f25cac6" exitCode=0
Nov 04 02:39:38.408416 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.408246    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"
Nov 04 02:39:38.408416 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.408289    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9" event={"ID":"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01","Type":"ContainerDied","Data":"7ecfa042124b085470cd8561a93eadb43f21adc00e04e7d6cc7522694f25cac6"}
Nov 04 02:39:38.408416 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.408343    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9" event={"ID":"6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01","Type":"ContainerDied","Data":"ec9426300b6f5b31a04bd259edf16538ca968f6588d11ef3e997c342711db836"}
Nov 04 02:39:38.408416 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.408365    5450 scope.go:122] "RemoveContainer" containerID="7ecfa042124b085470cd8561a93eadb43f21adc00e04e7d6cc7522694f25cac6"
Nov 04 02:39:38.418503 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.418486    5450 scope.go:122] "RemoveContainer" containerID="7ecfa042124b085470cd8561a93eadb43f21adc00e04e7d6cc7522694f25cac6"
Nov 04 02:39:38.418803 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:39:38.418785    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ecfa042124b085470cd8561a93eadb43f21adc00e04e7d6cc7522694f25cac6\": container with ID starting with 7ecfa042124b085470cd8561a93eadb43f21adc00e04e7d6cc7522694f25cac6 not found: ID does not exist" containerID="7ecfa042124b085470cd8561a93eadb43f21adc00e04e7d6cc7522694f25cac6"
Nov 04 02:39:38.418861 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.418812    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ecfa042124b085470cd8561a93eadb43f21adc00e04e7d6cc7522694f25cac6"} err="failed to get container status \"7ecfa042124b085470cd8561a93eadb43f21adc00e04e7d6cc7522694f25cac6\": rpc error: code = NotFound desc = could not find container \"7ecfa042124b085470cd8561a93eadb43f21adc00e04e7d6cc7522694f25cac6\": container with ID starting with 7ecfa042124b085470cd8561a93eadb43f21adc00e04e7d6cc7522694f25cac6 not found: ID does not exist"
Nov 04 02:39:38.566934 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.566902    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"]
Nov 04 02:39:38.575893 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.575861    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-d501fd-84f975795b-pn8v9"]
Nov 04 02:39:38.633649 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:38.633616    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01" path="/var/lib/kubelet/pods/6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01/volumes"
Nov 04 02:39:42.847500 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.847475    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:39:42.961506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.961472    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-certs\") pod \"50181e68-e458-41f6-81b2-910538ce6d3a\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") "
Nov 04 02:39:42.961506 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.961510    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/50181e68-e458-41f6-81b2-910538ce6d3a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50181e68-e458-41f6-81b2-910538ce6d3a-istio-podinfo\") pod \"50181e68-e458-41f6-81b2-910538ce6d3a\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") "
Nov 04 02:39:42.961803 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.961528    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50181e68-e458-41f6-81b2-910538ce6d3a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50181e68-e458-41f6-81b2-910538ce6d3a-istiod-ca-cert\") pod \"50181e68-e458-41f6-81b2-910538ce6d3a\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") "
Nov 04 02:39:42.961803 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.961577    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-socket\") pod \"50181e68-e458-41f6-81b2-910538ce6d3a\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") "
Nov 04 02:39:42.961803 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.961645    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-data\") pod \"50181e68-e458-41f6-81b2-910538ce6d3a\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") "
Nov 04 02:39:42.961803 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.961747    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-envoy\") pod \"50181e68-e458-41f6-81b2-910538ce6d3a\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") "
Nov 04 02:39:42.962000 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.961807    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-kube-api-access-5jxvw\" (UniqueName: \"kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-kube-api-access-5jxvw\") pod \"50181e68-e458-41f6-81b2-910538ce6d3a\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") "
Nov 04 02:39:42.962000 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.961849    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-istio-token\" (UniqueName: \"kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-istio-token\") pod \"50181e68-e458-41f6-81b2-910538ce6d3a\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") "
Nov 04 02:39:42.962000 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.961881    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-certs" pod "50181e68-e458-41f6-81b2-910538ce6d3a" (UID: "50181e68-e458-41f6-81b2-910538ce6d3a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:42.962000 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.961938    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-socket" pod "50181e68-e458-41f6-81b2-910538ce6d3a" (UID: "50181e68-e458-41f6-81b2-910538ce6d3a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:42.962198 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.962004    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-credential-socket\") pod \"50181e68-e458-41f6-81b2-910538ce6d3a\" (UID: \"50181e68-e458-41f6-81b2-910538ce6d3a\") "
Nov 04 02:39:42.962198 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.962029    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50181e68-e458-41f6-81b2-910538ce6d3a-istiod-ca-cert" pod "50181e68-e458-41f6-81b2-910538ce6d3a" (UID: "50181e68-e458-41f6-81b2-910538ce6d3a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:42.962297 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.962255    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-data" pod "50181e68-e458-41f6-81b2-910538ce6d3a" (UID: "50181e68-e458-41f6-81b2-910538ce6d3a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:42.962297 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.962270    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-credential-socket" pod "50181e68-e458-41f6-81b2-910538ce6d3a" (UID: "50181e68-e458-41f6-81b2-910538ce6d3a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:42.962582 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.962563    5450 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-credential-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:42.962667 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.962584    5450 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:42.962667 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.962622    5450 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50181e68-e458-41f6-81b2-910538ce6d3a-istiod-ca-cert\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:42.962667 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.962632    5450 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-workload-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:42.962667 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.962641    5450 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-data\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:42.964505 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.964381    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-istio-token" pod "50181e68-e458-41f6-81b2-910538ce6d3a" (UID: "50181e68-e458-41f6-81b2-910538ce6d3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:42.964505 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.964442    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50181e68-e458-41f6-81b2-910538ce6d3a-istio-podinfo" pod "50181e68-e458-41f6-81b2-910538ce6d3a" (UID: "50181e68-e458-41f6-81b2-910538ce6d3a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:39:42.964505 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.964454    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-envoy" pod "50181e68-e458-41f6-81b2-910538ce6d3a" (UID: "50181e68-e458-41f6-81b2-910538ce6d3a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:42.964505 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:42.964473    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-kube-api-access-5jxvw" pod "50181e68-e458-41f6-81b2-910538ce6d3a" (UID: "50181e68-e458-41f6-81b2-910538ce6d3a"). InnerVolumeSpecName "kube-api-access-5jxvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:43.063868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:43.063830    5450 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50181e68-e458-41f6-81b2-910538ce6d3a-istio-podinfo\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:43.063868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:43.063861    5450 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50181e68-e458-41f6-81b2-910538ce6d3a-istio-envoy\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:43.063868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:43.063872    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jxvw\" (UniqueName: \"kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-kube-api-access-5jxvw\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:43.064114 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:43.063881    5450 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50181e68-e458-41f6-81b2-910538ce6d3a-istio-token\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:43.442233 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:43.442197    5450 generic.go:356] "Generic (PLEG): container finished" podID="50181e68-e458-41f6-81b2-910538ce6d3a" containerID="cf9766d0b66d012d0bb1705ed729694f08980329ac6f4b9102fbeccd315fbc6e" exitCode=0
Nov 04 02:39:43.442409 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:43.442246    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"
Nov 04 02:39:43.442409 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:43.442282    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf" event={"ID":"50181e68-e458-41f6-81b2-910538ce6d3a","Type":"ContainerDied","Data":"cf9766d0b66d012d0bb1705ed729694f08980329ac6f4b9102fbeccd315fbc6e"}
Nov 04 02:39:43.442409 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:43.442345    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf" event={"ID":"50181e68-e458-41f6-81b2-910538ce6d3a","Type":"ContainerDied","Data":"ed3ca578e5a1600f841dc8460bb63978f0f3ef0d411cd0956cd2afa37e912178"}
Nov 04 02:39:43.442409 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:43.442376    5450 scope.go:122] "RemoveContainer" containerID="cf9766d0b66d012d0bb1705ed729694f08980329ac6f4b9102fbeccd315fbc6e"
Nov 04 02:39:43.452475 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:43.452457    5450 scope.go:122] "RemoveContainer" containerID="cf9766d0b66d012d0bb1705ed729694f08980329ac6f4b9102fbeccd315fbc6e"
Nov 04 02:39:43.452774 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:39:43.452758    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf9766d0b66d012d0bb1705ed729694f08980329ac6f4b9102fbeccd315fbc6e\": container with ID starting with cf9766d0b66d012d0bb1705ed729694f08980329ac6f4b9102fbeccd315fbc6e not found: ID does not exist" containerID="cf9766d0b66d012d0bb1705ed729694f08980329ac6f4b9102fbeccd315fbc6e"
Nov 04 02:39:43.452858 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:43.452781    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf9766d0b66d012d0bb1705ed729694f08980329ac6f4b9102fbeccd315fbc6e"} err="failed to get container status \"cf9766d0b66d012d0bb1705ed729694f08980329ac6f4b9102fbeccd315fbc6e\": rpc error: code = NotFound desc = could not find container \"cf9766d0b66d012d0bb1705ed729694f08980329ac6f4b9102fbeccd315fbc6e\": container with ID starting with cf9766d0b66d012d0bb1705ed729694f08980329ac6f4b9102fbeccd315fbc6e not found: ID does not exist"
Nov 04 02:39:43.604426 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:43.604387    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"]
Nov 04 02:39:43.652501 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:43.652471    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-zlwnf"]
Nov 04 02:39:44.633337 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:44.633304    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50181e68-e458-41f6-81b2-910538ce6d3a" path="/var/lib/kubelet/pods/50181e68-e458-41f6-81b2-910538ce6d3a/volumes"
Nov 04 02:39:46.578573 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:39:46.578537    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:39:47.764359 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:39:47.764322    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:40:01.706673 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:01.706636    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"]
Nov 04 02:40:01.810263 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:01.810227    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"]
Nov 04 02:40:06.160352 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:06.160308    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"]
Nov 04 02:40:06.263880 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:06.263838    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"]
Nov 04 02:40:06.707805 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:06.707746    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz" podUID="b1a697a2-dd3a-4efa-9575-c095e8081fd5" containerName="payload-processing" containerID="cri-o://900c5dd1e9a5d592eef6da4a015fbe2f5628588469c529888cb15cb3e42c4939" gracePeriod=25
Nov 04 02:40:06.811015 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:06.810940    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln" podUID="d107791d-401c-469f-8d48-749147f7ef24" containerName="payload-pre-processing" containerID="cri-o://98190982ca94fb5cdb117b6e3086add3c828bfc433e31099f5552ae4ea2858c7" gracePeriod=25
Nov 04 02:40:06.976628 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:06.976606    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"
Nov 04 02:40:07.128717 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.128688    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1a697a2-dd3a-4efa-9575-c095e8081fd5-kube-api-access-6bks6\" (UniqueName: \"kubernetes.io/projected/b1a697a2-dd3a-4efa-9575-c095e8081fd5-kube-api-access-6bks6\") pod \"b1a697a2-dd3a-4efa-9575-c095e8081fd5\" (UID: \"b1a697a2-dd3a-4efa-9575-c095e8081fd5\") "
Nov 04 02:40:07.128874 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.128813    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1a697a2-dd3a-4efa-9575-c095e8081fd5-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1a697a2-dd3a-4efa-9575-c095e8081fd5-plugins-config-volume\") pod \"b1a697a2-dd3a-4efa-9575-c095e8081fd5\" (UID: \"b1a697a2-dd3a-4efa-9575-c095e8081fd5\") "
Nov 04 02:40:07.129168 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.129147    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1a697a2-dd3a-4efa-9575-c095e8081fd5-plugins-config-volume" pod "b1a697a2-dd3a-4efa-9575-c095e8081fd5" (UID: "b1a697a2-dd3a-4efa-9575-c095e8081fd5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:07.129289 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.129272    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1a697a2-dd3a-4efa-9575-c095e8081fd5-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:07.130784 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.130763    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1a697a2-dd3a-4efa-9575-c095e8081fd5-kube-api-access-6bks6" pod "b1a697a2-dd3a-4efa-9575-c095e8081fd5" (UID: "b1a697a2-dd3a-4efa-9575-c095e8081fd5"). InnerVolumeSpecName "kube-api-access-6bks6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:07.230768 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.230698    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bks6\" (UniqueName: \"kubernetes.io/projected/b1a697a2-dd3a-4efa-9575-c095e8081fd5-kube-api-access-6bks6\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:07.597405 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.597367    5450 generic.go:356] "Generic (PLEG): container finished" podID="b1a697a2-dd3a-4efa-9575-c095e8081fd5" containerID="900c5dd1e9a5d592eef6da4a015fbe2f5628588469c529888cb15cb3e42c4939" exitCode=0
Nov 04 02:40:07.597631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.597414    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"
Nov 04 02:40:07.597631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.597456    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz" event={"ID":"b1a697a2-dd3a-4efa-9575-c095e8081fd5","Type":"ContainerDied","Data":"900c5dd1e9a5d592eef6da4a015fbe2f5628588469c529888cb15cb3e42c4939"}
Nov 04 02:40:07.597631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.597521    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz" event={"ID":"b1a697a2-dd3a-4efa-9575-c095e8081fd5","Type":"ContainerDied","Data":"afa47d3d55fdf8dfe47058fb72cea001a4bf8ed00877748eecb7ecf967007380"}
Nov 04 02:40:07.597631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.597544    5450 scope.go:122] "RemoveContainer" containerID="900c5dd1e9a5d592eef6da4a015fbe2f5628588469c529888cb15cb3e42c4939"
Nov 04 02:40:07.607977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.607959    5450 scope.go:122] "RemoveContainer" containerID="900c5dd1e9a5d592eef6da4a015fbe2f5628588469c529888cb15cb3e42c4939"
Nov 04 02:40:07.608244 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:40:07.608222    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"900c5dd1e9a5d592eef6da4a015fbe2f5628588469c529888cb15cb3e42c4939\": container with ID starting with 900c5dd1e9a5d592eef6da4a015fbe2f5628588469c529888cb15cb3e42c4939 not found: ID does not exist" containerID="900c5dd1e9a5d592eef6da4a015fbe2f5628588469c529888cb15cb3e42c4939"
Nov 04 02:40:07.608337 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.608250    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"900c5dd1e9a5d592eef6da4a015fbe2f5628588469c529888cb15cb3e42c4939"} err="failed to get container status \"900c5dd1e9a5d592eef6da4a015fbe2f5628588469c529888cb15cb3e42c4939\": rpc error: code = NotFound desc = could not find container \"900c5dd1e9a5d592eef6da4a015fbe2f5628588469c529888cb15cb3e42c4939\": container with ID starting with 900c5dd1e9a5d592eef6da4a015fbe2f5628588469c529888cb15cb3e42c4939 not found: ID does not exist"
Nov 04 02:40:07.767260 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.766563    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"]
Nov 04 02:40:07.806028 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:07.805993    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-6c403f-f697477cb-c2qsz"]
Nov 04 02:40:08.633457 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:08.633412    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1a697a2-dd3a-4efa-9575-c095e8081fd5" path="/var/lib/kubelet/pods/b1a697a2-dd3a-4efa-9575-c095e8081fd5/volumes"
Nov 04 02:40:10.182374 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:10.182342    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:40:11.160879 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.160840    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt" podUID="76eb656d-9d15-46bc-b921-b7400173e867" containerName="payload-processing" containerID="cri-o://62407a62cfc4f2c7213ea24f78ced453c24b2f4ee3e051eb123bbb5fb5ec1cb4" gracePeriod=25
Nov 04 02:40:11.264627 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.264555    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7" podUID="e13dcd76-74dd-4201-bb8b-612f7be49c32" containerName="payload-pre-processing" containerID="cri-o://e0b40d57a2145b59e6be8773a6b130100ae2353b3a015356509ec3f9ccc833d4" gracePeriod=25
Nov 04 02:40:11.469024 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.468994    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"
Nov 04 02:40:11.577804 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.577766    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/76eb656d-9d15-46bc-b921-b7400173e867-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76eb656d-9d15-46bc-b921-b7400173e867-plugins-config-volume\") pod \"76eb656d-9d15-46bc-b921-b7400173e867\" (UID: \"76eb656d-9d15-46bc-b921-b7400173e867\") "
Nov 04 02:40:11.578037 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.577833    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76eb656d-9d15-46bc-b921-b7400173e867-kube-api-access-kvp6m\" (UniqueName: \"kubernetes.io/projected/76eb656d-9d15-46bc-b921-b7400173e867-kube-api-access-kvp6m\") pod \"76eb656d-9d15-46bc-b921-b7400173e867\" (UID: \"76eb656d-9d15-46bc-b921-b7400173e867\") "
Nov 04 02:40:11.578338 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.578293    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76eb656d-9d15-46bc-b921-b7400173e867-plugins-config-volume" pod "76eb656d-9d15-46bc-b921-b7400173e867" (UID: "76eb656d-9d15-46bc-b921-b7400173e867"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:11.585569 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.585539    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76eb656d-9d15-46bc-b921-b7400173e867-kube-api-access-kvp6m" pod "76eb656d-9d15-46bc-b921-b7400173e867" (UID: "76eb656d-9d15-46bc-b921-b7400173e867"). InnerVolumeSpecName "kube-api-access-kvp6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:11.630910 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.630875    5450 generic.go:356] "Generic (PLEG): container finished" podID="76eb656d-9d15-46bc-b921-b7400173e867" containerID="62407a62cfc4f2c7213ea24f78ced453c24b2f4ee3e051eb123bbb5fb5ec1cb4" exitCode=0
Nov 04 02:40:11.631198 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.631174    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt" event={"ID":"76eb656d-9d15-46bc-b921-b7400173e867","Type":"ContainerDied","Data":"62407a62cfc4f2c7213ea24f78ced453c24b2f4ee3e051eb123bbb5fb5ec1cb4"}
Nov 04 02:40:11.631346 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.631328    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt" event={"ID":"76eb656d-9d15-46bc-b921-b7400173e867","Type":"ContainerDied","Data":"42fc94c18764f31c9ac9789cb2582c5842117857f155d27b24672eb290245143"}
Nov 04 02:40:11.631469 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.631455    5450 scope.go:122] "RemoveContainer" containerID="62407a62cfc4f2c7213ea24f78ced453c24b2f4ee3e051eb123bbb5fb5ec1cb4"
Nov 04 02:40:11.631718 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.631699    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"
Nov 04 02:40:11.658388 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.658306    5450 scope.go:122] "RemoveContainer" containerID="62407a62cfc4f2c7213ea24f78ced453c24b2f4ee3e051eb123bbb5fb5ec1cb4"
Nov 04 02:40:11.658696 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:40:11.658672    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62407a62cfc4f2c7213ea24f78ced453c24b2f4ee3e051eb123bbb5fb5ec1cb4\": container with ID starting with 62407a62cfc4f2c7213ea24f78ced453c24b2f4ee3e051eb123bbb5fb5ec1cb4 not found: ID does not exist" containerID="62407a62cfc4f2c7213ea24f78ced453c24b2f4ee3e051eb123bbb5fb5ec1cb4"
Nov 04 02:40:11.658852 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.658708    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62407a62cfc4f2c7213ea24f78ced453c24b2f4ee3e051eb123bbb5fb5ec1cb4"} err="failed to get container status \"62407a62cfc4f2c7213ea24f78ced453c24b2f4ee3e051eb123bbb5fb5ec1cb4\": rpc error: code = NotFound desc = could not find container \"62407a62cfc4f2c7213ea24f78ced453c24b2f4ee3e051eb123bbb5fb5ec1cb4\": container with ID starting with 62407a62cfc4f2c7213ea24f78ced453c24b2f4ee3e051eb123bbb5fb5ec1cb4 not found: ID does not exist"
Nov 04 02:40:11.679060 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.679025    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76eb656d-9d15-46bc-b921-b7400173e867-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:11.679194 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.679063    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvp6m\" (UniqueName: \"kubernetes.io/projected/76eb656d-9d15-46bc-b921-b7400173e867-kube-api-access-kvp6m\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:11.794758 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.794692    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"]
Nov 04 02:40:11.800321 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:11.800249    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-ab53c1-85dc94c9c6-vtzqt"]
Nov 04 02:40:12.690622 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:12.688684    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76eb656d-9d15-46bc-b921-b7400173e867" path="/var/lib/kubelet/pods/76eb656d-9d15-46bc-b921-b7400173e867/volumes"
Nov 04 02:40:13.741620 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:13.741430    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"]
Nov 04 02:40:13.742128 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:13.741799    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r" podUID="ebf46132-a37c-44d8-8131-66ff63df710a" containerName="maas-api" containerID="cri-o://20d76d74c9fac9854f41d8fa0a97697dbedc604a6ac8098ee8b480880794e947" gracePeriod=30
Nov 04 02:40:14.103510 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.103484    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:40:14.166268 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.166234    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-metrics-certs\") pod \"ebf46132-a37c-44d8-8131-66ff63df710a\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") "
Nov 04 02:40:14.166459 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.166313    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebf46132-a37c-44d8-8131-66ff63df710a-kube-api-access-bwbz5\" (UniqueName: \"kubernetes.io/projected/ebf46132-a37c-44d8-8131-66ff63df710a-kube-api-access-bwbz5\") pod \"ebf46132-a37c-44d8-8131-66ff63df710a\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") "
Nov 04 02:40:14.166459 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.166448    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-maas-api-tls\") pod \"ebf46132-a37c-44d8-8131-66ff63df710a\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") "
Nov 04 02:40:14.166582 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.166514    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ebf46132-a37c-44d8-8131-66ff63df710a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebf46132-a37c-44d8-8131-66ff63df710a-openshift-service-ca\") pod \"ebf46132-a37c-44d8-8131-66ff63df710a\" (UID: \"ebf46132-a37c-44d8-8131-66ff63df710a\") "
Nov 04 02:40:14.166922 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.166870    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebf46132-a37c-44d8-8131-66ff63df710a-openshift-service-ca" pod "ebf46132-a37c-44d8-8131-66ff63df710a" (UID: "ebf46132-a37c-44d8-8131-66ff63df710a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:14.168993 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.168937    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-metrics-certs" pod "ebf46132-a37c-44d8-8131-66ff63df710a" (UID: "ebf46132-a37c-44d8-8131-66ff63df710a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:14.168993 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.168988    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebf46132-a37c-44d8-8131-66ff63df710a-kube-api-access-bwbz5" pod "ebf46132-a37c-44d8-8131-66ff63df710a" (UID: "ebf46132-a37c-44d8-8131-66ff63df710a"). InnerVolumeSpecName "kube-api-access-bwbz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:14.169306 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.169271    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-maas-api-tls" pod "ebf46132-a37c-44d8-8131-66ff63df710a" (UID: "ebf46132-a37c-44d8-8131-66ff63df710a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:14.267774 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.267738    5450 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-maas-api-tls\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:14.267774 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.267770    5450 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebf46132-a37c-44d8-8131-66ff63df710a-openshift-service-ca\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:14.267774 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.267780    5450 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebf46132-a37c-44d8-8131-66ff63df710a-metrics-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:14.268087 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.267789    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwbz5\" (UniqueName: \"kubernetes.io/projected/ebf46132-a37c-44d8-8131-66ff63df710a-kube-api-access-bwbz5\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:14.805050 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.805019    5450 generic.go:356] "Generic (PLEG): container finished" podID="ebf46132-a37c-44d8-8131-66ff63df710a" containerID="20d76d74c9fac9854f41d8fa0a97697dbedc604a6ac8098ee8b480880794e947" exitCode=0
Nov 04 02:40:14.805580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.805065    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"
Nov 04 02:40:14.805580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.805064    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r" event={"ID":"ebf46132-a37c-44d8-8131-66ff63df710a","Type":"ContainerDied","Data":"20d76d74c9fac9854f41d8fa0a97697dbedc604a6ac8098ee8b480880794e947"}
Nov 04 02:40:14.805580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.805210    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r" event={"ID":"ebf46132-a37c-44d8-8131-66ff63df710a","Type":"ContainerDied","Data":"7632bee11174b342af18f0135dd9e6e16a551d13be7c9f32cff65686488da49f"}
Nov 04 02:40:14.805580 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.805247    5450 scope.go:122] "RemoveContainer" containerID="20d76d74c9fac9854f41d8fa0a97697dbedc604a6ac8098ee8b480880794e947"
Nov 04 02:40:14.814504 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.814474    5450 scope.go:122] "RemoveContainer" containerID="20d76d74c9fac9854f41d8fa0a97697dbedc604a6ac8098ee8b480880794e947"
Nov 04 02:40:14.814775 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:40:14.814754    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20d76d74c9fac9854f41d8fa0a97697dbedc604a6ac8098ee8b480880794e947\": container with ID starting with 20d76d74c9fac9854f41d8fa0a97697dbedc604a6ac8098ee8b480880794e947 not found: ID does not exist" containerID="20d76d74c9fac9854f41d8fa0a97697dbedc604a6ac8098ee8b480880794e947"
Nov 04 02:40:14.814831 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.814788    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20d76d74c9fac9854f41d8fa0a97697dbedc604a6ac8098ee8b480880794e947"} err="failed to get container status \"20d76d74c9fac9854f41d8fa0a97697dbedc604a6ac8098ee8b480880794e947\": rpc error: code = NotFound desc = could not find container \"20d76d74c9fac9854f41d8fa0a97697dbedc604a6ac8098ee8b480880794e947\": container with ID starting with 20d76d74c9fac9854f41d8fa0a97697dbedc604a6ac8098ee8b480880794e947 not found: ID does not exist"
Nov 04 02:40:14.964070 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:14.963991    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"]
Nov 04 02:40:15.011923 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:15.011895    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2ba6b8-75b958b9cf-jbl4r"]
Nov 04 02:40:15.741366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:15.741329    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln" podUID="d107791d-401c-469f-8d48-749147f7ef24" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:40:16.632724 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:16.632686    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ebf46132-a37c-44d8-8131-66ff63df710a" path="/var/lib/kubelet/pods/ebf46132-a37c-44d8-8131-66ff63df710a/volumes"
Nov 04 02:40:17.764286 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:40:17.764248    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:40:20.708445 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:20.708409    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7" podUID="e13dcd76-74dd-4201-bb8b-612f7be49c32" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:40:20.960491 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:20.960419    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"]
Nov 04 02:40:20.960662 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:20.960627    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j" podUID="9e6274d8-5084-48c5-bb87-83090caea8fb" containerName="maas-api" containerID="cri-o://baac811fc07f4f9df0fcaeef063992102979590944b200b60506d7015ea4117f" gracePeriod=30
Nov 04 02:40:21.218407 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.218347    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:40:21.244504 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.244474    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-metrics-certs\") pod \"9e6274d8-5084-48c5-bb87-83090caea8fb\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") "
Nov 04 02:40:21.244654 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.244561    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e6274d8-5084-48c5-bb87-83090caea8fb-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e6274d8-5084-48c5-bb87-83090caea8fb-openshift-service-ca\") pod \"9e6274d8-5084-48c5-bb87-83090caea8fb\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") "
Nov 04 02:40:21.244728 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.244656    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-maas-api-tls\") pod \"9e6274d8-5084-48c5-bb87-83090caea8fb\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") "
Nov 04 02:40:21.244805 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.244789    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e6274d8-5084-48c5-bb87-83090caea8fb-kube-api-access-jt6gd\" (UniqueName: \"kubernetes.io/projected/9e6274d8-5084-48c5-bb87-83090caea8fb-kube-api-access-jt6gd\") pod \"9e6274d8-5084-48c5-bb87-83090caea8fb\" (UID: \"9e6274d8-5084-48c5-bb87-83090caea8fb\") "
Nov 04 02:40:21.244914 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.244888    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e6274d8-5084-48c5-bb87-83090caea8fb-openshift-service-ca" pod "9e6274d8-5084-48c5-bb87-83090caea8fb" (UID: "9e6274d8-5084-48c5-bb87-83090caea8fb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:21.245194 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.245171    5450 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e6274d8-5084-48c5-bb87-83090caea8fb-openshift-service-ca\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:21.246586 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.246557    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-metrics-certs" pod "9e6274d8-5084-48c5-bb87-83090caea8fb" (UID: "9e6274d8-5084-48c5-bb87-83090caea8fb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:21.246586 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.246576    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-maas-api-tls" pod "9e6274d8-5084-48c5-bb87-83090caea8fb" (UID: "9e6274d8-5084-48c5-bb87-83090caea8fb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:21.246752 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.246680    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e6274d8-5084-48c5-bb87-83090caea8fb-kube-api-access-jt6gd" pod "9e6274d8-5084-48c5-bb87-83090caea8fb" (UID: "9e6274d8-5084-48c5-bb87-83090caea8fb"). InnerVolumeSpecName "kube-api-access-jt6gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:21.346074 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.346043    5450 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-maas-api-tls\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:21.346074 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.346070    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt6gd\" (UniqueName: \"kubernetes.io/projected/9e6274d8-5084-48c5-bb87-83090caea8fb-kube-api-access-jt6gd\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:21.346074 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.346080    5450 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e6274d8-5084-48c5-bb87-83090caea8fb-metrics-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:21.847304 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.847273    5450 generic.go:356] "Generic (PLEG): container finished" podID="9e6274d8-5084-48c5-bb87-83090caea8fb" containerID="baac811fc07f4f9df0fcaeef063992102979590944b200b60506d7015ea4117f" exitCode=0
Nov 04 02:40:21.847719 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.847313    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j" event={"ID":"9e6274d8-5084-48c5-bb87-83090caea8fb","Type":"ContainerDied","Data":"baac811fc07f4f9df0fcaeef063992102979590944b200b60506d7015ea4117f"}
Nov 04 02:40:21.847719 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.847320    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"
Nov 04 02:40:21.847719 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.847351    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j" event={"ID":"9e6274d8-5084-48c5-bb87-83090caea8fb","Type":"ContainerDied","Data":"43d8081a16c6d20d8aa8465f5752ff3b85adedf319c5460b53eddcf1bd51be38"}
Nov 04 02:40:21.847719 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.847373    5450 scope.go:122] "RemoveContainer" containerID="baac811fc07f4f9df0fcaeef063992102979590944b200b60506d7015ea4117f"
Nov 04 02:40:21.856675 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.856652    5450 scope.go:122] "RemoveContainer" containerID="baac811fc07f4f9df0fcaeef063992102979590944b200b60506d7015ea4117f"
Nov 04 02:40:21.856917 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:40:21.856896    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baac811fc07f4f9df0fcaeef063992102979590944b200b60506d7015ea4117f\": container with ID starting with baac811fc07f4f9df0fcaeef063992102979590944b200b60506d7015ea4117f not found: ID does not exist" containerID="baac811fc07f4f9df0fcaeef063992102979590944b200b60506d7015ea4117f"
Nov 04 02:40:21.856977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:21.856929    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baac811fc07f4f9df0fcaeef063992102979590944b200b60506d7015ea4117f"} err="failed to get container status \"baac811fc07f4f9df0fcaeef063992102979590944b200b60506d7015ea4117f\": rpc error: code = NotFound desc = could not find container \"baac811fc07f4f9df0fcaeef063992102979590944b200b60506d7015ea4117f\": container with ID starting with baac811fc07f4f9df0fcaeef063992102979590944b200b60506d7015ea4117f not found: ID does not exist"
Nov 04 02:40:22.005521 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.005494    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"]
Nov 04 02:40:22.053419 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.053390    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-6c403f-59fb497959-bf68j"]
Nov 04 02:40:22.632517 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.632467    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e6274d8-5084-48c5-bb87-83090caea8fb" path="/var/lib/kubelet/pods/9e6274d8-5084-48c5-bb87-83090caea8fb/volumes"
Nov 04 02:40:22.937557 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.937476    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"]
Nov 04 02:40:22.938083 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938067    5450 cpu_manager.go:414] "containerMap: removing container" podUID="9e6274d8-5084-48c5-bb87-83090caea8fb" containerName="maas-api"
Nov 04 02:40:22.938126 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938084    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e6274d8-5084-48c5-bb87-83090caea8fb" containerName="maas-api"
Nov 04 02:40:22.938126 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938098    5450 cpu_manager.go:414] "containerMap: removing container" podUID="50181e68-e458-41f6-81b2-910538ce6d3a" containerName="istio-proxy"
Nov 04 02:40:22.938126 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938104    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50181e68-e458-41f6-81b2-910538ce6d3a" containerName="istio-proxy"
Nov 04 02:40:22.938126 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938117    5450 cpu_manager.go:414] "containerMap: removing container" podUID="0503b120-75d9-4173-a709-c4fd3af91b26" containerName="payload-processing"
Nov 04 02:40:22.938126 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938122    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0503b120-75d9-4173-a709-c4fd3af91b26" containerName="payload-processing"
Nov 04 02:40:22.938126 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938128    5450 cpu_manager.go:414] "containerMap: removing container" podUID="ecb98692-871b-453d-9677-4f87f884754e" containerName="maas-api"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938132    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ecb98692-871b-453d-9677-4f87f884754e" containerName="maas-api"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938141    5450 cpu_manager.go:414] "containerMap: removing container" podUID="17692d26-e7ea-4ce5-b182-10e51eeeaebc" containerName="payload-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938145    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="17692d26-e7ea-4ce5-b182-10e51eeeaebc" containerName="payload-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938153    5450 cpu_manager.go:414] "containerMap: removing container" podUID="170a5ee7-56d5-4218-90db-9e3d495e9247" containerName="payload-pre-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938158    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="170a5ee7-56d5-4218-90db-9e3d495e9247" containerName="payload-pre-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938165    5450 cpu_manager.go:414] "containerMap: removing container" podUID="6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01" containerName="maas-api"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938169    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01" containerName="maas-api"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938177    5450 cpu_manager.go:414] "containerMap: removing container" podUID="3c6989de-d851-49f9-94b3-6ea0133407b7" containerName="maas-api"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938182    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c6989de-d851-49f9-94b3-6ea0133407b7" containerName="maas-api"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938190    5450 cpu_manager.go:414] "containerMap: removing container" podUID="b1a697a2-dd3a-4efa-9575-c095e8081fd5" containerName="payload-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938195    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1a697a2-dd3a-4efa-9575-c095e8081fd5" containerName="payload-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938202    5450 cpu_manager.go:414] "containerMap: removing container" podUID="c7d094a5-ed9d-4d2f-821d-72c8826994e0" containerName="istio-proxy"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938206    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7d094a5-ed9d-4d2f-821d-72c8826994e0" containerName="istio-proxy"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938215    5450 cpu_manager.go:414] "containerMap: removing container" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938220    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938225    5450 cpu_manager.go:414] "containerMap: removing container" podUID="36d70e82-e32d-4b63-a95e-009eb6439f25" containerName="istio-proxy"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938229    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36d70e82-e32d-4b63-a95e-009eb6439f25" containerName="istio-proxy"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938237    5450 cpu_manager.go:414] "containerMap: removing container" podUID="a0ff1c4a-3d73-45b2-adb9-44fd034306b6" containerName="istio-proxy"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938242    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0ff1c4a-3d73-45b2-adb9-44fd034306b6" containerName="istio-proxy"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938248    5450 cpu_manager.go:414] "containerMap: removing container" podUID="efa87d42-019e-4814-baf9-ec8577de13a3" containerName="payload-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938253    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="efa87d42-019e-4814-baf9-ec8577de13a3" containerName="payload-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938259    5450 cpu_manager.go:414] "containerMap: removing container" podUID="a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04" containerName="payload-pre-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938263    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04" containerName="payload-pre-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938270    5450 cpu_manager.go:414] "containerMap: removing container" podUID="205307f9-b34c-4a63-925e-425314b48e36" containerName="payload-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938275    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="205307f9-b34c-4a63-925e-425314b48e36" containerName="payload-processing"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938288    5450 cpu_manager.go:414] "containerMap: removing container" podUID="b34ce6ae-5bb1-4f95-905a-736cae472b62" containerName="maas-api"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938294    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b34ce6ae-5bb1-4f95-905a-736cae472b62" containerName="maas-api"
Nov 04 02:40:22.938296 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938304    5450 cpu_manager.go:414] "containerMap: removing container" podUID="97fc2fa4-e688-47b1-a958-97a545c16860" containerName="payload-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938310    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="97fc2fa4-e688-47b1-a958-97a545c16860" containerName="payload-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938323    5450 cpu_manager.go:414] "containerMap: removing container" podUID="efc4ec72-d671-44b7-9965-8b35438ce8be" containerName="payload-pre-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938331    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="efc4ec72-d671-44b7-9965-8b35438ce8be" containerName="payload-pre-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938344    5450 cpu_manager.go:414] "containerMap: removing container" podUID="dedb6bf3-bf24-42c9-987c-52c5acb56d7a" containerName="payload-pre-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938351    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dedb6bf3-bf24-42c9-987c-52c5acb56d7a" containerName="payload-pre-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938362    5450 cpu_manager.go:414] "containerMap: removing container" podUID="76eb656d-9d15-46bc-b921-b7400173e867" containerName="payload-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938368    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76eb656d-9d15-46bc-b921-b7400173e867" containerName="payload-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938388    5450 cpu_manager.go:414] "containerMap: removing container" podUID="ebf46132-a37c-44d8-8131-66ff63df710a" containerName="maas-api"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938395    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ebf46132-a37c-44d8-8131-66ff63df710a" containerName="maas-api"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938505    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="76eb656d-9d15-46bc-b921-b7400173e867" containerName="payload-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938517    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="ebf46132-a37c-44d8-8131-66ff63df710a" containerName="maas-api"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938523    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e6274d8-5084-48c5-bb87-83090caea8fb" containerName="maas-api"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938530    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="50181e68-e458-41f6-81b2-910538ce6d3a" containerName="istio-proxy"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938537    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="0503b120-75d9-4173-a709-c4fd3af91b26" containerName="payload-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938543    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="ecb98692-871b-453d-9677-4f87f884754e" containerName="maas-api"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938549    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="17692d26-e7ea-4ce5-b182-10e51eeeaebc" containerName="payload-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938554    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="170a5ee7-56d5-4218-90db-9e3d495e9247" containerName="payload-pre-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938559    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="6aa1a4af-491d-4f1e-bd95-e3e02d0c9c01" containerName="maas-api"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938564    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c6989de-d851-49f9-94b3-6ea0133407b7" containerName="maas-api"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938570    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1a697a2-dd3a-4efa-9575-c095e8081fd5" containerName="payload-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938575    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="c7d094a5-ed9d-4d2f-821d-72c8826994e0" containerName="istio-proxy"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938582    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="2901ec24-f190-44a2-a184-567d846d4b2e" containerName="payload-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938587    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="36d70e82-e32d-4b63-a95e-009eb6439f25" containerName="istio-proxy"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938605    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0ff1c4a-3d73-45b2-adb9-44fd034306b6" containerName="istio-proxy"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938612    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="efa87d42-019e-4814-baf9-ec8577de13a3" containerName="payload-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938618    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0ee4ffc-9bdb-496a-bb11-9b0dc1791c04" containerName="payload-pre-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938627    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="205307f9-b34c-4a63-925e-425314b48e36" containerName="payload-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938635    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="b34ce6ae-5bb1-4f95-905a-736cae472b62" containerName="maas-api"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938642    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="97fc2fa4-e688-47b1-a958-97a545c16860" containerName="payload-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938647    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="efc4ec72-d671-44b7-9965-8b35438ce8be" containerName="payload-pre-processing"
Nov 04 02:40:22.939265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.938653    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="dedb6bf3-bf24-42c9-987c-52c5acb56d7a" containerName="payload-pre-processing"
Nov 04 02:40:22.943393 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:22.943373    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.062522 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.062484    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.062708 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.062530    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.062708 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.062649    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.062708 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.062678    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e57dff1-c713-4778-aa19-9442f0017fbb-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.062834 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.062756    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.062834 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.062821    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.062932 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.062918    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.062981 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.062954    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.062981 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.062977    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zbxb\" (UniqueName: \"kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-kube-api-access-5zbxb\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.138504 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.138472    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"]
Nov 04 02:40:23.163736 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.163702    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.163910 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.163770    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.163910 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.163797    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zbxb\" (UniqueName: \"kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-kube-api-access-5zbxb\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.163910 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.163887    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.164195 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.163918    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.164195 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.163960    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.164195 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.163986    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e57dff1-c713-4778-aa19-9442f0017fbb-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.164195 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.164043    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.164195 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.164092    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.165168 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.164434    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.165168 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.164640    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.165168 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.164883    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.165168 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.165002    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.165867 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.165837    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e57dff1-c713-4778-aa19-9442f0017fbb-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.166999 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.166884    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.166999 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.166983    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.223149 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.223097    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.223149 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.223119    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zbxb\" (UniqueName: \"kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-kube-api-access-5zbxb\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.257013 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.256992    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:23.682639 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.682587    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"]
Nov 04 02:40:23.687303 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:40:23.687266    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e57dff1_c713_4778_aa19_9442f0017fbb.slice/crio-f87dd777cda120188b4254359d09280da12e481049e4741cb8a2d81dad31d166 WatchSource:0}: Error finding container f87dd777cda120188b4254359d09280da12e481049e4741cb8a2d81dad31d166: Status 404 returned error can't find the container with id f87dd777cda120188b4254359d09280da12e481049e4741cb8a2d81dad31d166
Nov 04 02:40:23.689487 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.689445    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:40:23.689576 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.689519    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:40:23.689576 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.689548    5450 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 04 02:40:23.861335 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.861298    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" event={"ID":"2e57dff1-c713-4778-aa19-9442f0017fbb","Type":"ContainerStarted","Data":"c5ca4e7e1ef8ce8b938f5c47d871b95c53e3f7fea466df20a62ad1d0ef96bcac"}
Nov 04 02:40:23.861499 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.861347    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" event={"ID":"2e57dff1-c713-4778-aa19-9442f0017fbb","Type":"ContainerStarted","Data":"f87dd777cda120188b4254359d09280da12e481049e4741cb8a2d81dad31d166"}
Nov 04 02:40:23.980761 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:23.980657    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" podStartSLOduration=1.980638301 podStartE2EDuration="1.980638301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:40:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:40:23.978208322 +0000 UTC m=+1419.482148819" watchObservedRunningTime="2026-11-04 02:40:23.980638301 +0000 UTC m=+1419.484578797"
Nov 04 02:40:24.258068 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:24.258040    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:24.259434 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:24.259409    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Nov 04 02:40:24.259536 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:24.259456    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" podUID="2e57dff1-c713-4778-aa19-9442f0017fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Nov 04 02:40:25.259024 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:25.257679    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Nov 04 02:40:25.259024 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:25.257740    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" podUID="2e57dff1-c713-4778-aa19-9442f0017fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Nov 04 02:40:25.741492 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:25.741401    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln" podUID="d107791d-401c-469f-8d48-749147f7ef24" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:40:26.258218 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:26.258188    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Nov 04 02:40:26.258382 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:26.258246    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" podUID="2e57dff1-c713-4778-aa19-9442f0017fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Nov 04 02:40:27.105148 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.105123    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"
Nov 04 02:40:27.222525 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.222493    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d107791d-401c-469f-8d48-749147f7ef24-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d107791d-401c-469f-8d48-749147f7ef24-plugins-config-volume\") pod \"d107791d-401c-469f-8d48-749147f7ef24\" (UID: \"d107791d-401c-469f-8d48-749147f7ef24\") "
Nov 04 02:40:27.222691 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.222635    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d107791d-401c-469f-8d48-749147f7ef24-kube-api-access-vgpns\" (UniqueName: \"kubernetes.io/projected/d107791d-401c-469f-8d48-749147f7ef24-kube-api-access-vgpns\") pod \"d107791d-401c-469f-8d48-749147f7ef24\" (UID: \"d107791d-401c-469f-8d48-749147f7ef24\") "
Nov 04 02:40:27.222887 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.222863    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d107791d-401c-469f-8d48-749147f7ef24-plugins-config-volume" pod "d107791d-401c-469f-8d48-749147f7ef24" (UID: "d107791d-401c-469f-8d48-749147f7ef24"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:27.224687 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.224657    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d107791d-401c-469f-8d48-749147f7ef24-kube-api-access-vgpns" pod "d107791d-401c-469f-8d48-749147f7ef24" (UID: "d107791d-401c-469f-8d48-749147f7ef24"). InnerVolumeSpecName "kube-api-access-vgpns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:27.257495 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.257456    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Nov 04 02:40:27.257658 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.257523    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" podUID="2e57dff1-c713-4778-aa19-9442f0017fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Nov 04 02:40:27.323657 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.323623    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgpns\" (UniqueName: \"kubernetes.io/projected/d107791d-401c-469f-8d48-749147f7ef24-kube-api-access-vgpns\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:27.323657 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.323649    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d107791d-401c-469f-8d48-749147f7ef24-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:27.923525 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.923486    5450 generic.go:356] "Generic (PLEG): container finished" podID="d107791d-401c-469f-8d48-749147f7ef24" containerID="98190982ca94fb5cdb117b6e3086add3c828bfc433e31099f5552ae4ea2858c7" exitCode=0
Nov 04 02:40:27.923705 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.923541    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"
Nov 04 02:40:27.923705 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.923570    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln" event={"ID":"d107791d-401c-469f-8d48-749147f7ef24","Type":"ContainerDied","Data":"98190982ca94fb5cdb117b6e3086add3c828bfc433e31099f5552ae4ea2858c7"}
Nov 04 02:40:27.923705 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.923667    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln" event={"ID":"d107791d-401c-469f-8d48-749147f7ef24","Type":"ContainerDied","Data":"9fb4f306a3d1aec5fcf758ecbc925fd8a0d7dedf083d3044f38dfd38a55e9cd0"}
Nov 04 02:40:27.923705 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.923690    5450 scope.go:122] "RemoveContainer" containerID="98190982ca94fb5cdb117b6e3086add3c828bfc433e31099f5552ae4ea2858c7"
Nov 04 02:40:27.933007 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.932990    5450 scope.go:122] "RemoveContainer" containerID="98190982ca94fb5cdb117b6e3086add3c828bfc433e31099f5552ae4ea2858c7"
Nov 04 02:40:27.933260 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:40:27.933242    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98190982ca94fb5cdb117b6e3086add3c828bfc433e31099f5552ae4ea2858c7\": container with ID starting with 98190982ca94fb5cdb117b6e3086add3c828bfc433e31099f5552ae4ea2858c7 not found: ID does not exist" containerID="98190982ca94fb5cdb117b6e3086add3c828bfc433e31099f5552ae4ea2858c7"
Nov 04 02:40:27.933312 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:27.933267    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98190982ca94fb5cdb117b6e3086add3c828bfc433e31099f5552ae4ea2858c7"} err="failed to get container status \"98190982ca94fb5cdb117b6e3086add3c828bfc433e31099f5552ae4ea2858c7\": rpc error: code = NotFound desc = could not find container \"98190982ca94fb5cdb117b6e3086add3c828bfc433e31099f5552ae4ea2858c7\": container with ID starting with 98190982ca94fb5cdb117b6e3086add3c828bfc433e31099f5552ae4ea2858c7 not found: ID does not exist"
Nov 04 02:40:28.094147 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.094111    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"]
Nov 04 02:40:28.099192 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.099158    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-6c403f-66f8855447-khpln"]
Nov 04 02:40:28.257461 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.257432    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Nov 04 02:40:28.257834 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.257487    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" podUID="2e57dff1-c713-4778-aa19-9442f0017fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Nov 04 02:40:28.490088 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.490054    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"]
Nov 04 02:40:28.490366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.490295    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t" podUID="4d66fc2c-399d-44e5-84f9-28373e7aacae" containerName="maas-api" containerID="cri-o://1017488c9954737e2bd6b22fb262eb12f5daaf895602f980af725d8608346be3" gracePeriod=30
Nov 04 02:40:28.633382 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.633348    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d107791d-401c-469f-8d48-749147f7ef24" path="/var/lib/kubelet/pods/d107791d-401c-469f-8d48-749147f7ef24/volumes"
Nov 04 02:40:28.815039 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.815011    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:40:28.930692 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.930657    5450 generic.go:356] "Generic (PLEG): container finished" podID="4d66fc2c-399d-44e5-84f9-28373e7aacae" containerID="1017488c9954737e2bd6b22fb262eb12f5daaf895602f980af725d8608346be3" exitCode=0
Nov 04 02:40:28.930847 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.930700    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"
Nov 04 02:40:28.930847 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.930755    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t" event={"ID":"4d66fc2c-399d-44e5-84f9-28373e7aacae","Type":"ContainerDied","Data":"1017488c9954737e2bd6b22fb262eb12f5daaf895602f980af725d8608346be3"}
Nov 04 02:40:28.930847 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.930804    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t" event={"ID":"4d66fc2c-399d-44e5-84f9-28373e7aacae","Type":"ContainerDied","Data":"9f0929130ac1ef0e78791cc5adc800fc2aefb29a8ad9cad84109643ce6136827"}
Nov 04 02:40:28.930847 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.930831    5450 scope.go:122] "RemoveContainer" containerID="1017488c9954737e2bd6b22fb262eb12f5daaf895602f980af725d8608346be3"
Nov 04 02:40:28.939797 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.939777    5450 scope.go:122] "RemoveContainer" containerID="1017488c9954737e2bd6b22fb262eb12f5daaf895602f980af725d8608346be3"
Nov 04 02:40:28.940080 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:40:28.940053    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1017488c9954737e2bd6b22fb262eb12f5daaf895602f980af725d8608346be3\": container with ID starting with 1017488c9954737e2bd6b22fb262eb12f5daaf895602f980af725d8608346be3 not found: ID does not exist" containerID="1017488c9954737e2bd6b22fb262eb12f5daaf895602f980af725d8608346be3"
Nov 04 02:40:28.940146 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.940092    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1017488c9954737e2bd6b22fb262eb12f5daaf895602f980af725d8608346be3"} err="failed to get container status \"1017488c9954737e2bd6b22fb262eb12f5daaf895602f980af725d8608346be3\": rpc error: code = NotFound desc = could not find container \"1017488c9954737e2bd6b22fb262eb12f5daaf895602f980af725d8608346be3\": container with ID starting with 1017488c9954737e2bd6b22fb262eb12f5daaf895602f980af725d8608346be3 not found: ID does not exist"
Nov 04 02:40:28.942405 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.942387    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-maas-api-tls\") pod \"4d66fc2c-399d-44e5-84f9-28373e7aacae\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") "
Nov 04 02:40:28.942459 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.942451    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-metrics-certs\") pod \"4d66fc2c-399d-44e5-84f9-28373e7aacae\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") "
Nov 04 02:40:28.942507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.942497    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d66fc2c-399d-44e5-84f9-28373e7aacae-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d66fc2c-399d-44e5-84f9-28373e7aacae-openshift-service-ca\") pod \"4d66fc2c-399d-44e5-84f9-28373e7aacae\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") "
Nov 04 02:40:28.942706 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.942689    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d66fc2c-399d-44e5-84f9-28373e7aacae-kube-api-access-p2k8w\" (UniqueName: \"kubernetes.io/projected/4d66fc2c-399d-44e5-84f9-28373e7aacae-kube-api-access-p2k8w\") pod \"4d66fc2c-399d-44e5-84f9-28373e7aacae\" (UID: \"4d66fc2c-399d-44e5-84f9-28373e7aacae\") "
Nov 04 02:40:28.943202 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.942878    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d66fc2c-399d-44e5-84f9-28373e7aacae-openshift-service-ca" pod "4d66fc2c-399d-44e5-84f9-28373e7aacae" (UID: "4d66fc2c-399d-44e5-84f9-28373e7aacae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:28.943202 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.943173    5450 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d66fc2c-399d-44e5-84f9-28373e7aacae-openshift-service-ca\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:28.944554 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.944525    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-maas-api-tls" pod "4d66fc2c-399d-44e5-84f9-28373e7aacae" (UID: "4d66fc2c-399d-44e5-84f9-28373e7aacae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:28.944554 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.944545    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-metrics-certs" pod "4d66fc2c-399d-44e5-84f9-28373e7aacae" (UID: "4d66fc2c-399d-44e5-84f9-28373e7aacae"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:28.944715 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:28.944608    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d66fc2c-399d-44e5-84f9-28373e7aacae-kube-api-access-p2k8w" pod "4d66fc2c-399d-44e5-84f9-28373e7aacae" (UID: "4d66fc2c-399d-44e5-84f9-28373e7aacae"). InnerVolumeSpecName "kube-api-access-p2k8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:29.044647 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:29.044543    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2k8w\" (UniqueName: \"kubernetes.io/projected/4d66fc2c-399d-44e5-84f9-28373e7aacae-kube-api-access-p2k8w\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:29.044647 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:29.044571    5450 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-maas-api-tls\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:29.044647 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:29.044582    5450 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d66fc2c-399d-44e5-84f9-28373e7aacae-metrics-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:29.258065 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:29.258033    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Nov 04 02:40:29.258432 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:29.258083    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" podUID="2e57dff1-c713-4778-aa19-9442f0017fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Nov 04 02:40:29.347872 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:29.347795    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"]
Nov 04 02:40:29.354060 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:29.354030    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-ab53c1-65d45cf8b9-mgv7t"]
Nov 04 02:40:30.257650 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:30.257615    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Nov 04 02:40:30.257826 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:30.257671    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" podUID="2e57dff1-c713-4778-aa19-9442f0017fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Nov 04 02:40:30.647809 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:30.647727    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d66fc2c-399d-44e5-84f9-28373e7aacae" path="/var/lib/kubelet/pods/4d66fc2c-399d-44e5-84f9-28373e7aacae/volumes"
Nov 04 02:40:30.708083 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:30.708044    5450 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7" podUID="e13dcd76-74dd-4201-bb8b-612f7be49c32" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:40:31.546753 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.546428    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"
Nov 04 02:40:31.678062 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.678025    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e13dcd76-74dd-4201-bb8b-612f7be49c32-kube-api-access-vv2wd\" (UniqueName: \"kubernetes.io/projected/e13dcd76-74dd-4201-bb8b-612f7be49c32-kube-api-access-vv2wd\") pod \"e13dcd76-74dd-4201-bb8b-612f7be49c32\" (UID: \"e13dcd76-74dd-4201-bb8b-612f7be49c32\") "
Nov 04 02:40:31.678535 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.678087    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e13dcd76-74dd-4201-bb8b-612f7be49c32-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13dcd76-74dd-4201-bb8b-612f7be49c32-plugins-config-volume\") pod \"e13dcd76-74dd-4201-bb8b-612f7be49c32\" (UID: \"e13dcd76-74dd-4201-bb8b-612f7be49c32\") "
Nov 04 02:40:31.678535 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.678503    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e13dcd76-74dd-4201-bb8b-612f7be49c32-plugins-config-volume" pod "e13dcd76-74dd-4201-bb8b-612f7be49c32" (UID: "e13dcd76-74dd-4201-bb8b-612f7be49c32"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:31.678671 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.678652    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13dcd76-74dd-4201-bb8b-612f7be49c32-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:31.681986 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.681946    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e13dcd76-74dd-4201-bb8b-612f7be49c32-kube-api-access-vv2wd" pod "e13dcd76-74dd-4201-bb8b-612f7be49c32" (UID: "e13dcd76-74dd-4201-bb8b-612f7be49c32"). InnerVolumeSpecName "kube-api-access-vv2wd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:31.780085 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.780048    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv2wd\" (UniqueName: \"kubernetes.io/projected/e13dcd76-74dd-4201-bb8b-612f7be49c32-kube-api-access-vv2wd\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:31.953430 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.953346    5450 generic.go:356] "Generic (PLEG): container finished" podID="e13dcd76-74dd-4201-bb8b-612f7be49c32" containerID="e0b40d57a2145b59e6be8773a6b130100ae2353b3a015356509ec3f9ccc833d4" exitCode=0
Nov 04 02:40:31.953430 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.953399    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"
Nov 04 02:40:31.953681 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.953423    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7" event={"ID":"e13dcd76-74dd-4201-bb8b-612f7be49c32","Type":"ContainerDied","Data":"e0b40d57a2145b59e6be8773a6b130100ae2353b3a015356509ec3f9ccc833d4"}
Nov 04 02:40:31.953681 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.953496    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7" event={"ID":"e13dcd76-74dd-4201-bb8b-612f7be49c32","Type":"ContainerDied","Data":"9260fdbd49fa0398e6b311bafed0c0d05049a2fe36dcbfaf0ce93321d73f4502"}
Nov 04 02:40:31.953681 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.953519    5450 scope.go:122] "RemoveContainer" containerID="e0b40d57a2145b59e6be8773a6b130100ae2353b3a015356509ec3f9ccc833d4"
Nov 04 02:40:31.965054 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.964769    5450 scope.go:122] "RemoveContainer" containerID="e0b40d57a2145b59e6be8773a6b130100ae2353b3a015356509ec3f9ccc833d4"
Nov 04 02:40:31.965175 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:40:31.965122    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0b40d57a2145b59e6be8773a6b130100ae2353b3a015356509ec3f9ccc833d4\": container with ID starting with e0b40d57a2145b59e6be8773a6b130100ae2353b3a015356509ec3f9ccc833d4 not found: ID does not exist" containerID="e0b40d57a2145b59e6be8773a6b130100ae2353b3a015356509ec3f9ccc833d4"
Nov 04 02:40:31.965175 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:31.965159    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0b40d57a2145b59e6be8773a6b130100ae2353b3a015356509ec3f9ccc833d4"} err="failed to get container status \"e0b40d57a2145b59e6be8773a6b130100ae2353b3a015356509ec3f9ccc833d4\": rpc error: code = NotFound desc = could not find container \"e0b40d57a2145b59e6be8773a6b130100ae2353b3a015356509ec3f9ccc833d4\": container with ID starting with e0b40d57a2145b59e6be8773a6b130100ae2353b3a015356509ec3f9ccc833d4 not found: ID does not exist"
Nov 04 02:40:32.114883 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:32.114838    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"]
Nov 04 02:40:32.162536 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:32.162498    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-ab53c1-566d558cbc-cxfz7"]
Nov 04 02:40:32.298761 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:32.298720    5450 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 02:40:32.298958 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:32.298799    5450 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" podUID="2e57dff1-c713-4778-aa19-9442f0017fbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:40:32.424253 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:32.424221    5450 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:32.424735 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:32.424716    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:32.425924 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:32.425903    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:32.633025 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:32.632948    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e13dcd76-74dd-4201-bb8b-612f7be49c32" path="/var/lib/kubelet/pods/e13dcd76-74dd-4201-bb8b-612f7be49c32/volumes"
Nov 04 02:40:36.537948 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:36.537915    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"]
Nov 04 02:40:36.538345 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:36.538163    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4" podUID="70e41f76-88b7-495d-ba6f-9dc2b0640de1" containerName="istio-proxy" containerID="cri-o://a4c22fe60f5303b19f055b5d490b911cf633b480b9b48dc0679aa351d8a408ec" gracePeriod=30
Nov 04 02:40:36.550493 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:36.550460    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"]
Nov 04 02:40:36.550919 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:36.550891    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" podUID="2e57dff1-c713-4778-aa19-9442f0017fbb" containerName="istio-proxy" containerID="cri-o://c5ca4e7e1ef8ce8b938f5c47d871b95c53e3f7fea466df20a62ad1d0ef96bcac" gracePeriod=30
Nov 04 02:40:41.811308 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.811252    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:40:41.830169 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.830140    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:41.911889 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.911860    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-socket\") pod \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") "
Nov 04 02:40:41.911982 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.911964    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-certs\") pod \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") "
Nov 04 02:40:41.912033 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912007    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-credential-socket\") pod \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") "
Nov 04 02:40:41.912085 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912064    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-data\") pod \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") "
Nov 04 02:40:41.912138 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912116    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-socket" pod "70e41f76-88b7-495d-ba6f-9dc2b0640de1" (UID: "70e41f76-88b7-495d-ba6f-9dc2b0640de1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.912138 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912120    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istiod-ca-cert\") pod \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") "
Nov 04 02:40:41.912244 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912197    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-token\" (UniqueName: \"kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-token\") pod \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") "
Nov 04 02:40:41.912244 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912216    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-certs" pod "70e41f76-88b7-495d-ba6f-9dc2b0640de1" (UID: "70e41f76-88b7-495d-ba6f-9dc2b0640de1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.912350 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912246    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-kube-api-access-tsczb\" (UniqueName: \"kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-kube-api-access-tsczb\") pod \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") "
Nov 04 02:40:41.912350 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912310    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-credential-socket" pod "70e41f76-88b7-495d-ba6f-9dc2b0640de1" (UID: "70e41f76-88b7-495d-ba6f-9dc2b0640de1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.912449 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912331    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-data" pod "70e41f76-88b7-495d-ba6f-9dc2b0640de1" (UID: "70e41f76-88b7-495d-ba6f-9dc2b0640de1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.912449 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912356    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-envoy\") pod \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") "
Nov 04 02:40:41.912449 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912407    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-podinfo\") pod \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\" (UID: \"70e41f76-88b7-495d-ba6f-9dc2b0640de1\") "
Nov 04 02:40:41.912631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912469    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istiod-ca-cert" pod "70e41f76-88b7-495d-ba6f-9dc2b0640de1" (UID: "70e41f76-88b7-495d-ba6f-9dc2b0640de1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:41.912883 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912862    5450 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-data\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.912965 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912892    5450 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istiod-ca-cert\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.912965 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912907    5450 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.912965 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912922    5450 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-workload-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.912965 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.912940    5450 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-credential-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.914252 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.914226    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-token" pod "70e41f76-88b7-495d-ba6f-9dc2b0640de1" (UID: "70e41f76-88b7-495d-ba6f-9dc2b0640de1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:41.914344 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.914254    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-kube-api-access-tsczb" pod "70e41f76-88b7-495d-ba6f-9dc2b0640de1" (UID: "70e41f76-88b7-495d-ba6f-9dc2b0640de1"). InnerVolumeSpecName "kube-api-access-tsczb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:41.914344 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.914263    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-podinfo" pod "70e41f76-88b7-495d-ba6f-9dc2b0640de1" (UID: "70e41f76-88b7-495d-ba6f-9dc2b0640de1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:40:41.914344 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:41.914280    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-envoy" pod "70e41f76-88b7-495d-ba6f-9dc2b0640de1" (UID: "70e41f76-88b7-495d-ba6f-9dc2b0640de1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:42.010387 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.010363    5450 generic.go:356] "Generic (PLEG): container finished" podID="70e41f76-88b7-495d-ba6f-9dc2b0640de1" containerID="a4c22fe60f5303b19f055b5d490b911cf633b480b9b48dc0679aa351d8a408ec" exitCode=0
Nov 04 02:40:42.010504 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.010415    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"
Nov 04 02:40:42.010504 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.010442    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4" event={"ID":"70e41f76-88b7-495d-ba6f-9dc2b0640de1","Type":"ContainerDied","Data":"a4c22fe60f5303b19f055b5d490b911cf633b480b9b48dc0679aa351d8a408ec"}
Nov 04 02:40:42.010504 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.010489    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4" event={"ID":"70e41f76-88b7-495d-ba6f-9dc2b0640de1","Type":"ContainerDied","Data":"42286f9c05a2438bcaea9d066b4c483be32d345b42b22c85159da9cab5658b68"}
Nov 04 02:40:42.010710 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.010515    5450 scope.go:122] "RemoveContainer" containerID="a4c22fe60f5303b19f055b5d490b911cf633b480b9b48dc0679aa351d8a408ec"
Nov 04 02:40:42.011993 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.011972    5450 generic.go:356] "Generic (PLEG): container finished" podID="2e57dff1-c713-4778-aa19-9442f0017fbb" containerID="c5ca4e7e1ef8ce8b938f5c47d871b95c53e3f7fea466df20a62ad1d0ef96bcac" exitCode=0
Nov 04 02:40:42.012101 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.012020    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"
Nov 04 02:40:42.012101 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.012045    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" event={"ID":"2e57dff1-c713-4778-aa19-9442f0017fbb","Type":"ContainerDied","Data":"c5ca4e7e1ef8ce8b938f5c47d871b95c53e3f7fea466df20a62ad1d0ef96bcac"}
Nov 04 02:40:42.012101 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.012092    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf" event={"ID":"2e57dff1-c713-4778-aa19-9442f0017fbb","Type":"ContainerDied","Data":"f87dd777cda120188b4254359d09280da12e481049e4741cb8a2d81dad31d166"}
Nov 04 02:40:42.013166 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013151    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-kube-api-access-5zbxb\" (UniqueName: \"kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-kube-api-access-5zbxb\") pod \"2e57dff1-c713-4778-aa19-9442f0017fbb\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") "
Nov 04 02:40:42.013219 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013197    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e57dff1-c713-4778-aa19-9442f0017fbb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e57dff1-c713-4778-aa19-9442f0017fbb-istiod-ca-cert\") pod \"2e57dff1-c713-4778-aa19-9442f0017fbb\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") "
Nov 04 02:40:42.013253 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013244    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-podinfo\") pod \"2e57dff1-c713-4778-aa19-9442f0017fbb\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") "
Nov 04 02:40:42.013297 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013262    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-certs\") pod \"2e57dff1-c713-4778-aa19-9442f0017fbb\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") "
Nov 04 02:40:42.013354 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013300    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-envoy\") pod \"2e57dff1-c713-4778-aa19-9442f0017fbb\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") "
Nov 04 02:40:42.013409 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013381    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-socket\") pod \"2e57dff1-c713-4778-aa19-9442f0017fbb\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") "
Nov 04 02:40:42.013469 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013415    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-credential-socket\") pod \"2e57dff1-c713-4778-aa19-9442f0017fbb\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") "
Nov 04 02:40:42.013469 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013453    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-data\") pod \"2e57dff1-c713-4778-aa19-9442f0017fbb\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") "
Nov 04 02:40:42.014042 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013582    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-token\" (UniqueName: \"kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-token\") pod \"2e57dff1-c713-4778-aa19-9442f0017fbb\" (UID: \"2e57dff1-c713-4778-aa19-9442f0017fbb\") "
Nov 04 02:40:42.014042 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013579    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-certs" pod "2e57dff1-c713-4778-aa19-9442f0017fbb" (UID: "2e57dff1-c713-4778-aa19-9442f0017fbb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:42.014042 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013701    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e57dff1-c713-4778-aa19-9442f0017fbb-istiod-ca-cert" pod "2e57dff1-c713-4778-aa19-9442f0017fbb" (UID: "2e57dff1-c713-4778-aa19-9442f0017fbb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:42.014042 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013779    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-socket" pod "2e57dff1-c713-4778-aa19-9442f0017fbb" (UID: "2e57dff1-c713-4778-aa19-9442f0017fbb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:42.014042 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013795    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-credential-socket" pod "2e57dff1-c713-4778-aa19-9442f0017fbb" (UID: "2e57dff1-c713-4778-aa19-9442f0017fbb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:42.014042 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.013931    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-data" pod "2e57dff1-c713-4778-aa19-9442f0017fbb" (UID: "2e57dff1-c713-4778-aa19-9442f0017fbb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:42.014366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.014050    5450 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e57dff1-c713-4778-aa19-9442f0017fbb-istiod-ca-cert\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.014366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.014073    5450 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.014366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.014090    5450 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-token\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.014366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.014105    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsczb\" (UniqueName: \"kubernetes.io/projected/70e41f76-88b7-495d-ba6f-9dc2b0640de1-kube-api-access-tsczb\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.014366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.014120    5450 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-envoy\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.014366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.014135    5450 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70e41f76-88b7-495d-ba6f-9dc2b0640de1-istio-podinfo\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.014366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.014149    5450 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-workload-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.014366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.014163    5450 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-credential-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.014366 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.014177    5450 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-data\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.015490 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.015466    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-podinfo" pod "2e57dff1-c713-4778-aa19-9442f0017fbb" (UID: "2e57dff1-c713-4778-aa19-9442f0017fbb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:40:42.015632 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.015578    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-kube-api-access-5zbxb" pod "2e57dff1-c713-4778-aa19-9442f0017fbb" (UID: "2e57dff1-c713-4778-aa19-9442f0017fbb"). InnerVolumeSpecName "kube-api-access-5zbxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:42.015831 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.015805    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-envoy" pod "2e57dff1-c713-4778-aa19-9442f0017fbb" (UID: "2e57dff1-c713-4778-aa19-9442f0017fbb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:42.016544 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.016526    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-token" pod "2e57dff1-c713-4778-aa19-9442f0017fbb" (UID: "2e57dff1-c713-4778-aa19-9442f0017fbb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:42.022290 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.022070    5450 scope.go:122] "RemoveContainer" containerID="a4c22fe60f5303b19f055b5d490b911cf633b480b9b48dc0679aa351d8a408ec"
Nov 04 02:40:42.022511 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:40:42.022480    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4c22fe60f5303b19f055b5d490b911cf633b480b9b48dc0679aa351d8a408ec\": container with ID starting with a4c22fe60f5303b19f055b5d490b911cf633b480b9b48dc0679aa351d8a408ec not found: ID does not exist" containerID="a4c22fe60f5303b19f055b5d490b911cf633b480b9b48dc0679aa351d8a408ec"
Nov 04 02:40:42.027653 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.022519    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4c22fe60f5303b19f055b5d490b911cf633b480b9b48dc0679aa351d8a408ec"} err="failed to get container status \"a4c22fe60f5303b19f055b5d490b911cf633b480b9b48dc0679aa351d8a408ec\": rpc error: code = NotFound desc = could not find container \"a4c22fe60f5303b19f055b5d490b911cf633b480b9b48dc0679aa351d8a408ec\": container with ID starting with a4c22fe60f5303b19f055b5d490b911cf633b480b9b48dc0679aa351d8a408ec not found: ID does not exist"
Nov 04 02:40:42.027653 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.022542    5450 scope.go:122] "RemoveContainer" containerID="c5ca4e7e1ef8ce8b938f5c47d871b95c53e3f7fea466df20a62ad1d0ef96bcac"
Nov 04 02:40:42.031920 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.031900    5450 scope.go:122] "RemoveContainer" containerID="c5ca4e7e1ef8ce8b938f5c47d871b95c53e3f7fea466df20a62ad1d0ef96bcac"
Nov 04 02:40:42.032194 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:40:42.032176    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5ca4e7e1ef8ce8b938f5c47d871b95c53e3f7fea466df20a62ad1d0ef96bcac\": container with ID starting with c5ca4e7e1ef8ce8b938f5c47d871b95c53e3f7fea466df20a62ad1d0ef96bcac not found: ID does not exist" containerID="c5ca4e7e1ef8ce8b938f5c47d871b95c53e3f7fea466df20a62ad1d0ef96bcac"
Nov 04 02:40:42.032270 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.032201    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ca4e7e1ef8ce8b938f5c47d871b95c53e3f7fea466df20a62ad1d0ef96bcac"} err="failed to get container status \"c5ca4e7e1ef8ce8b938f5c47d871b95c53e3f7fea466df20a62ad1d0ef96bcac\": rpc error: code = NotFound desc = could not find container \"c5ca4e7e1ef8ce8b938f5c47d871b95c53e3f7fea466df20a62ad1d0ef96bcac\": container with ID starting with c5ca4e7e1ef8ce8b938f5c47d871b95c53e3f7fea466df20a62ad1d0ef96bcac not found: ID does not exist"
Nov 04 02:40:42.115439 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.115377    5450 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-envoy\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.115439 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.115402    5450 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-token\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.115439 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.115418    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zbxb\" (UniqueName: \"kubernetes.io/projected/2e57dff1-c713-4778-aa19-9442f0017fbb-kube-api-access-5zbxb\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.115439 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.115431    5450 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e57dff1-c713-4778-aa19-9442f0017fbb-istio-podinfo\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.200065 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.200041    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"]
Nov 04 02:40:42.206405 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.206375    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gccd4"]
Nov 04 02:40:42.428816 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.428730    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"]
Nov 04 02:40:42.432494 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.432468    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-8jqkf"]
Nov 04 02:40:42.631984 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.631956    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e57dff1-c713-4778-aa19-9442f0017fbb" path="/var/lib/kubelet/pods/2e57dff1-c713-4778-aa19-9442f0017fbb/volumes"
Nov 04 02:40:42.632379 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:42.632366    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="70e41f76-88b7-495d-ba6f-9dc2b0640de1" path="/var/lib/kubelet/pods/70e41f76-88b7-495d-ba6f-9dc2b0640de1/volumes"
Nov 04 02:40:47.763035 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:40:47.763005    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:40:57.474033 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:40:57.473956    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:41:17.764414 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:41:17.764375    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:41:44.821167 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:41:44.821134    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:41:44.823844 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:41:44.823817    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:41:47.764435 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:41:47.764395    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:42:17.764714 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:42:17.764668    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:42:47.764164 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:42:47.764120    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:43:17.764695 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:43:17.764651    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:43:47.764567 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:43:47.764522    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:44:17.764653 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:44:17.764548    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:44:47.764702 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:44:47.764664    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:45:03.431732 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:03.431698    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:45:07.420330 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:07.420296    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"]
Nov 04 02:45:07.525966 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:07.525933    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"]
Nov 04 02:45:12.421456 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.421414    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm" podUID="0eb7183f-c331-4c13-898c-bf6085376df2" containerName="payload-processing" containerID="cri-o://c57e733df611248db648b50f9f636636a905856fad9bf5676332b6537ee611e5" gracePeriod=25
Nov 04 02:45:12.527024 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.526973    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4" podUID="9af097c5-120a-4b81-a86b-241101d0cbce" containerName="payload-pre-processing" containerID="cri-o://fe0176fbf53481c1e51f1e47c6667374bc4f61eae5a2d472fadcb1be26f48e41" gracePeriod=25
Nov 04 02:45:12.686326 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.686259    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"
Nov 04 02:45:12.785860 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.785824    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"
Nov 04 02:45:12.786349 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.786327    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0eb7183f-c331-4c13-898c-bf6085376df2-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eb7183f-c331-4c13-898c-bf6085376df2-plugins-config-volume\") pod \"0eb7183f-c331-4c13-898c-bf6085376df2\" (UID: \"0eb7183f-c331-4c13-898c-bf6085376df2\") "
Nov 04 02:45:12.786478 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.786437    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0eb7183f-c331-4c13-898c-bf6085376df2-kube-api-access-lfvrb\" (UniqueName: \"kubernetes.io/projected/0eb7183f-c331-4c13-898c-bf6085376df2-kube-api-access-lfvrb\") pod \"0eb7183f-c331-4c13-898c-bf6085376df2\" (UID: \"0eb7183f-c331-4c13-898c-bf6085376df2\") "
Nov 04 02:45:12.786737 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.786707    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eb7183f-c331-4c13-898c-bf6085376df2-plugins-config-volume" pod "0eb7183f-c331-4c13-898c-bf6085376df2" (UID: "0eb7183f-c331-4c13-898c-bf6085376df2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:12.786841 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.786823    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eb7183f-c331-4c13-898c-bf6085376df2-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:12.788386 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.788363    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eb7183f-c331-4c13-898c-bf6085376df2-kube-api-access-lfvrb" pod "0eb7183f-c331-4c13-898c-bf6085376df2" (UID: "0eb7183f-c331-4c13-898c-bf6085376df2"). InnerVolumeSpecName "kube-api-access-lfvrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:12.887624 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.887583    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9af097c5-120a-4b81-a86b-241101d0cbce-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9af097c5-120a-4b81-a86b-241101d0cbce-plugins-config-volume\") pod \"9af097c5-120a-4b81-a86b-241101d0cbce\" (UID: \"9af097c5-120a-4b81-a86b-241101d0cbce\") "
Nov 04 02:45:12.887766 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.887653    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9af097c5-120a-4b81-a86b-241101d0cbce-kube-api-access-gjxv5\" (UniqueName: \"kubernetes.io/projected/9af097c5-120a-4b81-a86b-241101d0cbce-kube-api-access-gjxv5\") pod \"9af097c5-120a-4b81-a86b-241101d0cbce\" (UID: \"9af097c5-120a-4b81-a86b-241101d0cbce\") "
Nov 04 02:45:12.887922 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.887908    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfvrb\" (UniqueName: \"kubernetes.io/projected/0eb7183f-c331-4c13-898c-bf6085376df2-kube-api-access-lfvrb\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:12.888037 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.888013    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9af097c5-120a-4b81-a86b-241101d0cbce-plugins-config-volume" pod "9af097c5-120a-4b81-a86b-241101d0cbce" (UID: "9af097c5-120a-4b81-a86b-241101d0cbce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:12.889655 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.889638    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af097c5-120a-4b81-a86b-241101d0cbce-kube-api-access-gjxv5" pod "9af097c5-120a-4b81-a86b-241101d0cbce" (UID: "9af097c5-120a-4b81-a86b-241101d0cbce"). InnerVolumeSpecName "kube-api-access-gjxv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:12.989231 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.989148    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9af097c5-120a-4b81-a86b-241101d0cbce-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:12.989231 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:12.989180    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjxv5\" (UniqueName: \"kubernetes.io/projected/9af097c5-120a-4b81-a86b-241101d0cbce-kube-api-access-gjxv5\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:13.485514 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.485479    5450 generic.go:356] "Generic (PLEG): container finished" podID="9af097c5-120a-4b81-a86b-241101d0cbce" containerID="fe0176fbf53481c1e51f1e47c6667374bc4f61eae5a2d472fadcb1be26f48e41" exitCode=0
Nov 04 02:45:13.485964 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.485524    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"
Nov 04 02:45:13.485964 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.485561    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4" event={"ID":"9af097c5-120a-4b81-a86b-241101d0cbce","Type":"ContainerDied","Data":"fe0176fbf53481c1e51f1e47c6667374bc4f61eae5a2d472fadcb1be26f48e41"}
Nov 04 02:45:13.485964 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.485631    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4" event={"ID":"9af097c5-120a-4b81-a86b-241101d0cbce","Type":"ContainerDied","Data":"a040a74c497350f9a1d6f60ae0916b0e3e72473af6ffe00ebc9620dc2f328ac3"}
Nov 04 02:45:13.485964 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.485659    5450 scope.go:122] "RemoveContainer" containerID="fe0176fbf53481c1e51f1e47c6667374bc4f61eae5a2d472fadcb1be26f48e41"
Nov 04 02:45:13.486991 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.486969    5450 generic.go:356] "Generic (PLEG): container finished" podID="0eb7183f-c331-4c13-898c-bf6085376df2" containerID="c57e733df611248db648b50f9f636636a905856fad9bf5676332b6537ee611e5" exitCode=0
Nov 04 02:45:13.487065 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.487008    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm" event={"ID":"0eb7183f-c331-4c13-898c-bf6085376df2","Type":"ContainerDied","Data":"c57e733df611248db648b50f9f636636a905856fad9bf5676332b6537ee611e5"}
Nov 04 02:45:13.487065 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.487024    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"
Nov 04 02:45:13.487065 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.487049    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm" event={"ID":"0eb7183f-c331-4c13-898c-bf6085376df2","Type":"ContainerDied","Data":"d26eb387dcdcec1a6b9a290f0307b8a1b63efac9f182065023f4f6b5e84fa191"}
Nov 04 02:45:13.497476 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.497455    5450 scope.go:122] "RemoveContainer" containerID="fe0176fbf53481c1e51f1e47c6667374bc4f61eae5a2d472fadcb1be26f48e41"
Nov 04 02:45:13.497808 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:45:13.497780    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe0176fbf53481c1e51f1e47c6667374bc4f61eae5a2d472fadcb1be26f48e41\": container with ID starting with fe0176fbf53481c1e51f1e47c6667374bc4f61eae5a2d472fadcb1be26f48e41 not found: ID does not exist" containerID="fe0176fbf53481c1e51f1e47c6667374bc4f61eae5a2d472fadcb1be26f48e41"
Nov 04 02:45:13.497905 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.497820    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0176fbf53481c1e51f1e47c6667374bc4f61eae5a2d472fadcb1be26f48e41"} err="failed to get container status \"fe0176fbf53481c1e51f1e47c6667374bc4f61eae5a2d472fadcb1be26f48e41\": rpc error: code = NotFound desc = could not find container \"fe0176fbf53481c1e51f1e47c6667374bc4f61eae5a2d472fadcb1be26f48e41\": container with ID starting with fe0176fbf53481c1e51f1e47c6667374bc4f61eae5a2d472fadcb1be26f48e41 not found: ID does not exist"
Nov 04 02:45:13.497905 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.497843    5450 scope.go:122] "RemoveContainer" containerID="c57e733df611248db648b50f9f636636a905856fad9bf5676332b6537ee611e5"
Nov 04 02:45:13.505724 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.505708    5450 scope.go:122] "RemoveContainer" containerID="c57e733df611248db648b50f9f636636a905856fad9bf5676332b6537ee611e5"
Nov 04 02:45:13.505956 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:45:13.505940    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c57e733df611248db648b50f9f636636a905856fad9bf5676332b6537ee611e5\": container with ID starting with c57e733df611248db648b50f9f636636a905856fad9bf5676332b6537ee611e5 not found: ID does not exist" containerID="c57e733df611248db648b50f9f636636a905856fad9bf5676332b6537ee611e5"
Nov 04 02:45:13.505994 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.505963    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c57e733df611248db648b50f9f636636a905856fad9bf5676332b6537ee611e5"} err="failed to get container status \"c57e733df611248db648b50f9f636636a905856fad9bf5676332b6537ee611e5\": rpc error: code = NotFound desc = could not find container \"c57e733df611248db648b50f9f636636a905856fad9bf5676332b6537ee611e5\": container with ID starting with c57e733df611248db648b50f9f636636a905856fad9bf5676332b6537ee611e5 not found: ID does not exist"
Nov 04 02:45:13.646265 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.646230    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"]
Nov 04 02:45:13.694158 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.694082    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-80b404-67bc9766d-txrxm"]
Nov 04 02:45:13.756605 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.756560    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"]
Nov 04 02:45:13.763857 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:13.763833    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-80b404-595754f4c5-brsw4"]
Nov 04 02:45:14.633355 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:14.633320    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0eb7183f-c331-4c13-898c-bf6085376df2" path="/var/lib/kubelet/pods/0eb7183f-c331-4c13-898c-bf6085376df2/volumes"
Nov 04 02:45:14.633776 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:14.633744    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9af097c5-120a-4b81-a86b-241101d0cbce" path="/var/lib/kubelet/pods/9af097c5-120a-4b81-a86b-241101d0cbce/volumes"
Nov 04 02:45:17.763067 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:45:17.763024    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:45:18.960523 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:18.960480    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"]
Nov 04 02:45:18.960962 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:18.960712    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp" podUID="6a47414e-24ca-4b3a-873a-c90633787a51" containerName="maas-api" containerID="cri-o://95cabf9da8027e1a7aecfefea935da8114fa52593d4a51a579bbaf3b7bdc7077" gracePeriod=30
Nov 04 02:45:19.224337 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.224277    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:45:19.253631 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.253589    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-maas-api-tls\") pod \"6a47414e-24ca-4b3a-873a-c90633787a51\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") "
Nov 04 02:45:19.253811 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.253794    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-metrics-certs\") pod \"6a47414e-24ca-4b3a-873a-c90633787a51\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") "
Nov 04 02:45:19.253882 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.253829    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6a47414e-24ca-4b3a-873a-c90633787a51-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a47414e-24ca-4b3a-873a-c90633787a51-openshift-service-ca\") pod \"6a47414e-24ca-4b3a-873a-c90633787a51\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") "
Nov 04 02:45:19.253933 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.253904    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a47414e-24ca-4b3a-873a-c90633787a51-kube-api-access-68gk5\" (UniqueName: \"kubernetes.io/projected/6a47414e-24ca-4b3a-873a-c90633787a51-kube-api-access-68gk5\") pod \"6a47414e-24ca-4b3a-873a-c90633787a51\" (UID: \"6a47414e-24ca-4b3a-873a-c90633787a51\") "
Nov 04 02:45:19.254262 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.254224    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a47414e-24ca-4b3a-873a-c90633787a51-openshift-service-ca" pod "6a47414e-24ca-4b3a-873a-c90633787a51" (UID: "6a47414e-24ca-4b3a-873a-c90633787a51"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:19.255714 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.255684    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-maas-api-tls" pod "6a47414e-24ca-4b3a-873a-c90633787a51" (UID: "6a47414e-24ca-4b3a-873a-c90633787a51"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:45:19.255908 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.255885    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a47414e-24ca-4b3a-873a-c90633787a51-kube-api-access-68gk5" pod "6a47414e-24ca-4b3a-873a-c90633787a51" (UID: "6a47414e-24ca-4b3a-873a-c90633787a51"). InnerVolumeSpecName "kube-api-access-68gk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:19.255983 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.255883    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-metrics-certs" pod "6a47414e-24ca-4b3a-873a-c90633787a51" (UID: "6a47414e-24ca-4b3a-873a-c90633787a51"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:45:19.355630 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.355581    5450 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-metrics-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:19.355802 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.355634    5450 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a47414e-24ca-4b3a-873a-c90633787a51-openshift-service-ca\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:19.355802 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.355652    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68gk5\" (UniqueName: \"kubernetes.io/projected/6a47414e-24ca-4b3a-873a-c90633787a51-kube-api-access-68gk5\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:19.355802 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.355666    5450 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a47414e-24ca-4b3a-873a-c90633787a51-maas-api-tls\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:19.523561 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.523527    5450 generic.go:356] "Generic (PLEG): container finished" podID="6a47414e-24ca-4b3a-873a-c90633787a51" containerID="95cabf9da8027e1a7aecfefea935da8114fa52593d4a51a579bbaf3b7bdc7077" exitCode=0
Nov 04 02:45:19.523762 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.523567    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp" event={"ID":"6a47414e-24ca-4b3a-873a-c90633787a51","Type":"ContainerDied","Data":"95cabf9da8027e1a7aecfefea935da8114fa52593d4a51a579bbaf3b7bdc7077"}
Nov 04 02:45:19.523762 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.523575    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"
Nov 04 02:45:19.523762 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.523635    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp" event={"ID":"6a47414e-24ca-4b3a-873a-c90633787a51","Type":"ContainerDied","Data":"20c99b463a2487840b8f0ebc28830a31da0ed28056ab20a618dd8e0a34a6b56f"}
Nov 04 02:45:19.523762 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.523657    5450 scope.go:122] "RemoveContainer" containerID="95cabf9da8027e1a7aecfefea935da8114fa52593d4a51a579bbaf3b7bdc7077"
Nov 04 02:45:19.533784 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.533762    5450 scope.go:122] "RemoveContainer" containerID="95cabf9da8027e1a7aecfefea935da8114fa52593d4a51a579bbaf3b7bdc7077"
Nov 04 02:45:19.534110 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:45:19.534085    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95cabf9da8027e1a7aecfefea935da8114fa52593d4a51a579bbaf3b7bdc7077\": container with ID starting with 95cabf9da8027e1a7aecfefea935da8114fa52593d4a51a579bbaf3b7bdc7077 not found: ID does not exist" containerID="95cabf9da8027e1a7aecfefea935da8114fa52593d4a51a579bbaf3b7bdc7077"
Nov 04 02:45:19.534171 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.534120    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95cabf9da8027e1a7aecfefea935da8114fa52593d4a51a579bbaf3b7bdc7077"} err="failed to get container status \"95cabf9da8027e1a7aecfefea935da8114fa52593d4a51a579bbaf3b7bdc7077\": rpc error: code = NotFound desc = could not find container \"95cabf9da8027e1a7aecfefea935da8114fa52593d4a51a579bbaf3b7bdc7077\": container with ID starting with 95cabf9da8027e1a7aecfefea935da8114fa52593d4a51a579bbaf3b7bdc7077 not found: ID does not exist"
Nov 04 02:45:19.684325 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.684294    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"]
Nov 04 02:45:19.688336 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:19.688306    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-80b404-b7975487-slnhp"]
Nov 04 02:45:20.633842 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:20.633799    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6a47414e-24ca-4b3a-873a-c90633787a51" path="/var/lib/kubelet/pods/6a47414e-24ca-4b3a-873a-c90633787a51/volumes"
Nov 04 02:45:35.310591 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:35.310556    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:45:47.763699 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:45:47.763657    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:45:49.906969 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:45:49.906934    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:46:03.877613 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:03.877573    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:46:06.019945 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:06.019910    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"]
Nov 04 02:46:06.128364 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:06.128332    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"]
Nov 04 02:46:11.020527 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.020486    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp" podUID="2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7" containerName="payload-processing" containerID="cri-o://142b1ef924ea0273e583ffd5f919e5caeae0471d96eb7e0ddb7fa291c8ad1f14" gracePeriod=25
Nov 04 02:46:11.128833 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.128775    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2" podUID="2a76723a-39f2-468f-ae6b-dc0984460548" containerName="payload-pre-processing" containerID="cri-o://e8f4f9e24b044890707d6d92db6ed6655facb5fbca39837197e8e147ac8552f7" gracePeriod=25
Nov 04 02:46:11.283936 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.283865    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"
Nov 04 02:46:11.375585 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.375559    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"
Nov 04 02:46:11.404258 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.404233    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-plugins-config-volume\") pod \"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7\" (UID: \"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7\") "
Nov 04 02:46:11.404440 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.404296    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-kube-api-access-n9qhv\" (UniqueName: \"kubernetes.io/projected/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-kube-api-access-n9qhv\") pod \"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7\" (UID: \"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7\") "
Nov 04 02:46:11.404726 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.404699    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-plugins-config-volume" pod "2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7" (UID: "2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:46:11.406449 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.406426    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-kube-api-access-n9qhv" pod "2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7" (UID: "2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7"). InnerVolumeSpecName "kube-api-access-n9qhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:46:11.505344 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.505304    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2a76723a-39f2-468f-ae6b-dc0984460548-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a76723a-39f2-468f-ae6b-dc0984460548-plugins-config-volume\") pod \"2a76723a-39f2-468f-ae6b-dc0984460548\" (UID: \"2a76723a-39f2-468f-ae6b-dc0984460548\") "
Nov 04 02:46:11.505538 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.505368    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a76723a-39f2-468f-ae6b-dc0984460548-kube-api-access-92bl5\" (UniqueName: \"kubernetes.io/projected/2a76723a-39f2-468f-ae6b-dc0984460548-kube-api-access-92bl5\") pod \"2a76723a-39f2-468f-ae6b-dc0984460548\" (UID: \"2a76723a-39f2-468f-ae6b-dc0984460548\") "
Nov 04 02:46:11.505639 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.505579    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:11.505639 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.505591    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9qhv\" (UniqueName: \"kubernetes.io/projected/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7-kube-api-access-n9qhv\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:11.505798 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.505773    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a76723a-39f2-468f-ae6b-dc0984460548-plugins-config-volume" pod "2a76723a-39f2-468f-ae6b-dc0984460548" (UID: "2a76723a-39f2-468f-ae6b-dc0984460548"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:46:11.507908 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.507870    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a76723a-39f2-468f-ae6b-dc0984460548-kube-api-access-92bl5" pod "2a76723a-39f2-468f-ae6b-dc0984460548" (UID: "2a76723a-39f2-468f-ae6b-dc0984460548"). InnerVolumeSpecName "kube-api-access-92bl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:46:11.613037 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.612952    5450 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a76723a-39f2-468f-ae6b-dc0984460548-plugins-config-volume\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:11.613037 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.612986    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92bl5\" (UniqueName: \"kubernetes.io/projected/2a76723a-39f2-468f-ae6b-dc0984460548-kube-api-access-92bl5\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:11.789738 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.789696    5450 generic.go:356] "Generic (PLEG): container finished" podID="2a76723a-39f2-468f-ae6b-dc0984460548" containerID="e8f4f9e24b044890707d6d92db6ed6655facb5fbca39837197e8e147ac8552f7" exitCode=0
Nov 04 02:46:11.789930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.789748    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"
Nov 04 02:46:11.789930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.789778    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2" event={"ID":"2a76723a-39f2-468f-ae6b-dc0984460548","Type":"ContainerDied","Data":"e8f4f9e24b044890707d6d92db6ed6655facb5fbca39837197e8e147ac8552f7"}
Nov 04 02:46:11.789930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.789844    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2" event={"ID":"2a76723a-39f2-468f-ae6b-dc0984460548","Type":"ContainerDied","Data":"5f104c38eba8f5d16fe72a2f440ea73534da6e8bf8ba3cb005275ebe68313e4a"}
Nov 04 02:46:11.789930 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.789886    5450 scope.go:122] "RemoveContainer" containerID="e8f4f9e24b044890707d6d92db6ed6655facb5fbca39837197e8e147ac8552f7"
Nov 04 02:46:11.792966 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.792541    5450 generic.go:356] "Generic (PLEG): container finished" podID="2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7" containerID="142b1ef924ea0273e583ffd5f919e5caeae0471d96eb7e0ddb7fa291c8ad1f14" exitCode=0
Nov 04 02:46:11.792966 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.792726    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp" event={"ID":"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7","Type":"ContainerDied","Data":"142b1ef924ea0273e583ffd5f919e5caeae0471d96eb7e0ddb7fa291c8ad1f14"}
Nov 04 02:46:11.792966 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.792819    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp" event={"ID":"2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7","Type":"ContainerDied","Data":"4380efbc800988972e583a366952359905f56d90b6836c85c3bb615b9f345fe5"}
Nov 04 02:46:11.793140 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.793065    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"
Nov 04 02:46:11.815823 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.815797    5450 scope.go:122] "RemoveContainer" containerID="e8f4f9e24b044890707d6d92db6ed6655facb5fbca39837197e8e147ac8552f7"
Nov 04 02:46:11.816320 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:46:11.816297    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8f4f9e24b044890707d6d92db6ed6655facb5fbca39837197e8e147ac8552f7\": container with ID starting with e8f4f9e24b044890707d6d92db6ed6655facb5fbca39837197e8e147ac8552f7 not found: ID does not exist" containerID="e8f4f9e24b044890707d6d92db6ed6655facb5fbca39837197e8e147ac8552f7"
Nov 04 02:46:11.816389 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.816331    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8f4f9e24b044890707d6d92db6ed6655facb5fbca39837197e8e147ac8552f7"} err="failed to get container status \"e8f4f9e24b044890707d6d92db6ed6655facb5fbca39837197e8e147ac8552f7\": rpc error: code = NotFound desc = could not find container \"e8f4f9e24b044890707d6d92db6ed6655facb5fbca39837197e8e147ac8552f7\": container with ID starting with e8f4f9e24b044890707d6d92db6ed6655facb5fbca39837197e8e147ac8552f7 not found: ID does not exist"
Nov 04 02:46:11.816389 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.816355    5450 scope.go:122] "RemoveContainer" containerID="142b1ef924ea0273e583ffd5f919e5caeae0471d96eb7e0ddb7fa291c8ad1f14"
Nov 04 02:46:11.826109 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.826090    5450 scope.go:122] "RemoveContainer" containerID="142b1ef924ea0273e583ffd5f919e5caeae0471d96eb7e0ddb7fa291c8ad1f14"
Nov 04 02:46:11.826397 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:46:11.826374    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"142b1ef924ea0273e583ffd5f919e5caeae0471d96eb7e0ddb7fa291c8ad1f14\": container with ID starting with 142b1ef924ea0273e583ffd5f919e5caeae0471d96eb7e0ddb7fa291c8ad1f14 not found: ID does not exist" containerID="142b1ef924ea0273e583ffd5f919e5caeae0471d96eb7e0ddb7fa291c8ad1f14"
Nov 04 02:46:11.826481 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.826405    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142b1ef924ea0273e583ffd5f919e5caeae0471d96eb7e0ddb7fa291c8ad1f14"} err="failed to get container status \"142b1ef924ea0273e583ffd5f919e5caeae0471d96eb7e0ddb7fa291c8ad1f14\": rpc error: code = NotFound desc = could not find container \"142b1ef924ea0273e583ffd5f919e5caeae0471d96eb7e0ddb7fa291c8ad1f14\": container with ID starting with 142b1ef924ea0273e583ffd5f919e5caeae0471d96eb7e0ddb7fa291c8ad1f14 not found: ID does not exist"
Nov 04 02:46:11.948997 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.948905    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"]
Nov 04 02:46:11.953924 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:11.953895    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-1e4f1e-5455747c5f-nsjh2"]
Nov 04 02:46:12.060282 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:12.060243    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"]
Nov 04 02:46:12.064492 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:12.064466    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-1e4f1e-57b677d95d-xsmnp"]
Nov 04 02:46:12.636379 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:12.636338    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2a76723a-39f2-468f-ae6b-dc0984460548" path="/var/lib/kubelet/pods/2a76723a-39f2-468f-ae6b-dc0984460548/volumes"
Nov 04 02:46:12.636868 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:12.636845    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7" path="/var/lib/kubelet/pods/2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7/volumes"
Nov 04 02:46:17.763170 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:46:17.763137    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:46:17.919034 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:17.918999    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"]
Nov 04 02:46:17.919226 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:17.919202    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5" podUID="00af9bdc-ac9c-4d11-9589-4d5dc6609aa3" containerName="maas-api" containerID="cri-o://f7e1c5e2d70998a4c843e1aad5469ba5bb39eb170e5a4d57f3a6c4664fe1bbe6" gracePeriod=30
Nov 04 02:46:18.178806 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.178777    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:46:18.184318 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.184291    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-maas-api-tls\") pod \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") "
Nov 04 02:46:18.184460 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.184336    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-metrics-certs\") pod \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") "
Nov 04 02:46:18.184460 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.184398    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-kube-api-access-7t2xr\" (UniqueName: \"kubernetes.io/projected/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-kube-api-access-7t2xr\") pod \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") "
Nov 04 02:46:18.184573 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.184522    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-openshift-service-ca\") pod \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\" (UID: \"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3\") "
Nov 04 02:46:18.184890 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.184862    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-openshift-service-ca" pod "00af9bdc-ac9c-4d11-9589-4d5dc6609aa3" (UID: "00af9bdc-ac9c-4d11-9589-4d5dc6609aa3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:46:18.186428 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.186400    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-metrics-certs" pod "00af9bdc-ac9c-4d11-9589-4d5dc6609aa3" (UID: "00af9bdc-ac9c-4d11-9589-4d5dc6609aa3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:46:18.186784 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.186765    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-maas-api-tls" pod "00af9bdc-ac9c-4d11-9589-4d5dc6609aa3" (UID: "00af9bdc-ac9c-4d11-9589-4d5dc6609aa3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:46:18.186844 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.186829    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-kube-api-access-7t2xr" pod "00af9bdc-ac9c-4d11-9589-4d5dc6609aa3" (UID: "00af9bdc-ac9c-4d11-9589-4d5dc6609aa3"). InnerVolumeSpecName "kube-api-access-7t2xr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:46:18.285570 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.285491    5450 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-openshift-service-ca\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:18.285570 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.285519    5450 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-maas-api-tls\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:18.285570 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.285531    5450 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-metrics-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:18.285570 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.285539    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t2xr\" (UniqueName: \"kubernetes.io/projected/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3-kube-api-access-7t2xr\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:18.831198 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.831162    5450 generic.go:356] "Generic (PLEG): container finished" podID="00af9bdc-ac9c-4d11-9589-4d5dc6609aa3" containerID="f7e1c5e2d70998a4c843e1aad5469ba5bb39eb170e5a4d57f3a6c4664fe1bbe6" exitCode=0
Nov 04 02:46:18.831692 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.831216    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"
Nov 04 02:46:18.831692 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.831246    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5" event={"ID":"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3","Type":"ContainerDied","Data":"f7e1c5e2d70998a4c843e1aad5469ba5bb39eb170e5a4d57f3a6c4664fe1bbe6"}
Nov 04 02:46:18.831692 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.831306    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5" event={"ID":"00af9bdc-ac9c-4d11-9589-4d5dc6609aa3","Type":"ContainerDied","Data":"6c7f0e320b657283aaacb11b472da8e202fb78611238b041a600d25590bba776"}
Nov 04 02:46:18.831692 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.831334    5450 scope.go:122] "RemoveContainer" containerID="f7e1c5e2d70998a4c843e1aad5469ba5bb39eb170e5a4d57f3a6c4664fe1bbe6"
Nov 04 02:46:18.840443 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.840427    5450 scope.go:122] "RemoveContainer" containerID="f7e1c5e2d70998a4c843e1aad5469ba5bb39eb170e5a4d57f3a6c4664fe1bbe6"
Nov 04 02:46:18.840710 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:46:18.840692    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7e1c5e2d70998a4c843e1aad5469ba5bb39eb170e5a4d57f3a6c4664fe1bbe6\": container with ID starting with f7e1c5e2d70998a4c843e1aad5469ba5bb39eb170e5a4d57f3a6c4664fe1bbe6 not found: ID does not exist" containerID="f7e1c5e2d70998a4c843e1aad5469ba5bb39eb170e5a4d57f3a6c4664fe1bbe6"
Nov 04 02:46:18.840794 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.840715    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e1c5e2d70998a4c843e1aad5469ba5bb39eb170e5a4d57f3a6c4664fe1bbe6"} err="failed to get container status \"f7e1c5e2d70998a4c843e1aad5469ba5bb39eb170e5a4d57f3a6c4664fe1bbe6\": rpc error: code = NotFound desc = could not find container \"f7e1c5e2d70998a4c843e1aad5469ba5bb39eb170e5a4d57f3a6c4664fe1bbe6\": container with ID starting with f7e1c5e2d70998a4c843e1aad5469ba5bb39eb170e5a4d57f3a6c4664fe1bbe6 not found: ID does not exist"
Nov 04 02:46:18.991701 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:18.991613    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"]
Nov 04 02:46:19.038193 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:19.038157    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-1e4f1e-5479f4dcd6-2p2h5"]
Nov 04 02:46:20.631632 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:20.631580    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="00af9bdc-ac9c-4d11-9589-4d5dc6609aa3" path="/var/lib/kubelet/pods/00af9bdc-ac9c-4d11-9589-4d5dc6609aa3/volumes"
Nov 04 02:46:24.405665 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:24.405634    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-ckdtv"]
Nov 04 02:46:30.283992 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:30.283953    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"]
Nov 04 02:46:30.284446 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:30.284148    5450 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz" podUID="f311be95-2069-4a78-b3c1-39a111f1ddf4" containerName="istio-proxy" containerID="cri-o://a91b654ece7aeffea36c19893e4933db4f05b4a1db93392107cd2b6e7acd2ec1" gracePeriod=30
Nov 04 02:46:32.546080 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:32.546046    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-bkv7h_2fcf4580-8c24-41b9-a93f-dbc2feac8a7e/kuadrant-console-plugin/0.log"
Nov 04 02:46:33.748516 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:33.748489    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-ckdtv_4504d788-446c-46d7-863e-b4da14a53d0b/limitador/0.log"
Nov 04 02:46:35.301507 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.301480    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-z99gz_94467c99-f42c-4305-a2c8-0566e48b68b5/manager/0.log"
Nov 04 02:46:35.537196 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.537173    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:46:35.672847 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.672768    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-certs\") pod \"f311be95-2069-4a78-b3c1-39a111f1ddf4\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") "
Nov 04 02:46:35.672847 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.672807    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-kube-api-access-xgckh\" (UniqueName: \"kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-kube-api-access-xgckh\") pod \"f311be95-2069-4a78-b3c1-39a111f1ddf4\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") "
Nov 04 02:46:35.672847 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.672837    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-podinfo\") pod \"f311be95-2069-4a78-b3c1-39a111f1ddf4\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") "
Nov 04 02:46:35.673091 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.672864    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f311be95-2069-4a78-b3c1-39a111f1ddf4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f311be95-2069-4a78-b3c1-39a111f1ddf4-istiod-ca-cert\") pod \"f311be95-2069-4a78-b3c1-39a111f1ddf4\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") "
Nov 04 02:46:35.673091 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.672927    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-envoy\") pod \"f311be95-2069-4a78-b3c1-39a111f1ddf4\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") "
Nov 04 02:46:35.673091 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.672993    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-token\" (UniqueName: \"kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-token\") pod \"f311be95-2069-4a78-b3c1-39a111f1ddf4\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") "
Nov 04 02:46:35.673091 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.673016    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-data\") pod \"f311be95-2069-4a78-b3c1-39a111f1ddf4\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") "
Nov 04 02:46:35.673091 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.673043    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-socket\") pod \"f311be95-2069-4a78-b3c1-39a111f1ddf4\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") "
Nov 04 02:46:35.673346 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.673107    5450 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-credential-socket\") pod \"f311be95-2069-4a78-b3c1-39a111f1ddf4\" (UID: \"f311be95-2069-4a78-b3c1-39a111f1ddf4\") "
Nov 04 02:46:35.673346 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.673113    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-certs" pod "f311be95-2069-4a78-b3c1-39a111f1ddf4" (UID: "f311be95-2069-4a78-b3c1-39a111f1ddf4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:35.673469 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.673382    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-socket" pod "f311be95-2069-4a78-b3c1-39a111f1ddf4" (UID: "f311be95-2069-4a78-b3c1-39a111f1ddf4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:35.673469 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.673390    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-data" pod "f311be95-2069-4a78-b3c1-39a111f1ddf4" (UID: "f311be95-2069-4a78-b3c1-39a111f1ddf4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:35.673586 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.673491    5450 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-certs\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:35.673586 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.673511    5450 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-data\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:35.673721 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.673643    5450 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-workload-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:35.673721 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.673578    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-credential-socket" pod "f311be95-2069-4a78-b3c1-39a111f1ddf4" (UID: "f311be95-2069-4a78-b3c1-39a111f1ddf4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:35.673721 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.673680    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f311be95-2069-4a78-b3c1-39a111f1ddf4-istiod-ca-cert" pod "f311be95-2069-4a78-b3c1-39a111f1ddf4" (UID: "f311be95-2069-4a78-b3c1-39a111f1ddf4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:46:35.674976 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.674958    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-kube-api-access-xgckh" pod "f311be95-2069-4a78-b3c1-39a111f1ddf4" (UID: "f311be95-2069-4a78-b3c1-39a111f1ddf4"). InnerVolumeSpecName "kube-api-access-xgckh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:46:35.675193 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.675176    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-token" pod "f311be95-2069-4a78-b3c1-39a111f1ddf4" (UID: "f311be95-2069-4a78-b3c1-39a111f1ddf4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:46:35.675470 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.675450    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-podinfo" pod "f311be95-2069-4a78-b3c1-39a111f1ddf4" (UID: "f311be95-2069-4a78-b3c1-39a111f1ddf4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:46:35.675540 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.675464    5450 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-envoy" pod "f311be95-2069-4a78-b3c1-39a111f1ddf4" (UID: "f311be95-2069-4a78-b3c1-39a111f1ddf4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:35.774638 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.774578    5450 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-credential-socket\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:35.774638 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.774632    5450 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgckh\" (UniqueName: \"kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-kube-api-access-xgckh\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:35.774638 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.774647    5450 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-podinfo\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:35.774869 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.774663    5450 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f311be95-2069-4a78-b3c1-39a111f1ddf4-istiod-ca-cert\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:35.774869 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.774677    5450 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-envoy\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:35.774869 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.774688    5450 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f311be95-2069-4a78-b3c1-39a111f1ddf4-istio-token\") on node \"ip-10-0-131-226.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:35.921771 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.921735    5450 generic.go:356] "Generic (PLEG): container finished" podID="f311be95-2069-4a78-b3c1-39a111f1ddf4" containerID="a91b654ece7aeffea36c19893e4933db4f05b4a1db93392107cd2b6e7acd2ec1" exitCode=0
Nov 04 02:46:35.921945 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.921783    5450 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"
Nov 04 02:46:35.921945 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.921820    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz" event={"ID":"f311be95-2069-4a78-b3c1-39a111f1ddf4","Type":"ContainerDied","Data":"a91b654ece7aeffea36c19893e4933db4f05b4a1db93392107cd2b6e7acd2ec1"}
Nov 04 02:46:35.921945 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.921872    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz" event={"ID":"f311be95-2069-4a78-b3c1-39a111f1ddf4","Type":"ContainerDied","Data":"207efc94e5036b20ef83a3b1b860a57163b64f612af6994cb31931fa2fb53215"}
Nov 04 02:46:35.921945 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.921910    5450 scope.go:122] "RemoveContainer" containerID="a91b654ece7aeffea36c19893e4933db4f05b4a1db93392107cd2b6e7acd2ec1"
Nov 04 02:46:35.933873 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.933846    5450 scope.go:122] "RemoveContainer" containerID="a91b654ece7aeffea36c19893e4933db4f05b4a1db93392107cd2b6e7acd2ec1"
Nov 04 02:46:35.934251 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:46:35.934233    5450 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a91b654ece7aeffea36c19893e4933db4f05b4a1db93392107cd2b6e7acd2ec1\": container with ID starting with a91b654ece7aeffea36c19893e4933db4f05b4a1db93392107cd2b6e7acd2ec1 not found: ID does not exist" containerID="a91b654ece7aeffea36c19893e4933db4f05b4a1db93392107cd2b6e7acd2ec1"
Nov 04 02:46:35.934314 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:35.934261    5450 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91b654ece7aeffea36c19893e4933db4f05b4a1db93392107cd2b6e7acd2ec1"} err="failed to get container status \"a91b654ece7aeffea36c19893e4933db4f05b4a1db93392107cd2b6e7acd2ec1\": rpc error: code = NotFound desc = could not find container \"a91b654ece7aeffea36c19893e4933db4f05b4a1db93392107cd2b6e7acd2ec1\": container with ID starting with a91b654ece7aeffea36c19893e4933db4f05b4a1db93392107cd2b6e7acd2ec1 not found: ID does not exist"
Nov 04 02:46:36.080822 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:36.080783    5450 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"]
Nov 04 02:46:36.128857 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:36.128819    5450 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-nzzdz"]
Nov 04 02:46:36.217063 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:36.216985    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74b9444797-jtnrf_79065a57-7320-4823-a727-1fcb50145dd1/manager/0.log"
Nov 04 02:46:36.560114 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:36.560085    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-phrf7_c831875f-bf66-4462-a8d0-04b9692e01ab/server/0.log"
Nov 04 02:46:36.632574 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:36.632538    5450 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f311be95-2069-4a78-b3c1-39a111f1ddf4" path="/var/lib/kubelet/pods/f311be95-2069-4a78-b3c1-39a111f1ddf4/volumes"
Nov 04 02:46:36.807341 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:36.807315    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-h9lpt_7a9a3d4a-e35f-44f3-b256-782fa8625556/manager/0.log"
Nov 04 02:46:44.853174 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:44.853136    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:46:44.857457 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:44.857433    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2cfx8_cf5bf92a-b637-4ed5-b2a8-2b6e2d5b3c9b/ovn-acl-logging/0.log"
Nov 04 02:46:47.763806 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:46:47.763769    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:46:54.794095 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:54.794023    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-z99gz_94467c99-f42c-4305-a2c8-0566e48b68b5/manager/0.log"
Nov 04 02:46:55.817162 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:55.817125    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74b9444797-jtnrf_79065a57-7320-4823-a727-1fcb50145dd1/manager/0.log"
Nov 04 02:46:56.275062 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:56.275039    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-phrf7_c831875f-bf66-4462-a8d0-04b9692e01ab/server/0.log"
Nov 04 02:46:56.506810 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:56.506780    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-h9lpt_7a9a3d4a-e35f-44f3-b256-782fa8625556/manager/0.log"
Nov 04 02:46:57.804170 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:57.804138    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-57fb95ff7c-2swn6_00731567-5ec5-45f5-a4a0-d692ec45cd52/maas-api/0.log"
Nov 04 02:46:58.792765 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:46:58.792736    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-bn8xx_cfbf4e94-67ea-40a9-9555-48666da8fa67/postgres/0.log"
Nov 04 02:47:01.662451 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:01.662425    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-bkv7h_2fcf4580-8c24-41b9-a93f-dbc2feac8a7e/kuadrant-console-plugin/0.log"
Nov 04 02:47:02.686102 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:02.686068    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-ckdtv_4504d788-446c-46d7-863e-b4da14a53d0b/limitador/0.log"
Nov 04 02:47:04.404454 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:04.404414    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d555fc4c8-4mcz9_49b58c3b-6d85-4798-9417-b0b5a938ee1d/kube-auth-proxy/0.log"
Nov 04 02:47:04.870727 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:04.870697    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-785jm_acd18f37-52e9-45bb-8b81-ae4f8f64fbcc/istio-proxy/0.log"
Nov 04 02:47:06.358433 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:06.358398    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-gdn98_3a57cd78-39fc-48ca-b789-a64ea82c12dd/istio-proxy/0.log"
Nov 04 02:47:07.117584 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:07.117553    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-xdcsw_7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d/istio-proxy/0.log"
Nov 04 02:47:07.652592 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:07.652550    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-4l68q_2e145331-60bc-4fea-9d4e-04bfbb4964c8/payload-pre-processing/0.log"
Nov 04 02:47:07.892889 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:07.892853    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-bd857_87b7890e-a38b-45c7-8ca3-4fe3ba33435f/payload-processing/0.log"
Nov 04 02:47:09.579604 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:09.579565    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-vkkgd_9a78a346-f513-4cb1-a278-6d5ae9eb66f3/main/0.log"
Nov 04 02:47:10.413695 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:10.413665    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pbxm9_1bdddd82-a903-4017-98ae-200faa4219c3/main/0.log"
Nov 04 02:47:10.716821 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:10.716742    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-snzd9_7bdc67c0-5165-4137-a066-78649d51681c/main/0.log"
Nov 04 02:47:17.762998 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:47:17.762960    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:47:32.987566 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:32.987535    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-msgpp_3e6dcb66-ce72-40ee-86fd-96d07dc4960f/global-pull-secret-syncer/0.log"
Nov 04 02:47:34.310633 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:34.310607    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-z99gz_94467c99-f42c-4305-a2c8-0566e48b68b5/manager/0.log"
Nov 04 02:47:35.104729 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:35.104688    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74b9444797-jtnrf_79065a57-7320-4823-a727-1fcb50145dd1/manager/0.log"
Nov 04 02:47:35.484681 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:35.484589    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-phrf7_c831875f-bf66-4462-a8d0-04b9692e01ab/server/0.log"
Nov 04 02:47:35.793106 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:35.793072    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n9lpj_d501b5d8-6030-4871-a7f9-a352f96a4d2f/konnectivity-agent/0.log"
Nov 04 02:47:36.067925 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:36.067847    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-h9lpt_7a9a3d4a-e35f-44f3-b256-782fa8625556/manager/0.log"
Nov 04 02:47:36.649122 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:36.649092    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-226.us-west-2.compute.internal_68f285f0cd89b6c329b3b82af5b728f4/haproxy/0.log"
Nov 04 02:47:39.261317 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:39.261281    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-z99gz_94467c99-f42c-4305-a2c8-0566e48b68b5/manager/0.log"
Nov 04 02:47:40.044896 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:40.044861    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74b9444797-jtnrf_79065a57-7320-4823-a727-1fcb50145dd1/manager/0.log"
Nov 04 02:47:40.461862 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:40.461776    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-phrf7_c831875f-bf66-4462-a8d0-04b9692e01ab/server/0.log"
Nov 04 02:47:41.055977 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.055947    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-h9lpt_7a9a3d4a-e35f-44f3-b256-782fa8625556/manager/0.log"
Nov 04 02:47:41.136060 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.136029    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-bkv7h_2fcf4580-8c24-41b9-a93f-dbc2feac8a7e/kuadrant-console-plugin/0.log"
Nov 04 02:47:41.795282 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795252    5450 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"]
Nov 04 02:47:41.795695 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795682    5450 cpu_manager.go:414] "containerMap: removing container" podUID="2e57dff1-c713-4778-aa19-9442f0017fbb" containerName="istio-proxy"
Nov 04 02:47:41.795739 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795696    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e57dff1-c713-4778-aa19-9442f0017fbb" containerName="istio-proxy"
Nov 04 02:47:41.795739 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795712    5450 cpu_manager.go:414] "containerMap: removing container" podUID="0eb7183f-c331-4c13-898c-bf6085376df2" containerName="payload-processing"
Nov 04 02:47:41.795739 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795717    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0eb7183f-c331-4c13-898c-bf6085376df2" containerName="payload-processing"
Nov 04 02:47:41.795739 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795736    5450 cpu_manager.go:414] "containerMap: removing container" podUID="4d66fc2c-399d-44e5-84f9-28373e7aacae" containerName="maas-api"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795741    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d66fc2c-399d-44e5-84f9-28373e7aacae" containerName="maas-api"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795754    5450 cpu_manager.go:414] "containerMap: removing container" podUID="2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7" containerName="payload-processing"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795759    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7" containerName="payload-processing"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795768    5450 cpu_manager.go:414] "containerMap: removing container" podUID="f311be95-2069-4a78-b3c1-39a111f1ddf4" containerName="istio-proxy"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795773    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f311be95-2069-4a78-b3c1-39a111f1ddf4" containerName="istio-proxy"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795780    5450 cpu_manager.go:414] "containerMap: removing container" podUID="6a47414e-24ca-4b3a-873a-c90633787a51" containerName="maas-api"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795784    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6a47414e-24ca-4b3a-873a-c90633787a51" containerName="maas-api"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795794    5450 cpu_manager.go:414] "containerMap: removing container" podUID="d107791d-401c-469f-8d48-749147f7ef24" containerName="payload-pre-processing"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795798    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d107791d-401c-469f-8d48-749147f7ef24" containerName="payload-pre-processing"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795807    5450 cpu_manager.go:414] "containerMap: removing container" podUID="00af9bdc-ac9c-4d11-9589-4d5dc6609aa3" containerName="maas-api"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795811    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="00af9bdc-ac9c-4d11-9589-4d5dc6609aa3" containerName="maas-api"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795818    5450 cpu_manager.go:414] "containerMap: removing container" podUID="e13dcd76-74dd-4201-bb8b-612f7be49c32" containerName="payload-pre-processing"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795823    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e13dcd76-74dd-4201-bb8b-612f7be49c32" containerName="payload-pre-processing"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795831    5450 cpu_manager.go:414] "containerMap: removing container" podUID="9af097c5-120a-4b81-a86b-241101d0cbce" containerName="payload-pre-processing"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795835    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9af097c5-120a-4b81-a86b-241101d0cbce" containerName="payload-pre-processing"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795843    5450 cpu_manager.go:414] "containerMap: removing container" podUID="70e41f76-88b7-495d-ba6f-9dc2b0640de1" containerName="istio-proxy"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795847    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="70e41f76-88b7-495d-ba6f-9dc2b0640de1" containerName="istio-proxy"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795855    5450 cpu_manager.go:414] "containerMap: removing container" podUID="2a76723a-39f2-468f-ae6b-dc0984460548" containerName="payload-pre-processing"
Nov 04 02:47:41.795859 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795859    5450 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2a76723a-39f2-468f-ae6b-dc0984460548" containerName="payload-pre-processing"
Nov 04 02:47:41.796412 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795917    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="2bfbdd8b-01b8-4bc5-a0ca-04983655a2b7" containerName="payload-processing"
Nov 04 02:47:41.796412 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795926    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="f311be95-2069-4a78-b3c1-39a111f1ddf4" containerName="istio-proxy"
Nov 04 02:47:41.796412 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795931    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="6a47414e-24ca-4b3a-873a-c90633787a51" containerName="maas-api"
Nov 04 02:47:41.796412 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795937    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="d107791d-401c-469f-8d48-749147f7ef24" containerName="payload-pre-processing"
Nov 04 02:47:41.796412 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795943    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="00af9bdc-ac9c-4d11-9589-4d5dc6609aa3" containerName="maas-api"
Nov 04 02:47:41.796412 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795948    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="e13dcd76-74dd-4201-bb8b-612f7be49c32" containerName="payload-pre-processing"
Nov 04 02:47:41.796412 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795953    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="9af097c5-120a-4b81-a86b-241101d0cbce" containerName="payload-pre-processing"
Nov 04 02:47:41.796412 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795958    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="70e41f76-88b7-495d-ba6f-9dc2b0640de1" containerName="istio-proxy"
Nov 04 02:47:41.796412 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795963    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="2a76723a-39f2-468f-ae6b-dc0984460548" containerName="payload-pre-processing"
Nov 04 02:47:41.796412 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795968    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e57dff1-c713-4778-aa19-9442f0017fbb" containerName="istio-proxy"
Nov 04 02:47:41.796412 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795974    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="0eb7183f-c331-4c13-898c-bf6085376df2" containerName="payload-processing"
Nov 04 02:47:41.796412 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.795981    5450 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d66fc2c-399d-44e5-84f9-28373e7aacae" containerName="maas-api"
Nov 04 02:47:41.799218 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.799196    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.850546 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.850522    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpqsl\"/\"kube-root-ca.crt\""
Nov 04 02:47:41.850546 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.850528    5450 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpqsl\"/\"openshift-service-ca.crt\""
Nov 04 02:47:41.898680 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.898648    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3bedf668-142d-4f4b-9e67-5f8442f61785-proc\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.898833 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.898681    5450 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wpqsl\"/\"default-dockercfg-qfzcp\""
Nov 04 02:47:41.898833 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.898688    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7zqq\" (UniqueName: \"kubernetes.io/projected/3bedf668-142d-4f4b-9e67-5f8442f61785-kube-api-access-n7zqq\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.898833 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.898802    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bedf668-142d-4f4b-9e67-5f8442f61785-sys\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.898971 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.898865    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bedf668-142d-4f4b-9e67-5f8442f61785-lib-modules\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.898971 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.898923    5450 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3bedf668-142d-4f4b-9e67-5f8442f61785-podres\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.900513 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.900495    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"]
Nov 04 02:47:41.999667 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.999634    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bedf668-142d-4f4b-9e67-5f8442f61785-sys\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.999865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.999694    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bedf668-142d-4f4b-9e67-5f8442f61785-lib-modules\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.999865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.999723    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3bedf668-142d-4f4b-9e67-5f8442f61785-podres\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.999865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.999747    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3bedf668-142d-4f4b-9e67-5f8442f61785-proc\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.999865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.999765    5450 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7zqq\" (UniqueName: \"kubernetes.io/projected/3bedf668-142d-4f4b-9e67-5f8442f61785-kube-api-access-n7zqq\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.999865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.999767    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bedf668-142d-4f4b-9e67-5f8442f61785-sys\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.999865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.999833    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bedf668-142d-4f4b-9e67-5f8442f61785-lib-modules\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.999865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.999851    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3bedf668-142d-4f4b-9e67-5f8442f61785-proc\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:41.999865 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:41.999833    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3bedf668-142d-4f4b-9e67-5f8442f61785-podres\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:42.059406 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:42.059342    5450 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7zqq\" (UniqueName: \"kubernetes.io/projected/3bedf668-142d-4f4b-9e67-5f8442f61785-kube-api-access-n7zqq\") pod \"perf-node-gather-daemonset-fwkx6\" (UID: \"3bedf668-142d-4f4b-9e67-5f8442f61785\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:42.111704 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:42.111663    5450 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:42.310281 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:42.310205    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-ckdtv_4504d788-446c-46d7-863e-b4da14a53d0b/limitador/0.log"
Nov 04 02:47:42.480664 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:42.480625    5450 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"]
Nov 04 02:47:42.487295 ip-10-0-131-226 kubenswrapper[5450]: W1104 02:47:42.487266    5450 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3bedf668_142d_4f4b_9e67_5f8442f61785.slice/crio-2a243fe7d15c19bda727ceff4fbacea9717f1dd8df17bb67bc9c62f65c2b6c59 WatchSource:0}: Error finding container 2a243fe7d15c19bda727ceff4fbacea9717f1dd8df17bb67bc9c62f65c2b6c59: Status 404 returned error can't find the container with id 2a243fe7d15c19bda727ceff4fbacea9717f1dd8df17bb67bc9c62f65c2b6c59
Nov 04 02:47:43.242936 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:43.242892    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6" event={"ID":"3bedf668-142d-4f4b-9e67-5f8442f61785","Type":"ContainerStarted","Data":"dfced381faf8b7728047100e88502660b1b0dc310d06a9822cf4fb0c2cab28d0"}
Nov 04 02:47:43.243331 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:43.242950    5450 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6" event={"ID":"3bedf668-142d-4f4b-9e67-5f8442f61785","Type":"ContainerStarted","Data":"2a243fe7d15c19bda727ceff4fbacea9717f1dd8df17bb67bc9c62f65c2b6c59"}
Nov 04 02:47:43.243331 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:43.243013    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:43.357494 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:43.357428    5450 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6" podStartSLOduration=2.3574148839999998 podStartE2EDuration="2.357414884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:47:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:47:43.355951222 +0000 UTC m=+1858.859891716" watchObservedRunningTime="2026-11-04 02:47:43.357414884 +0000 UTC m=+1858.861355378"
Nov 04 02:47:44.222226 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:44.222197    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-z99gz_94467c99-f42c-4305-a2c8-0566e48b68b5/manager/0.log"
Nov 04 02:47:44.972206 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:44.972173    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74b9444797-jtnrf_79065a57-7320-4823-a727-1fcb50145dd1/manager/0.log"
Nov 04 02:47:45.198736 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:45.198708    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-phrf7_c831875f-bf66-4462-a8d0-04b9692e01ab/server/0.log"
Nov 04 02:47:45.264988 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:45.264959    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8a7228a5-f340-4a34-ab5b-a89ddd9832ea/alertmanager/0.log"
Nov 04 02:47:45.680002 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:45.679923    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8a7228a5-f340-4a34-ab5b-a89ddd9832ea/config-reloader/0.log"
Nov 04 02:47:45.792726 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:45.792693    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-h9lpt_7a9a3d4a-e35f-44f3-b256-782fa8625556/manager/0.log"
Nov 04 02:47:46.093134 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:46.093109    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8a7228a5-f340-4a34-ab5b-a89ddd9832ea/kube-rbac-proxy-web/0.log"
Nov 04 02:47:46.506770 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:46.506748    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8a7228a5-f340-4a34-ab5b-a89ddd9832ea/kube-rbac-proxy/0.log"
Nov 04 02:47:46.920798 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:46.920721    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8a7228a5-f340-4a34-ab5b-a89ddd9832ea/kube-rbac-proxy-metric/0.log"
Nov 04 02:47:47.334178 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:47.334154    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8a7228a5-f340-4a34-ab5b-a89ddd9832ea/prom-label-proxy/0.log"
Nov 04 02:47:47.747769 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:47.747705    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8a7228a5-f340-4a34-ab5b-a89ddd9832ea/init-config-reloader/0.log"
Nov 04 02:47:47.763726 ip-10-0-131-226 kubenswrapper[5450]: E1104 02:47:47.763692    5450 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xq8jl" containerName="extractor"
Nov 04 02:47:48.572563 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:48.572533    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-dvc9c_64552c37-114a-47cf-8c71-cbab012174d0/kube-state-metrics/0.log"
Nov 04 02:47:48.983521 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:48.983445    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-dvc9c_64552c37-114a-47cf-8c71-cbab012174d0/kube-rbac-proxy-main/0.log"
Nov 04 02:47:49.261236 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:49.261212    5450 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-fwkx6"
Nov 04 02:47:49.395061 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:49.395031    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-dvc9c_64552c37-114a-47cf-8c71-cbab012174d0/kube-rbac-proxy-self/0.log"
Nov 04 02:47:49.817967 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:49.817941    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66b6494b5d-lk428_ef999918-fa31-440e-ba39-f20feca4f4ab/metrics-server/0.log"
Nov 04 02:47:50.234702 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:50.234630    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-75ztr_539faf35-0294-46b3-847c-c8e33464ba7b/monitoring-plugin/0.log"
Nov 04 02:47:50.496306 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:50.496227    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d555fc4c8-4mcz9_49b58c3b-6d85-4798-9417-b0b5a938ee1d/kube-auth-proxy/0.log"
Nov 04 02:47:50.949775 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:50.949744    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-785jm_acd18f37-52e9-45bb-8b81-ae4f8f64fbcc/istio-proxy/0.log"
Nov 04 02:47:52.267176 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:52.267147    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-gdn98_3a57cd78-39fc-48ca-b789-a64ea82c12dd/istio-proxy/0.log"
Nov 04 02:47:52.942654 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:52.942626    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-xdcsw_7cd47d53-fc21-4b2d-8e8a-4396bb8bfa5d/istio-proxy/0.log"
Nov 04 02:47:53.035124 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:53.035097    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xt6nc_a222092c-b379-4b4b-a857-de3236571886/node-exporter/0.log"
Nov 04 02:47:53.385520 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:53.385491    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-4l68q_2e145331-60bc-4fea-9d4e-04bfbb4964c8/payload-pre-processing/0.log"
Nov 04 02:47:53.446586 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:53.446557    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xt6nc_a222092c-b379-4b4b-a857-de3236571886/kube-rbac-proxy/0.log"
Nov 04 02:47:53.613373 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:53.613344    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-bd857_87b7890e-a38b-45c7-8ca3-4fe3ba33435f/payload-processing/0.log"
Nov 04 02:47:53.861151 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:53.861127    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xt6nc_a222092c-b379-4b4b-a857-de3236571886/init-textfile/0.log"
Nov 04 02:47:54.276545 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:54.276513    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-9czt7_4473b042-87a2-4397-a283-2ac777fc838e/kube-rbac-proxy-main/0.log"
Nov 04 02:47:54.688730 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:54.688665    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-9czt7_4473b042-87a2-4397-a283-2ac777fc838e/kube-rbac-proxy-self/0.log"
Nov 04 02:47:55.104294 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:55.104265    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-9czt7_4473b042-87a2-4397-a283-2ac777fc838e/openshift-state-metrics/0.log"
Nov 04 02:47:55.531554 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:55.531527    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5353ff64-a4c2-4eea-840f-f072db82beca/prometheus/0.log"
Nov 04 02:47:55.942981 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:55.942905    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5353ff64-a4c2-4eea-840f-f072db82beca/config-reloader/0.log"
Nov 04 02:47:56.355711 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:56.355680    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5353ff64-a4c2-4eea-840f-f072db82beca/thanos-sidecar/0.log"
Nov 04 02:47:56.780905 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:56.780878    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5353ff64-a4c2-4eea-840f-f072db82beca/kube-rbac-proxy-web/0.log"
Nov 04 02:47:57.194516 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:57.194442    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5353ff64-a4c2-4eea-840f-f072db82beca/kube-rbac-proxy/0.log"
Nov 04 02:47:57.606493 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:57.606465    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5353ff64-a4c2-4eea-840f-f072db82beca/kube-rbac-proxy-thanos/0.log"
Nov 04 02:47:58.019539 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:58.019513    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5353ff64-a4c2-4eea-840f-f072db82beca/init-config-reloader/0.log"
Nov 04 02:47:58.439046 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:58.438975    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-8gfqc_638f2276-6417-4b5f-a0d1-5d3d0e85d63a/prometheus-operator/0.log"
Nov 04 02:47:58.706698 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:58.706627    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-bkv7h_2fcf4580-8c24-41b9-a93f-dbc2feac8a7e/kuadrant-console-plugin/0.log"
Nov 04 02:47:58.854840 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:58.854811    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-8gfqc_638f2276-6417-4b5f-a0d1-5d3d0e85d63a/kube-rbac-proxy/0.log"
Nov 04 02:47:59.270485 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:59.270456    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-xsflh_5fdaac0b-352b-4199-a772-a7013fab3fe7/prometheus-operator-admission-webhook/0.log"
Nov 04 02:47:59.454213 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:59.454183    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-ckdtv_4504d788-446c-46d7-863e-b4da14a53d0b/limitador/0.log"
Nov 04 02:47:59.688713 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:47:59.688635    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-db9dc59b6-fbdkd_db573293-5d41-4d1c-8f00-c15dec39eb51/telemeter-client/0.log"
Nov 04 02:48:00.099662 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:48:00.099635    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-db9dc59b6-fbdkd_db573293-5d41-4d1c-8f00-c15dec39eb51/reload/0.log"
Nov 04 02:48:00.511701 ip-10-0-131-226 kubenswrapper[5450]: I1104 02:48:00.511678    5450 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-db9dc59b6-fbdkd_db573293-5d41-4d1c-8f00-c15dec39eb51/kube-rbac-proxy/0.log"