Sep 15 11:37:16.202609 ip-10-0-141-110 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 11:37:16.589089 ip-10-0-141-110 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:37:16.589089 ip-10-0-141-110 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 11:37:16.589089 ip-10-0-141-110 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:37:16.589089 ip-10-0-141-110 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 11:37:16.589089 ip-10-0-141-110 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 11:37:16.589810 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.589145    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 11:37:16.591954 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591937    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:37:16.591954 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591952    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:37:16.591954 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591956    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591959    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591962    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591965    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591968    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591971    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591973    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591976    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591979    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591984    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591988    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591992    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591995    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.591998    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592001    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592004    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592007    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592009    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592012    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592015    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:37:16.592048 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592018    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592021    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592024    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592027    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592030    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592036    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592039    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592042    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592044    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592047    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592050    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592052    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592055    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592058    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592061    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592063    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592066    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592070    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592074    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:37:16.592539 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592077    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592079    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592082    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592085    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592087    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592090    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592093    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592095    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592098    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592102    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592104    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592107    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592109    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592112    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592116    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592121    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592124    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592127    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592130    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592132    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:37:16.593039 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592135    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592138    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592140    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592143    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592145    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592148    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592151    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592153    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592156    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592158    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592161    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592164    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592166    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592168    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592171    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592173    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592176    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592179    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592182    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592185    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:37:16.593533 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592188    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592190    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592194    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592198    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592201    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592204    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592207    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592211    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592214    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592217    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592220    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592223    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592225    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592228    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592230    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592233    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592236    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592238    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592949    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:37:16.594051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592956    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592961    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592965    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592969    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592972    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592975    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592978    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592981    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592983    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592986    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592989    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592992    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592995    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.592997    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593000    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593003    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593005    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593008    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593010    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593013    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:37:16.594527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593017    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593019    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593022    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593024    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593027    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593029    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593032    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593034    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593037    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593039    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593042    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593045    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593048    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593050    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593053    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593055    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593058    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593061    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593063    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593066    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:37:16.595051 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593068    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593071    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593073    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593076    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593078    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593081    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593084    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593086    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593089    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593091    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593093    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593096    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593099    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593102    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593105    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593108    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593111    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593113    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593116    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593119    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:37:16.595558 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593121    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593124    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593127    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593129    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593132    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593135    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593138    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593140    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593142    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593145    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593148    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593150    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593152    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593155    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593160    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593163    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593166    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593169    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593172    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:37:16.596059 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593175    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593178    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593181    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593183    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593187    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593191    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593195    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593199    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593202    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593205    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593208    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593210    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593213    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593216    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593218    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593220    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593223    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593226    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593229    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:37:16.596538 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593606    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593614    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593618    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593621    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593624    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593627    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593630    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593633    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593636    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593639    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593641    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593644    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593647    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593650    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593653    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593655    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593658    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593661    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593664    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:37:16.597005 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593667    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593670    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593673    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593676    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593679    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593681    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593684    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593686    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593689    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593691    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593694    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593696    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593699    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593701    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593704    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593706    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593709    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593711    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593714    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593716    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593719    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:37:16.597482 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593722    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593724    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593729    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593732    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593734    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593737    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593740    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593742    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593744    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593748    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593753    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593755    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593758    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593760    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593763    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593766    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593768    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593771    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593773    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593776    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:37:16.598084 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593778    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593781    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593783    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593786    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593789    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593791    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593794    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593796    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593799    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593801    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593804    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593806    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593809    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593812    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593816    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593818    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593821    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593823    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593831    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:37:16.598593 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593834    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593836    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593839    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593843    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593846    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593848    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593851    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593854    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593856    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593859    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593861    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593864    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593866    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593869    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593871    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593874    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593877    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593879    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593883    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.593885    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.593961    2571 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 11:37:16.599061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594004    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594012    2571 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594016    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594020    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594024    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594028    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594033    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594036    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594039    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594042    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594046    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594050    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594053    2571 flags.go:64] FLAG: --cgroup-root=""
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594056    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594060    2571 flags.go:64] FLAG: --client-ca-file=""
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594063    2571 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594066    2571 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594071    2571 flags.go:64] FLAG: --cluster-domain=""
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594073    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594076    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594080    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594083    2571 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594087    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 11:37:16.599580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594090    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594093    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594096    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594099    2571 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594102    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594105    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594108    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594111    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594115    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594118    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594121    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594124    2571 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594127    2571 flags.go:64] FLAG: --enable-server="true"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594130    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594134    2571 flags.go:64] FLAG: --event-burst="100"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594137    2571 flags.go:64] FLAG: --event-qps="50"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594140    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594143    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594145    2571 flags.go:64] FLAG: --eviction-hard=""
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594154    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594157    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594160    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594163    2571 flags.go:64] FLAG: --eviction-soft=""
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594166    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594169    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 11:37:16.600137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594172    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594175    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594178    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594181    2571 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594184    2571 flags.go:64] FLAG: --feature-gates=""
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594187    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594190    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594194    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594197    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594200    2571 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594203    2571 flags.go:64] FLAG: --help="false"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594206    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-141-110.ec2.internal"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594209    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594213    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594216    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594219    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594223    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594226    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594229    2571 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594231    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594234    2571 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594237    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594240    2571 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594255    2571 flags.go:64] FLAG: --kube-reserved=""
Sep 15 11:37:16.600813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594259    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594262    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594265    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594268    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594271    2571 flags.go:64] FLAG: --lock-file=""
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594274    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594278    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594281    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594287    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594290    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594293    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594296    2571 flags.go:64] FLAG: --logging-format="text"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594299    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594302    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594306    2571 flags.go:64] FLAG: --manifest-url=""
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594309    2571 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594315    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594318    2571 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594323    2571 flags.go:64] FLAG: --max-pods="110"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594326    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594329    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594332    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594335    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594338    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594341    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 11:37:16.601443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594344    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594352    2571 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594355    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594358    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594361    2571 flags.go:64] FLAG: --pod-cidr=""
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594364    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594369    2571 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594372    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594375    2571 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594378    2571 flags.go:64] FLAG: --port="10250"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594381    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594384    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07cf7128d43ccecef"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594387    2571 flags.go:64] FLAG: --qos-reserved=""
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594391    2571 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594394    2571 flags.go:64] FLAG: --register-node="true"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594397    2571 flags.go:64] FLAG: --register-with-taints=""
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594405    2571 flags.go:64] FLAG: --registry-burst="10"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594408    2571 flags.go:64] FLAG: --registry-qps="5"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594411    2571 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594413    2571 flags.go:64] FLAG: --reserved-memory=""
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594417    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594420    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594423    2571 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594427    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594430    2571 flags.go:64] FLAG: --runonce="false"
Sep 15 11:37:16.602061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594433    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594436    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594439    2571 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594442    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594445    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594448    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594451    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594454    2571 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594457    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594460    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594463    2571 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594466    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594469    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594472    2571 flags.go:64] FLAG: --system-cgroups=""
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594474    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594480    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594482    2571 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594485    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594489    2571 flags.go:64] FLAG: --tls-min-version=""
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594492    2571 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594495    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594501    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594504    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594507    2571 flags.go:64] FLAG: --v="2"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594511    2571 flags.go:64] FLAG: --version="false"
Sep 15 11:37:16.602688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594515    2571 flags.go:64] FLAG: --vmodule=""
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594518    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594521    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594639    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594643    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594647    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594650    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594653    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594655    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594658    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594661    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594663    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594666    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594669    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594671    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594674    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594677    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594680    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594683    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:37:16.603315 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594685    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594688    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594692    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594696    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594699    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594702    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594705    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594708    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594711    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594715    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594719    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594731    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594734    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594737    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594740    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594742    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594745    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594748    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594751    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:37:16.603820 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594754    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594756    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594759    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594762    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594765    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594767    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594770    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594773    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594775    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594778    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594781    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594784    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594786    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594789    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594792    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594794    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594797    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594799    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594803    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594806    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:37:16.604295 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594809    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594812    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594816    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594819    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594822    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594825    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594828    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594831    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594834    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594837    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594840    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594843    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594845    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594848    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594850    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594853    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594855    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594858    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594861    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594863    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:37:16.604803 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594866    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594869    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594871    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594874    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594876    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594879    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594881    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594884    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594886    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594889    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594891    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594894    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594896    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594899    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594903    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594907    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594910    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594914    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594916    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:37:16.605329 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594919    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594922    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594925    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594928    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.594930    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.594936    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.602334    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.602350    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.603059    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.603070    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603148    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603154    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603158    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603161    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:37:16.605800 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603165    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603168    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603171    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603174    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603177    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603180    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603182    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603185    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603187    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603190    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603193    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603196    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603199    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603202    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603205    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603207    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603216    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603219    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603221    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603224    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:37:16.606166 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603227    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603230    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603232    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603235    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603237    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603255    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603259    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603262    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603265    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603267    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603270    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603273    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603276    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603279    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603281    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603284    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603287    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603289    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603292    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603294    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:37:16.606681 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603297    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603299    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603302    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603304    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603307    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603310    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603312    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603315    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603318    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603329    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603332    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603335    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603337    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603340    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603343    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603345    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603348    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603351    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603354    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:37:16.607164 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603357    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603360    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603368    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603371    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603374    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603376    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603379    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603381    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603384    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603387    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603389    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603395    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603398    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603401    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603404    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603408    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603411    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603414    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603416    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603419    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:37:16.607685 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603421    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603424    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603426    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603435    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603438    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603440    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603443    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603445    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603448    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603451    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603456    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603460    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603463    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603466    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603469    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:37:16.608160 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603472    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.603477    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603622    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603627    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603630    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603633    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603636    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603639    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603642    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603645    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603647    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603650    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603653    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603655    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603658    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 11:37:16.608553 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603661    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603663    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603667    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603671    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603674    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603678    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603687    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603690    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603693    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603696    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603698    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603701    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603705    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603707    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603710    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603713    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603715    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603718    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 11:37:16.608934 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603720    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603723    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603725    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603728    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603730    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603733    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603735    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603738    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603741    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603743    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603746    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603749    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603751    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603754    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603756    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603759    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603761    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603763    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603766    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603769    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 11:37:16.609390 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603771    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603779    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603782    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603785    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603787    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603790    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603793    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603795    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603798    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603801    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603803    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603806    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603808    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603811    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603813    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603816    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603818    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603820    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603823    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603826    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 11:37:16.609890 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603829    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603831    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603834    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603837    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603839    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603842    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603844    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603847    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603849    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603852    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603854    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603857    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603859    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603863    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603872    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603875    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603877    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603880    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603884    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603887    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 11:37:16.610399 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603889    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603892    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603894    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603897    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603899    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603902    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603905    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:16.603907    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.603912    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.604027    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.606082    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.606940    2571 server.go:1019] "Starting client certificate rotation"
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.607057    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.607107    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 11:37:16.610888 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.609340    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 11:37:16.618229 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.618080    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 11:37:16.626330 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.626300    2571 log.go:25] "Validated CRI v1 runtime API"
Sep 15 11:37:16.629103 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.629082    2571 log.go:25] "Validated CRI v1 image API"
Sep 15 11:37:16.629972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.629955    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 11:37:16.632611 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.632584    2571 fs.go:135] Filesystem UUIDs: map[148e73e3-b1e1-4f30-ad0d-f71bd01f11f1:/dev/nvme0n1p4 6f571f91-80e0-4ae0-aa22-eac9d2b63aaa:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 15 11:37:16.632687 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.632610    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 11:37:16.637937 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.637818    2571 manager.go:216] Machine: {Timestamp:2026-09-15 11:37:16.636482124 +0000 UTC m=+0.307947901 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3113477 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24460097938e1939306d0d47b550e2 SystemUUID:ec244600-9793-8e19-3930-6d0d47b550e2 BootID:0ba241d9-f1b5-4701-bf04-b001fd223a61 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d8:35:b0:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d8:35:b0:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:45:54:2b:f6:07 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 11:37:16.637937 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.637934    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 11:37:16.638063 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.638051    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 11:37:16.638429 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.638409    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 11:37:16.640609 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.640580    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 11:37:16.640764 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.640615    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 11:37:16.641404 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.641392    2571 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 11:37:16.641436 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.641406    2571 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 11:37:16.641436 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.641414    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 11:37:16.641913 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.641903    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 11:37:16.642493 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.642483    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 11:37:16.646638 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.646626    2571 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 11:37:16.646919 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.646909    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 11:37:16.646954 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.646940    2571 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 11:37:16.646954 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.646949    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 11:37:16.647011 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.646967    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 11:37:16.647011 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.646984    2571 kubelet.go:398] "Adding apiserver pod source"
Sep 15 11:37:16.647078 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.647035    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 11:37:16.647469 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.647456    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 11:37:16.647532 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.647474    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 11:37:16.649421 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.649401    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 11:37:16.651487 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.651471    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 11:37:16.651560 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.651509    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 11:37:16.652906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.652878    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 11:37:16.652979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.652915    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 11:37:16.652979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.652924    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 11:37:16.652979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.652937    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 11:37:16.652979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.652952    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 11:37:16.653142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.653015    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 11:37:16.653142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.653046    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 11:37:16.653142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.653058    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 11:37:16.653142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.653067    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 11:37:16.653142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.653077    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 11:37:16.653142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.653103    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 11:37:16.653142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.653117    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 11:37:16.653819 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.653808    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 11:37:16.653876 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.653822    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 11:37:16.657518 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.657503    2571 server.go:1268] "Started kubelet"
Sep 15 11:37:16.657631 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.657579    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 11:37:16.657726 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.657602    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 11:37:16.657726 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.657697    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 11:37:16.660833 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.660800    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 11:37:16.661129 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.661105    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-110.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 11:37:16.661233 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.661178    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 11:37:16.661398 ip-10-0-141-110 systemd[1]: Started Kubernetes Kubelet.
Sep 15 11:37:16.662014 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.661990    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 11:37:16.663735 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.663717    2571 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 11:37:16.664966 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.664947    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 11:37:16.665510 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.665491    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b7t7x"
Sep 15 11:37:16.668122 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.667155    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-110.ec2.internal.18d57b84a9647349  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-110.ec2.internal,UID:ip-10-0-141-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-110.ec2.internal,},FirstTimestamp:2026-09-15 11:37:16.657472329 +0000 UTC m=+0.328938107,LastTimestamp:2026-09-15 11:37:16.657472329 +0000 UTC m=+0.328938107,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-110.ec2.internal,}"
Sep 15 11:37:16.668441 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.668428    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 11:37:16.668499 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.668447    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 11:37:16.668552 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.668538    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found"
Sep 15 11:37:16.669144 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.669126    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 11:37:16.669234 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.669128    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 11:37:16.669234 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.669204    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 11:37:16.669440 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.669418    2571 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 11:37:16.669440 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.669434    2571 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 11:37:16.669687 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.669663    2571 factory.go:55] Registering systemd factory
Sep 15 11:37:16.669687 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.669681    2571 factory.go:223] Registration of the systemd container factory successfully
Sep 15 11:37:16.669936 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.669924    2571 factory.go:153] Registering CRI-O factory
Sep 15 11:37:16.669936 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.669936    2571 factory.go:223] Registration of the crio container factory successfully
Sep 15 11:37:16.670033 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.669977    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 11:37:16.670033 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.669994    2571 factory.go:103] Registering Raw factory
Sep 15 11:37:16.670033 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.670004    2571 manager.go:1196] Started watching for new ooms in manager
Sep 15 11:37:16.670428 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.670416    2571 manager.go:349] Starting recovery of all containers
Sep 15 11:37:16.671408 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.671382    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b7t7x"
Sep 15 11:37:16.675128 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.675096    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 11:37:16.675261 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.675176    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 11:37:16.680702 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.680453    2571 manager.go:354] Recovery completed
Sep 15 11:37:16.685418 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.685405    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:16.687190 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.687175    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:16.687299 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.687203    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:16.687299 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.687214    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:16.687848 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.687831    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 11:37:16.687930 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.687848    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 11:37:16.687930 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.687855    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:16.687930 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.687869    2571 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 11:37:16.688727 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.688710    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:16.688832 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.688744    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:16.688832 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.688756    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:16.689794 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.689772    2571 policy_none.go:49] "None policy: Start"
Sep 15 11:37:16.689869 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.689802    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 11:37:16.689869 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.689818    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 11:37:16.691680 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.691666    2571 policy_none.go:47] "Start"
Sep 15 11:37:16.717833 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.717816    2571 manager.go:337] "Starting Device Plugin manager"
Sep 15 11:37:16.741645 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.717859    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 11:37:16.741645 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.717869    2571 server.go:87] "Starting device plugin registration server"
Sep 15 11:37:16.741645 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.718235    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 11:37:16.741645 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.718263    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 11:37:16.741645 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.718454    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 11:37:16.741645 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.718560    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 11:37:16.741645 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.718571    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 11:37:16.741645 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.718970    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 11:37:16.741645 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.719011    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-110.ec2.internal\" not found"
Sep 15 11:37:16.785854 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.785821    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 11:37:16.787059 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.787036    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 11:37:16.787162 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.787090    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 11:37:16.787162 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.787118    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 11:37:16.787265 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.787164    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 11:37:16.789694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.789672    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:37:16.818579 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.818551    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:16.819581 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.819565    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:16.819658 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.819596    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:16.819658 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.819606    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:16.819658 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.819629    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-110.ec2.internal"
Sep 15 11:37:16.827897 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.827882    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-110.ec2.internal"
Sep 15 11:37:16.827946 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.827904    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-110.ec2.internal\": node \"ip-10-0-141-110.ec2.internal\" not found"
Sep 15 11:37:16.853235 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.853148    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found"
Sep 15 11:37:16.888236 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.888201    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal"]
Sep 15 11:37:16.888412 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.888312    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:16.890717 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.890701    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:16.890814 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.890735    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:16.890814 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.890749    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:16.892864 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.892848    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:16.892966 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.892939    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:16.893025 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.892971    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:16.893673 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.893656    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:16.893751 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.893682    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:16.893751 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.893692    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:16.893751 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.893727    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:16.893751 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.893745    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:16.893886 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.893754    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:16.895844 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.895827    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:16.895909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.895861    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 11:37:16.896722 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.896706    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 11:37:16.896812 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.896735    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 11:37:16.896812 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.896745    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeHasSufficientPID"
Sep 15 11:37:16.920063 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.920040    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-110.ec2.internal\" not found" node="ip-10-0-141-110.ec2.internal"
Sep 15 11:37:16.924691 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.924673    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-110.ec2.internal\" not found" node="ip-10-0-141-110.ec2.internal"
Sep 15 11:37:16.953303 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:16.953262    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found"
Sep 15 11:37:16.970595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.970565    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a77f882da81efbb546d90096b4f4a6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal\" (UID: \"5a77f882da81efbb546d90096b4f4a6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:16.970721 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.970602    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a77f882da81efbb546d90096b4f4a6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal\" (UID: \"5a77f882da81efbb546d90096b4f4a6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:16.970721 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:16.970629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e352b0800062f7f3412fe21ece1ede3-config\") pod \"kube-apiserver-proxy-ip-10-0-141-110.ec2.internal\" (UID: \"4e352b0800062f7f3412fe21ece1ede3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:17.053723 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:17.053690    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found"
Sep 15 11:37:17.071090 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:17.071064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a77f882da81efbb546d90096b4f4a6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal\" (UID: \"5a77f882da81efbb546d90096b4f4a6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:17.071090 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:17.071092    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a77f882da81efbb546d90096b4f4a6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal\" (UID: \"5a77f882da81efbb546d90096b4f4a6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:17.071221 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:17.071110    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e352b0800062f7f3412fe21ece1ede3-config\") pod \"kube-apiserver-proxy-ip-10-0-141-110.ec2.internal\" (UID: \"4e352b0800062f7f3412fe21ece1ede3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:17.071221 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:17.071165    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e352b0800062f7f3412fe21ece1ede3-config\") pod \"kube-apiserver-proxy-ip-10-0-141-110.ec2.internal\" (UID: \"4e352b0800062f7f3412fe21ece1ede3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:17.071221 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:17.071165    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a77f882da81efbb546d90096b4f4a6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal\" (UID: \"5a77f882da81efbb546d90096b4f4a6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:17.071221 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:17.071193    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a77f882da81efbb546d90096b4f4a6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal\" (UID: \"5a77f882da81efbb546d90096b4f4a6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:17.154572 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:17.154504    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found"
Sep 15 11:37:18.642948 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:18.642910    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:18.647826 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:18.647547    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:18.675072 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:18.675044    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found"
Sep 15 11:37:18.775563 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:18.775511    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found"
Sep 15 11:37:18.876183 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:18.876088    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found"
Sep 15 11:37:18.961349 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:18.961316    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:37:18.976610 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:18.976569    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-110.ec2.internal\" not found"
Sep 15 11:37:18.992733 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:18.992707    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:37:19.026811 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.026778    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 11:37:19.027291 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.026920    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 11:37:19.027291 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.026923    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 11:37:19.027291 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.026921    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 11:37:19.068134 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.068109    2571 apiserver.go:52] "Watching apiserver"
Sep 15 11:37:19.088899 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.088858    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:19.088899 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.088884    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 11:37:19.088899 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.088899    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 11:37:19.089847 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.089823    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-kgp8h","openshift-multus/multus-additional-cni-plugins-xpffd","openshift-multus/multus-x4p8m","openshift-multus/network-metrics-daemon-959p9","openshift-network-diagnostics/network-check-target-dd9x4","openshift-network-operator/iptables-alerter-nb2sr","openshift-ovn-kubernetes/ovnkube-node-4n9x6","kube-system/global-pull-secret-syncer-25rqj","kube-system/konnectivity-agent-h4mkd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98","openshift-cluster-node-tuning-operator/tuned-7z6ww","openshift-dns/node-resolver-vmg9v"]
Sep 15 11:37:19.092334 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.092314    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kgp8h"
Sep 15 11:37:19.094517 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.094494    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.095409 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.095198    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 11:32:18 +0000 UTC" deadline="2028-05-15 01:18:55.639915491 +0000 UTC"
Sep 15 11:37:19.095409 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.095248    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14581h41m36.544671494s"
Sep 15 11:37:19.095409 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.095308    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 11:37:19.095551 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.095421    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 11:37:19.095714 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.095701    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 11:37:19.097407 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.096131    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-582qp\""
Sep 15 11:37:19.097407 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.097044    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.097556 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.097431    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-trg4l\""
Sep 15 11:37:19.097924 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.097900    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 11:37:19.098031 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.097903    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 11:37:19.098194 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.098174    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 11:37:19.098426 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.098371    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 11:37:19.098426 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.098415    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 11:37:19.099200 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.099176    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:19.099298 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.099240    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 11:37:19.099298 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.099265    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:19.099298 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.099289    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sqfw4\""
Sep 15 11:37:19.100181 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.100149    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 11:37:19.100260 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.100228    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal"
Sep 15 11:37:19.101599 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.101581    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:19.101683 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.101662    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:19.102639 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.102485    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 11:37:19.103788 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.103771    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nb2sr"
Sep 15 11:37:19.106105 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.106086    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.106211 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.106139    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 11:37:19.106211 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.106204    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 11:37:19.106323 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.106260    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tjsrz\""
Sep 15 11:37:19.106556 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.106423    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:37:19.108305 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.108287    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:19.108400 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.108344    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:19.108484 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.108467    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 11:37:19.109689 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.109668    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 11:37:19.109760 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.109718    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 11:37:19.109760 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.109732    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 11:37:19.109850 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.109763    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 11:37:19.109850 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.109797    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 11:37:19.109850 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.109806    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6vm9r\""
Sep 15 11:37:19.109991 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.109969    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 11:37:19.110970 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.110950    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h4mkd"
Sep 15 11:37:19.113359 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.113340    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 11:37:19.113433 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.113374    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.113433 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.113387    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 11:37:19.113433 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.113407    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2dlgm\""
Sep 15 11:37:19.115753 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.115737    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.116064 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.116044    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 11:37:19.116171 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.116050    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 11:37:19.116171 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.116083    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 11:37:19.116171 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.116130    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cwj6n\""
Sep 15 11:37:19.118313 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.118238    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal"]
Sep 15 11:37:19.118313 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.118271    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal"]
Sep 15 11:37:19.118459 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.118367    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vmg9v"
Sep 15 11:37:19.118459 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.118396    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 11:37:19.119640 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.119614    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:37:19.119812 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.119796    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nmnlp\""
Sep 15 11:37:19.120957 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.120942    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 11:37:19.121214 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.121200    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 11:37:19.121423 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.121410    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p9zkp\""
Sep 15 11:37:19.125212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.123320    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xp5bp"
Sep 15 11:37:19.131452 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.131431    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xp5bp"
Sep 15 11:37:19.189257 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:19.189221    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a77f882da81efbb546d90096b4f4a6e.slice/crio-ad086e769a3f87c9b8de4eb553c52398b018d33078b87581afd4becbb5f7535b WatchSource:0}: Error finding container ad086e769a3f87c9b8de4eb553c52398b018d33078b87581afd4becbb5f7535b: Status 404 returned error can't find the container with id ad086e769a3f87c9b8de4eb553c52398b018d33078b87581afd4becbb5f7535b
Sep 15 11:37:19.190380 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.190318    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 11:37:19.194115 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194098    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:37:19.194567 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194542    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-run-k8s-cni-cncf-io\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.194650 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194589    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phwgw\" (UniqueName: \"kubernetes.io/projected/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-kube-api-access-phwgw\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.194650 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194615    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx6fx\" (UniqueName: \"kubernetes.io/projected/52c718e0-4bf0-406b-9c49-1a5e120fcd43-kube-api-access-rx6fx\") pod \"network-metrics-daemon-959p9\" (UID: \"52c718e0-4bf0-406b-9c49-1a5e120fcd43\") " pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:19.194650 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194639    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-cni-bin\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.194802 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b257fc07-966b-43b6-a6fd-e4f922c9e907-system-cni-dir\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.194802 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194728    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-var-lib-cni-multus\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.194802 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194751    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-systemd-units\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.194802 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194777    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-slash\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.194928 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194856    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.194928 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194901    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b257fc07-966b-43b6-a6fd-e4f922c9e907-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.195019 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194927    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-tuned\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.195019 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194952    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-multus-socket-dir-parent\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.195019 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.194986    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-multus-conf-dir\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.195019 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195013    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-967dm\" (UniqueName: \"kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm\") pod \"network-check-target-dd9x4\" (UID: \"fa09d17e-2f73-4047-9d04-031bec2e9927\") " pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:19.195231 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195036    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-run-openvswitch\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.195231 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195056    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e7423e8a-7332-4124-82ce-92db8066e036-dbus\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:19.195231 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195075    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:19.195231 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195098    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b257fc07-966b-43b6-a6fd-e4f922c9e907-cni-binary-copy\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.195231 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195122    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-lib-modules\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.195231 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195149    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a60ed99b-1058-4652-9589-0e97c1bc629c-tmp\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.195231 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195191    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-run-systemd\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.195231 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195212    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-sys-fs\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195235    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b257fc07-966b-43b6-a6fd-e4f922c9e907-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195261    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl6wz\" (UniqueName: \"kubernetes.io/projected/529da763-ba66-4010-a0af-b13d2de0ce25-kube-api-access-gl6wz\") pod \"iptables-alerter-nb2sr\" (UID: \"529da763-ba66-4010-a0af-b13d2de0ce25\") " pod="openshift-network-operator/iptables-alerter-nb2sr"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195282    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-system-cni-dir\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195302    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-run-netns\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195324    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-etc-kubernetes\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195349    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195372    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl79t\" (UniqueName: \"kubernetes.io/projected/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-kube-api-access-xl79t\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195394    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b257fc07-966b-43b6-a6fd-e4f922c9e907-cnibin\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195424    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-run\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195444    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-node-log\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195463    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-ovnkube-script-lib\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195492    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-socket-dir\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195508    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-device-dir\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195520    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-sys\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.195552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195533    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-var-lib-cni-bin\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195559    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-ovnkube-config\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195627    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-ovn-node-metrics-cert\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195667    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmxzd\" (UniqueName: \"kubernetes.io/projected/b257fc07-966b-43b6-a6fd-e4f922c9e907-kube-api-access-cmxzd\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195683    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-sysctl-conf\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195701    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c1c09d2-5782-4c07-b6da-d8211ecc6bf4-hosts-file\") pod \"node-resolver-vmg9v\" (UID: \"0c1c09d2-5782-4c07-b6da-d8211ecc6bf4\") " pod="openshift-dns/node-resolver-vmg9v"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195724    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/719ac105-ddf6-4f1a-937c-d86ec063d9ec-serviceca\") pod \"node-ca-kgp8h\" (UID: \"719ac105-ddf6-4f1a-937c-d86ec063d9ec\") " pod="openshift-image-registry/node-ca-kgp8h"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195740    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-var-lib-kubelet\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195776    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/529da763-ba66-4010-a0af-b13d2de0ce25-iptables-alerter-script\") pod \"iptables-alerter-nb2sr\" (UID: \"529da763-ba66-4010-a0af-b13d2de0ce25\") " pod="openshift-network-operator/iptables-alerter-nb2sr"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195796    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e9ba56b-3290-489b-980d-e8706e503dd6-agent-certs\") pod \"konnectivity-agent-h4mkd\" (UID: \"7e9ba56b-3290-489b-980d-e8706e503dd6\") " pod="kube-system/konnectivity-agent-h4mkd"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195809    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c1c09d2-5782-4c07-b6da-d8211ecc6bf4-tmp-dir\") pod \"node-resolver-vmg9v\" (UID: \"0c1c09d2-5782-4c07-b6da-d8211ecc6bf4\") " pod="openshift-dns/node-resolver-vmg9v"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195823    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g8xf\" (UniqueName: \"kubernetes.io/projected/719ac105-ddf6-4f1a-937c-d86ec063d9ec-kube-api-access-7g8xf\") pod \"node-ca-kgp8h\" (UID: \"719ac105-ddf6-4f1a-937c-d86ec063d9ec\") " pod="openshift-image-registry/node-ca-kgp8h"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195840    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e7423e8a-7332-4124-82ce-92db8066e036-kubelet-config\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195868    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6d6h\" (UniqueName: \"kubernetes.io/projected/a5c53150-e123-4167-91d4-b3dee53e864b-kube-api-access-t6d6h\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195887    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-modprobe-d\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195900    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-kubernetes\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.196258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195919    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-sysctl-d\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195941    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-cni-binary-copy\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195960    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-var-lib-openvswitch\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.195978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-etc-openvswitch\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196002    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-cni-netd\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196023    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-registration-dir\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196041    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hfdf\" (UniqueName: \"kubernetes.io/projected/0c1c09d2-5782-4c07-b6da-d8211ecc6bf4-kube-api-access-8hfdf\") pod \"node-resolver-vmg9v\" (UID: \"0c1c09d2-5782-4c07-b6da-d8211ecc6bf4\") " pod="openshift-dns/node-resolver-vmg9v"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196055    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/719ac105-ddf6-4f1a-937c-d86ec063d9ec-host\") pod \"node-ca-kgp8h\" (UID: \"719ac105-ddf6-4f1a-937c-d86ec063d9ec\") " pod="openshift-image-registry/node-ca-kgp8h"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196070    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-run-ovn\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196088    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/529da763-ba66-4010-a0af-b13d2de0ce25-host-slash\") pod \"iptables-alerter-nb2sr\" (UID: \"529da763-ba66-4010-a0af-b13d2de0ce25\") " pod="openshift-network-operator/iptables-alerter-nb2sr"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196106    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e9ba56b-3290-489b-980d-e8706e503dd6-konnectivity-ca\") pod \"konnectivity-agent-h4mkd\" (UID: \"7e9ba56b-3290-489b-980d-e8706e503dd6\") " pod="kube-system/konnectivity-agent-h4mkd"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196121    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-sysconfig\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196134    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-systemd\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196164    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-var-lib-kubelet\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196191    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-host\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196211    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-multus-daemon-config\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196227    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-run-multus-certs\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.196979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196262    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-kubelet\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.197595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196275    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-run-netns\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.197595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196289    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.197595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196324    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.197595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196351    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b257fc07-966b-43b6-a6fd-e4f922c9e907-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.197595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-hostroot\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.197595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196400    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d7xz\" (UniqueName: \"kubernetes.io/projected/a60ed99b-1058-4652-9589-0e97c1bc629c-kube-api-access-4d7xz\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.197595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196417    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-log-socket\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.197595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196439    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-multus-cni-dir\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.197595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196466    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-cnibin\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.197595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196490    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs\") pod \"network-metrics-daemon-959p9\" (UID: \"52c718e0-4bf0-406b-9c49-1a5e120fcd43\") " pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:19.197595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.196510    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-env-overrides\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.201557 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:19.201536    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e352b0800062f7f3412fe21ece1ede3.slice/crio-f0d7030e509259d09ce45f9513cb1c3bb126be9e38b4f2f632c63800116d5b66 WatchSource:0}: Error finding container f0d7030e509259d09ce45f9513cb1c3bb126be9e38b4f2f632c63800116d5b66: Status 404 returned error can't find the container with id f0d7030e509259d09ce45f9513cb1c3bb126be9e38b4f2f632c63800116d5b66
Sep 15 11:37:19.210812 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.210743    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal" event={"ID":"4e352b0800062f7f3412fe21ece1ede3","Type":"ContainerStarted","Data":"f0d7030e509259d09ce45f9513cb1c3bb126be9e38b4f2f632c63800116d5b66"}
Sep 15 11:37:19.212062 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.212040    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" event={"ID":"5a77f882da81efbb546d90096b4f4a6e","Type":"ContainerStarted","Data":"ad086e769a3f87c9b8de4eb553c52398b018d33078b87581afd4becbb5f7535b"}
Sep 15 11:37:19.296984 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.296949    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.296984 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.296984    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b257fc07-966b-43b6-a6fd-e4f922c9e907-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.297255 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297002    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-tuned\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.297255 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297020    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-multus-socket-dir-parent\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.297255 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297035    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-multus-conf-dir\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.297255 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297051    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967dm\" (UniqueName: \"kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm\") pod \"network-check-target-dd9x4\" (UID: \"fa09d17e-2f73-4047-9d04-031bec2e9927\") " pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:19.297255 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297073    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-run-openvswitch\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.297255 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297095    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e7423e8a-7332-4124-82ce-92db8066e036-dbus\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:19.297255 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297116    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:19.297255 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297120    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.297255 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297128    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-multus-conf-dir\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.297255 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297137    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b257fc07-966b-43b6-a6fd-e4f922c9e907-cni-binary-copy\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.297255 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297195    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-lib-modules\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.297255 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297210    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-multus-socket-dir-parent\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.297255 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297221    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a60ed99b-1058-4652-9589-0e97c1bc629c-tmp\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297290    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-run-systemd\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297314    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-sys-fs\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297368    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-sys-fs\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297375    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e7423e8a-7332-4124-82ce-92db8066e036-dbus\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297395    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-run-openvswitch\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297405    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-lib-modules\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297415    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b257fc07-966b-43b6-a6fd-e4f922c9e907-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.297443    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297449    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl6wz\" (UniqueName: \"kubernetes.io/projected/529da763-ba66-4010-a0af-b13d2de0ce25-kube-api-access-gl6wz\") pod \"iptables-alerter-nb2sr\" (UID: \"529da763-ba66-4010-a0af-b13d2de0ce25\") " pod="openshift-network-operator/iptables-alerter-nb2sr"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297468    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-system-cni-dir\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297487    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-run-netns\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297527    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-run-netns\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.297534    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret podName:e7423e8a-7332-4124-82ce-92db8066e036 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:19.797492654 +0000 UTC m=+2.049049700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret") pod "global-pull-secret-syncer-25rqj" (UID: "e7423e8a-7332-4124-82ce-92db8066e036") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297549    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-run-systemd\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297565    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-etc-kubernetes\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297564    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-system-cni-dir\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.297868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297594    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297628    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-etc-kubernetes\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297635    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297655    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl79t\" (UniqueName: \"kubernetes.io/projected/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-kube-api-access-xl79t\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297674    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b257fc07-966b-43b6-a6fd-e4f922c9e907-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297688    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b257fc07-966b-43b6-a6fd-e4f922c9e907-cnibin\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297689    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-run\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297742    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-node-log\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297751    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b257fc07-966b-43b6-a6fd-e4f922c9e907-cnibin\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297780    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-ovnkube-script-lib\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297787    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-node-log\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297744    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-run\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297810    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-socket-dir\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-device-dir\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297884    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-sys\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297903    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-var-lib-cni-bin\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297906    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-socket-dir\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.298694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297925    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-ovnkube-config\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297949    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-ovn-node-metrics-cert\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297956    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-device-dir\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297964    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-var-lib-cni-bin\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.297973    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmxzd\" (UniqueName: \"kubernetes.io/projected/b257fc07-966b-43b6-a6fd-e4f922c9e907-kube-api-access-cmxzd\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298001    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-sysctl-conf\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298014    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-sys\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298023    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c1c09d2-5782-4c07-b6da-d8211ecc6bf4-hosts-file\") pod \"node-resolver-vmg9v\" (UID: \"0c1c09d2-5782-4c07-b6da-d8211ecc6bf4\") " pod="openshift-dns/node-resolver-vmg9v"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298045    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/719ac105-ddf6-4f1a-937c-d86ec063d9ec-serviceca\") pod \"node-ca-kgp8h\" (UID: \"719ac105-ddf6-4f1a-937c-d86ec063d9ec\") " pod="openshift-image-registry/node-ca-kgp8h"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298227    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-var-lib-kubelet\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298252    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/529da763-ba66-4010-a0af-b13d2de0ce25-iptables-alerter-script\") pod \"iptables-alerter-nb2sr\" (UID: \"529da763-ba66-4010-a0af-b13d2de0ce25\") " pod="openshift-network-operator/iptables-alerter-nb2sr"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298276    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e9ba56b-3290-489b-980d-e8706e503dd6-agent-certs\") pod \"konnectivity-agent-h4mkd\" (UID: \"7e9ba56b-3290-489b-980d-e8706e503dd6\") " pod="kube-system/konnectivity-agent-h4mkd"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c1c09d2-5782-4c07-b6da-d8211ecc6bf4-tmp-dir\") pod \"node-resolver-vmg9v\" (UID: \"0c1c09d2-5782-4c07-b6da-d8211ecc6bf4\") " pod="openshift-dns/node-resolver-vmg9v"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g8xf\" (UniqueName: \"kubernetes.io/projected/719ac105-ddf6-4f1a-937c-d86ec063d9ec-kube-api-access-7g8xf\") pod \"node-ca-kgp8h\" (UID: \"719ac105-ddf6-4f1a-937c-d86ec063d9ec\") " pod="openshift-image-registry/node-ca-kgp8h"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298375    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-ovnkube-script-lib\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298417    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-var-lib-kubelet\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298440    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e7423e8a-7332-4124-82ce-92db8066e036-kubelet-config\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:19.299538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298381    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e7423e8a-7332-4124-82ce-92db8066e036-kubelet-config\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298474    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-ovnkube-config\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298478    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6d6h\" (UniqueName: \"kubernetes.io/projected/a5c53150-e123-4167-91d4-b3dee53e864b-kube-api-access-t6d6h\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298532    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-modprobe-d\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298558    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-kubernetes\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298582    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-sysctl-d\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298606    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-cni-binary-copy\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298633    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-var-lib-openvswitch\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298655    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-etc-openvswitch\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298681    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-cni-netd\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298700    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c1c09d2-5782-4c07-b6da-d8211ecc6bf4-hosts-file\") pod \"node-resolver-vmg9v\" (UID: \"0c1c09d2-5782-4c07-b6da-d8211ecc6bf4\") " pod="openshift-dns/node-resolver-vmg9v"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298712    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-registration-dir\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c1c09d2-5782-4c07-b6da-d8211ecc6bf4-tmp-dir\") pod \"node-resolver-vmg9v\" (UID: \"0c1c09d2-5782-4c07-b6da-d8211ecc6bf4\") " pod="openshift-dns/node-resolver-vmg9v"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298737    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hfdf\" (UniqueName: \"kubernetes.io/projected/0c1c09d2-5782-4c07-b6da-d8211ecc6bf4-kube-api-access-8hfdf\") pod \"node-resolver-vmg9v\" (UID: \"0c1c09d2-5782-4c07-b6da-d8211ecc6bf4\") " pod="openshift-dns/node-resolver-vmg9v"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298760    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/719ac105-ddf6-4f1a-937c-d86ec063d9ec-host\") pod \"node-ca-kgp8h\" (UID: \"719ac105-ddf6-4f1a-937c-d86ec063d9ec\") " pod="openshift-image-registry/node-ca-kgp8h"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298798    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-run-ovn\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298822    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/529da763-ba66-4010-a0af-b13d2de0ce25-host-slash\") pod \"iptables-alerter-nb2sr\" (UID: \"529da763-ba66-4010-a0af-b13d2de0ce25\") " pod="openshift-network-operator/iptables-alerter-nb2sr"
Sep 15 11:37:19.300363 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298847    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e9ba56b-3290-489b-980d-e8706e503dd6-konnectivity-ca\") pod \"konnectivity-agent-h4mkd\" (UID: \"7e9ba56b-3290-489b-980d-e8706e503dd6\") " pod="kube-system/konnectivity-agent-h4mkd"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298873    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/529da763-ba66-4010-a0af-b13d2de0ce25-iptables-alerter-script\") pod \"iptables-alerter-nb2sr\" (UID: \"529da763-ba66-4010-a0af-b13d2de0ce25\") " pod="openshift-network-operator/iptables-alerter-nb2sr"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298880    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-sysconfig\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298924    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-systemd\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298932    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-cni-netd\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298946    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-var-lib-kubelet\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298968    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-host\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298981    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-sysconfig\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298988    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-multus-daemon-config\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299003    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-sysctl-conf\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298479    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/719ac105-ddf6-4f1a-937c-d86ec063d9ec-serviceca\") pod \"node-ca-kgp8h\" (UID: \"719ac105-ddf6-4f1a-937c-d86ec063d9ec\") " pod="openshift-image-registry/node-ca-kgp8h"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.298925    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-etc-openvswitch\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299059    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-run-multus-certs\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299073    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-host\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299099    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-var-lib-kubelet\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299178    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-modprobe-d\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299215    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-kubernetes\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299262    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/719ac105-ddf6-4f1a-937c-d86ec063d9ec-host\") pod \"node-ca-kgp8h\" (UID: \"719ac105-ddf6-4f1a-937c-d86ec063d9ec\") " pod="openshift-image-registry/node-ca-kgp8h"
Sep 15 11:37:19.301193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299272    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-sysctl-d\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299316    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-run-ovn\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299360    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/529da763-ba66-4010-a0af-b13d2de0ce25-host-slash\") pod \"iptables-alerter-nb2sr\" (UID: \"529da763-ba66-4010-a0af-b13d2de0ce25\") " pod="openshift-network-operator/iptables-alerter-nb2sr"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299550    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-multus-daemon-config\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299610    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-registration-dir\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299009    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-run-multus-certs\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299647    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-kubelet\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299669    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-run-netns\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299695    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299716    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299740    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b257fc07-966b-43b6-a6fd-e4f922c9e907-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299749    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-cni-binary-copy\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299764    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-hostroot\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299798    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d7xz\" (UniqueName: \"kubernetes.io/projected/a60ed99b-1058-4652-9589-0e97c1bc629c-kube-api-access-4d7xz\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299819    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-log-socket\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299807    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-systemd\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299845    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-multus-cni-dir\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299868    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-cnibin\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.301909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299894    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs\") pod \"network-metrics-daemon-959p9\" (UID: \"52c718e0-4bf0-406b-9c49-1a5e120fcd43\") " pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299918    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-env-overrides\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299919    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5c53150-e123-4167-91d4-b3dee53e864b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299952    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-log-socket\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299956    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-var-lib-openvswitch\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299977    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-run-k8s-cni-cncf-io\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300026    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phwgw\" (UniqueName: \"kubernetes.io/projected/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-kube-api-access-phwgw\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300031    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-multus-cni-dir\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300055    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx6fx\" (UniqueName: \"kubernetes.io/projected/52c718e0-4bf0-406b-9c49-1a5e120fcd43-kube-api-access-rx6fx\") pod \"network-metrics-daemon-959p9\" (UID: \"52c718e0-4bf0-406b-9c49-1a5e120fcd43\") " pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300081    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-cni-bin\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300084    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-cnibin\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300095    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b257fc07-966b-43b6-a6fd-e4f922c9e907-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300108    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b257fc07-966b-43b6-a6fd-e4f922c9e907-system-cni-dir\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-var-lib-cni-multus\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300142    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-hostroot\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.300183    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300218    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-systemd-units\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302431 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.300252    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs podName:52c718e0-4bf0-406b-9c49-1a5e120fcd43 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:19.800232859 +0000 UTC m=+2.051789898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs") pod "network-metrics-daemon-959p9" (UID: "52c718e0-4bf0-406b-9c49-1a5e120fcd43") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.299891    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e9ba56b-3290-489b-980d-e8706e503dd6-konnectivity-ca\") pod \"konnectivity-agent-h4mkd\" (UID: \"7e9ba56b-3290-489b-980d-e8706e503dd6\") " pod="kube-system/konnectivity-agent-h4mkd"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300259    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-kubelet\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300292    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-run-netns\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300331    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300382    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-cni-bin\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300454    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-run-k8s-cni-cncf-io\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300494    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b257fc07-966b-43b6-a6fd-e4f922c9e907-system-cni-dir\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300529    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-host-var-lib-cni-multus\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300185    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-systemd-units\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300589    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-slash\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300606    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-env-overrides\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.300651    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-host-slash\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.301031    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b257fc07-966b-43b6-a6fd-e4f922c9e907-cni-binary-copy\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.301384    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b257fc07-966b-43b6-a6fd-e4f922c9e907-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.301799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a60ed99b-1058-4652-9589-0e97c1bc629c-etc-tuned\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.301911    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a60ed99b-1058-4652-9589-0e97c1bc629c-tmp\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.301959    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-ovn-node-metrics-cert\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.302906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.302191    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e9ba56b-3290-489b-980d-e8706e503dd6-agent-certs\") pod \"konnectivity-agent-h4mkd\" (UID: \"7e9ba56b-3290-489b-980d-e8706e503dd6\") " pod="kube-system/konnectivity-agent-h4mkd"
Sep 15 11:37:19.310047 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.310016    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:19.310047 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.310037    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:19.310203 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.310050    2571 projected.go:196] Error preparing data for projected volume kube-api-access-967dm for pod openshift-network-diagnostics/network-check-target-dd9x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:19.310203 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.310113    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm podName:fa09d17e-2f73-4047-9d04-031bec2e9927 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:19.810100484 +0000 UTC m=+2.061657524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-967dm" (UniqueName: "kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm") pod "network-check-target-dd9x4" (UID: "fa09d17e-2f73-4047-9d04-031bec2e9927") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:19.312033 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.312006    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmxzd\" (UniqueName: \"kubernetes.io/projected/b257fc07-966b-43b6-a6fd-e4f922c9e907-kube-api-access-cmxzd\") pod \"multus-additional-cni-plugins-xpffd\" (UID: \"b257fc07-966b-43b6-a6fd-e4f922c9e907\") " pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.312296 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.312273    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl6wz\" (UniqueName: \"kubernetes.io/projected/529da763-ba66-4010-a0af-b13d2de0ce25-kube-api-access-gl6wz\") pod \"iptables-alerter-nb2sr\" (UID: \"529da763-ba66-4010-a0af-b13d2de0ce25\") " pod="openshift-network-operator/iptables-alerter-nb2sr"
Sep 15 11:37:19.312656 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.312636    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6d6h\" (UniqueName: \"kubernetes.io/projected/a5c53150-e123-4167-91d4-b3dee53e864b-kube-api-access-t6d6h\") pod \"aws-ebs-csi-driver-node-7hk98\" (UID: \"a5c53150-e123-4167-91d4-b3dee53e864b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.312925 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.312898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl79t\" (UniqueName: \"kubernetes.io/projected/6f223f9c-27a1-4c1e-9d40-8d6a557d90b7-kube-api-access-xl79t\") pod \"ovnkube-node-4n9x6\" (UID: \"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.313049 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.313033    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g8xf\" (UniqueName: \"kubernetes.io/projected/719ac105-ddf6-4f1a-937c-d86ec063d9ec-kube-api-access-7g8xf\") pod \"node-ca-kgp8h\" (UID: \"719ac105-ddf6-4f1a-937c-d86ec063d9ec\") " pod="openshift-image-registry/node-ca-kgp8h"
Sep 15 11:37:19.313717 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.313688    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hfdf\" (UniqueName: \"kubernetes.io/projected/0c1c09d2-5782-4c07-b6da-d8211ecc6bf4-kube-api-access-8hfdf\") pod \"node-resolver-vmg9v\" (UID: \"0c1c09d2-5782-4c07-b6da-d8211ecc6bf4\") " pod="openshift-dns/node-resolver-vmg9v"
Sep 15 11:37:19.314749 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.314728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx6fx\" (UniqueName: \"kubernetes.io/projected/52c718e0-4bf0-406b-9c49-1a5e120fcd43-kube-api-access-rx6fx\") pod \"network-metrics-daemon-959p9\" (UID: \"52c718e0-4bf0-406b-9c49-1a5e120fcd43\") " pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:19.314930 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.314914    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d7xz\" (UniqueName: \"kubernetes.io/projected/a60ed99b-1058-4652-9589-0e97c1bc629c-kube-api-access-4d7xz\") pod \"tuned-7z6ww\" (UID: \"a60ed99b-1058-4652-9589-0e97c1bc629c\") " pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.314984 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.314970    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phwgw\" (UniqueName: \"kubernetes.io/projected/2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6-kube-api-access-phwgw\") pod \"multus-x4p8m\" (UID: \"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6\") " pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.424920 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.424832    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kgp8h"
Sep 15 11:37:19.435696 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:19.435671    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719ac105_ddf6_4f1a_937c_d86ec063d9ec.slice/crio-14c2f578441c8a1fe5f867be2cb35cc9499703f24347a77b4f64f5dbe7bfc904 WatchSource:0}: Error finding container 14c2f578441c8a1fe5f867be2cb35cc9499703f24347a77b4f64f5dbe7bfc904: Status 404 returned error can't find the container with id 14c2f578441c8a1fe5f867be2cb35cc9499703f24347a77b4f64f5dbe7bfc904
Sep 15 11:37:19.439188 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.439147    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xpffd"
Sep 15 11:37:19.439615 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.439595    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:37:19.447652 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:19.447631    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb257fc07_966b_43b6_a6fd_e4f922c9e907.slice/crio-343cac4011ed79c1abd000a6625925bf91a041bb1ea98607f3af9266c7d6ff2d WatchSource:0}: Error finding container 343cac4011ed79c1abd000a6625925bf91a041bb1ea98607f3af9266c7d6ff2d: Status 404 returned error can't find the container with id 343cac4011ed79c1abd000a6625925bf91a041bb1ea98607f3af9266c7d6ff2d
Sep 15 11:37:19.447727 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.447716    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x4p8m"
Sep 15 11:37:19.452642 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.452628    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nb2sr"
Sep 15 11:37:19.456020 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:19.455985    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb28757_2d9d_47a8_9d7c_8ad2d3802eb6.slice/crio-90afb10a1e9c57673ec644cb511194a23ba1498fab519a4bf5e32e7bc76fd029 WatchSource:0}: Error finding container 90afb10a1e9c57673ec644cb511194a23ba1498fab519a4bf5e32e7bc76fd029: Status 404 returned error can't find the container with id 90afb10a1e9c57673ec644cb511194a23ba1498fab519a4bf5e32e7bc76fd029
Sep 15 11:37:19.460466 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:19.460445    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529da763_ba66_4010_a0af_b13d2de0ce25.slice/crio-f08c75f556a6c3eb605849e8e362bce45d9e090f26fe25062b887d0dba189918 WatchSource:0}: Error finding container f08c75f556a6c3eb605849e8e362bce45d9e090f26fe25062b887d0dba189918: Status 404 returned error can't find the container with id f08c75f556a6c3eb605849e8e362bce45d9e090f26fe25062b887d0dba189918
Sep 15 11:37:19.492623 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.492593    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:19.504116 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:19.504092    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f223f9c_27a1_4c1e_9d40_8d6a557d90b7.slice/crio-2e78b7ffa927abb222cfa95b05f14331a31a8c4130c6f728a52896fd3789dd90 WatchSource:0}: Error finding container 2e78b7ffa927abb222cfa95b05f14331a31a8c4130c6f728a52896fd3789dd90: Status 404 returned error can't find the container with id 2e78b7ffa927abb222cfa95b05f14331a31a8c4130c6f728a52896fd3789dd90
Sep 15 11:37:19.509233 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.509216    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h4mkd"
Sep 15 11:37:19.513960 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.513940    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98"
Sep 15 11:37:19.517078 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:19.517057    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9ba56b_3290_489b_980d_e8706e503dd6.slice/crio-1975062e2acdce5b1a8883a13ed9b270925c4a14bbc89888cc41ce0061c6ae39 WatchSource:0}: Error finding container 1975062e2acdce5b1a8883a13ed9b270925c4a14bbc89888cc41ce0061c6ae39: Status 404 returned error can't find the container with id 1975062e2acdce5b1a8883a13ed9b270925c4a14bbc89888cc41ce0061c6ae39
Sep 15 11:37:19.519143 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.519117    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7z6ww"
Sep 15 11:37:19.522233 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:19.522212    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c53150_e123_4167_91d4_b3dee53e864b.slice/crio-1368cfa5f754e8257d6510834cacd7a371c5ed1d95fec4835df19eb378c3fcce WatchSource:0}: Error finding container 1368cfa5f754e8257d6510834cacd7a371c5ed1d95fec4835df19eb378c3fcce: Status 404 returned error can't find the container with id 1368cfa5f754e8257d6510834cacd7a371c5ed1d95fec4835df19eb378c3fcce
Sep 15 11:37:19.524315 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.524295    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vmg9v"
Sep 15 11:37:19.528527 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:37:19.528507    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60ed99b_1058_4652_9589_0e97c1bc629c.slice/crio-3d8c5490c55b6e2a536d18126d8633e45d1143afeb69cbd2e9a873b6cc16e22a WatchSource:0}: Error finding container 3d8c5490c55b6e2a536d18126d8633e45d1143afeb69cbd2e9a873b6cc16e22a: Status 404 returned error can't find the container with id 3d8c5490c55b6e2a536d18126d8633e45d1143afeb69cbd2e9a873b6cc16e22a
Sep 15 11:37:19.804977 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.804940    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs\") pod \"network-metrics-daemon-959p9\" (UID: \"52c718e0-4bf0-406b-9c49-1a5e120fcd43\") " pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:19.805182 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.805015    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:19.805260 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.805180    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:19.805260 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.805242    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret podName:e7423e8a-7332-4124-82ce-92db8066e036 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:20.805222499 +0000 UTC m=+3.056779541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret") pod "global-pull-secret-syncer-25rqj" (UID: "e7423e8a-7332-4124-82ce-92db8066e036") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:19.805652 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.805626    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:19.805704 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.805675    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs podName:52c718e0-4bf0-406b-9c49-1a5e120fcd43 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:20.805660022 +0000 UTC m=+3.057217062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs") pod "network-metrics-daemon-959p9" (UID: "52c718e0-4bf0-406b-9c49-1a5e120fcd43") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:19.905511 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:19.905471    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967dm\" (UniqueName: \"kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm\") pod \"network-check-target-dd9x4\" (UID: \"fa09d17e-2f73-4047-9d04-031bec2e9927\") " pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:19.905715 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.905695    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:19.905784 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.905723    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:19.905784 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.905736    2571 projected.go:196] Error preparing data for projected volume kube-api-access-967dm for pod openshift-network-diagnostics/network-check-target-dd9x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:19.905897 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:19.905796    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm podName:fa09d17e-2f73-4047-9d04-031bec2e9927 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:20.905776831 +0000 UTC m=+3.157333868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-967dm" (UniqueName: "kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm") pod "network-check-target-dd9x4" (UID: "fa09d17e-2f73-4047-9d04-031bec2e9927") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:20.134857 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.134645    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 11:32:19 +0000 UTC" deadline="2028-05-18 05:57:52.966468712 +0000 UTC"
Sep 15 11:37:20.134857 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.134732    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14658h20m32.831744047s"
Sep 15 11:37:20.208595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.207845    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:20.208595 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:20.207969    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:20.228126 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.228088    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vmg9v" event={"ID":"0c1c09d2-5782-4c07-b6da-d8211ecc6bf4","Type":"ContainerStarted","Data":"5cf6959758d078e62e6d623a5d2817cb6f99b6d495131b7adec836da400bdbcd"}
Sep 15 11:37:20.242141 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.242101    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7z6ww" event={"ID":"a60ed99b-1058-4652-9589-0e97c1bc629c","Type":"ContainerStarted","Data":"3d8c5490c55b6e2a536d18126d8633e45d1143afeb69cbd2e9a873b6cc16e22a"}
Sep 15 11:37:20.271004 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.270965    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98" event={"ID":"a5c53150-e123-4167-91d4-b3dee53e864b","Type":"ContainerStarted","Data":"1368cfa5f754e8257d6510834cacd7a371c5ed1d95fec4835df19eb378c3fcce"}
Sep 15 11:37:20.273692 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.273636    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h4mkd" event={"ID":"7e9ba56b-3290-489b-980d-e8706e503dd6","Type":"ContainerStarted","Data":"1975062e2acdce5b1a8883a13ed9b270925c4a14bbc89888cc41ce0061c6ae39"}
Sep 15 11:37:20.285272 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.285238    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6" event={"ID":"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7","Type":"ContainerStarted","Data":"2e78b7ffa927abb222cfa95b05f14331a31a8c4130c6f728a52896fd3789dd90"}
Sep 15 11:37:20.296434 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.296401    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nb2sr" event={"ID":"529da763-ba66-4010-a0af-b13d2de0ce25","Type":"ContainerStarted","Data":"f08c75f556a6c3eb605849e8e362bce45d9e090f26fe25062b887d0dba189918"}
Sep 15 11:37:20.310693 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.309523    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x4p8m" event={"ID":"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6","Type":"ContainerStarted","Data":"90afb10a1e9c57673ec644cb511194a23ba1498fab519a4bf5e32e7bc76fd029"}
Sep 15 11:37:20.323736 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.323698    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpffd" event={"ID":"b257fc07-966b-43b6-a6fd-e4f922c9e907","Type":"ContainerStarted","Data":"343cac4011ed79c1abd000a6625925bf91a041bb1ea98607f3af9266c7d6ff2d"}
Sep 15 11:37:20.327527 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.327493    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kgp8h" event={"ID":"719ac105-ddf6-4f1a-937c-d86ec063d9ec","Type":"ContainerStarted","Data":"14c2f578441c8a1fe5f867be2cb35cc9499703f24347a77b4f64f5dbe7bfc904"}
Sep 15 11:37:20.337001 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.336974    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:37:20.813708 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.812930    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs\") pod \"network-metrics-daemon-959p9\" (UID: \"52c718e0-4bf0-406b-9c49-1a5e120fcd43\") " pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:20.813708 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.813000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:20.813708 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:20.813123    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:20.813708 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:20.813201    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret podName:e7423e8a-7332-4124-82ce-92db8066e036 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:22.813180552 +0000 UTC m=+5.064737588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret") pod "global-pull-secret-syncer-25rqj" (UID: "e7423e8a-7332-4124-82ce-92db8066e036") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:20.813708 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:20.813615    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:20.813708 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:20.813669    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs podName:52c718e0-4bf0-406b-9c49-1a5e120fcd43 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:22.813651306 +0000 UTC m=+5.065208359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs") pod "network-metrics-daemon-959p9" (UID: "52c718e0-4bf0-406b-9c49-1a5e120fcd43") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:20.913856 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:20.913813    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967dm\" (UniqueName: \"kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm\") pod \"network-check-target-dd9x4\" (UID: \"fa09d17e-2f73-4047-9d04-031bec2e9927\") " pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:20.914076 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:20.914049    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:20.914076 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:20.914073    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:20.914243 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:20.914085    2571 projected.go:196] Error preparing data for projected volume kube-api-access-967dm for pod openshift-network-diagnostics/network-check-target-dd9x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:20.914243 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:20.914148    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm podName:fa09d17e-2f73-4047-9d04-031bec2e9927 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:22.91412803 +0000 UTC m=+5.165685067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-967dm" (UniqueName: "kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm") pod "network-check-target-dd9x4" (UID: "fa09d17e-2f73-4047-9d04-031bec2e9927") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:21.136370 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:21.135880    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 11:32:19 +0000 UTC" deadline="2028-02-20 18:38:00.920288554 +0000 UTC"
Sep 15 11:37:21.136370 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:21.135918    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12559h0m39.784374352s"
Sep 15 11:37:21.207835 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:21.207803    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:21.208022 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:21.207930    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:21.208347 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:21.208327    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:21.208470 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:21.208449    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:21.815735 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:21.815701    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:37:21.886598 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:21.886323    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 11:37:22.228258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:22.228230    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:22.228809 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:22.228392    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:22.831350 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:22.831311    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs\") pod \"network-metrics-daemon-959p9\" (UID: \"52c718e0-4bf0-406b-9c49-1a5e120fcd43\") " pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:22.831534 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:22.831369    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:22.831534 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:22.831497    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:22.831660 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:22.831553    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret podName:e7423e8a-7332-4124-82ce-92db8066e036 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:26.831539935 +0000 UTC m=+9.083096970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret") pod "global-pull-secret-syncer-25rqj" (UID: "e7423e8a-7332-4124-82ce-92db8066e036") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:22.832215 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:22.831870    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:22.832215 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:22.831912    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs podName:52c718e0-4bf0-406b-9c49-1a5e120fcd43 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:26.831901221 +0000 UTC m=+9.083458257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs") pod "network-metrics-daemon-959p9" (UID: "52c718e0-4bf0-406b-9c49-1a5e120fcd43") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:22.932611 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:22.932567    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967dm\" (UniqueName: \"kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm\") pod \"network-check-target-dd9x4\" (UID: \"fa09d17e-2f73-4047-9d04-031bec2e9927\") " pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:22.932783 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:22.932746    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:22.932783 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:22.932771    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:22.932783 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:22.932783    2571 projected.go:196] Error preparing data for projected volume kube-api-access-967dm for pod openshift-network-diagnostics/network-check-target-dd9x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:22.932951 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:22.932856    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm podName:fa09d17e-2f73-4047-9d04-031bec2e9927 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:26.932836879 +0000 UTC m=+9.184393930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-967dm" (UniqueName: "kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm") pod "network-check-target-dd9x4" (UID: "fa09d17e-2f73-4047-9d04-031bec2e9927") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:23.207561 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:23.207527    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:23.207758 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:23.207654    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:23.207758 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:23.207716    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:23.207873 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:23.207827    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:24.210655 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:24.210179    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:24.210655 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:24.210308    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:25.207824 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:25.207783    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:25.208017 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:25.207925    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:25.208017 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:25.207945    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:25.208131 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:25.208029    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:26.211370 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:26.211342    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:26.211832 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:26.211454    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:26.868483 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:26.868446    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs\") pod \"network-metrics-daemon-959p9\" (UID: \"52c718e0-4bf0-406b-9c49-1a5e120fcd43\") " pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:26.868652 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:26.868512    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:26.868652 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:26.868619    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:26.868652 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:26.868621    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:26.868824 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:26.868687    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret podName:e7423e8a-7332-4124-82ce-92db8066e036 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:34.86866918 +0000 UTC m=+17.120226233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret") pod "global-pull-secret-syncer-25rqj" (UID: "e7423e8a-7332-4124-82ce-92db8066e036") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:26.868824 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:26.868705    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs podName:52c718e0-4bf0-406b-9c49-1a5e120fcd43 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:34.868697323 +0000 UTC m=+17.120254363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs") pod "network-metrics-daemon-959p9" (UID: "52c718e0-4bf0-406b-9c49-1a5e120fcd43") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:26.969288 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:26.969245    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967dm\" (UniqueName: \"kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm\") pod \"network-check-target-dd9x4\" (UID: \"fa09d17e-2f73-4047-9d04-031bec2e9927\") " pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:26.969497 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:26.969462    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:26.969497 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:26.969495    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:26.969646 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:26.969510    2571 projected.go:196] Error preparing data for projected volume kube-api-access-967dm for pod openshift-network-diagnostics/network-check-target-dd9x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:26.969646 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:26.969579    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm podName:fa09d17e-2f73-4047-9d04-031bec2e9927 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:34.969559344 +0000 UTC m=+17.221116383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-967dm" (UniqueName: "kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm") pod "network-check-target-dd9x4" (UID: "fa09d17e-2f73-4047-9d04-031bec2e9927") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:27.207368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:27.207333    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:27.207546 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:27.207456    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:27.207840 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:27.207820    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:27.207945 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:27.207930    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:28.209185 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:28.209137    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:28.209662 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:28.209286    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:29.207966 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:29.207924    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:29.208175 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:29.207933    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:29.208175 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:29.208047    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:29.208175 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:29.208148    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:30.208023 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:30.207984    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:30.208442 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:30.208109    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:31.207626 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:31.207587    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:31.207832 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:31.207587    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:31.207832 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:31.207735    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:31.207832 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:31.207804    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:32.207274 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:32.207234    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:32.207833 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:32.207384    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:33.207823 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:33.207782    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:33.208300 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:33.207831    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:33.208300 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:33.207923    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:33.208300 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:33.208058    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:34.207371 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:34.207284    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:34.207527 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:34.207410    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:34.928541 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:34.928502    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs\") pod \"network-metrics-daemon-959p9\" (UID: \"52c718e0-4bf0-406b-9c49-1a5e120fcd43\") " pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:34.928988 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:34.928565    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:34.928988 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:34.928673    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:34.928988 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:34.928707    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:34.928988 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:34.928746    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret podName:e7423e8a-7332-4124-82ce-92db8066e036 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:50.928729775 +0000 UTC m=+33.180286810 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret") pod "global-pull-secret-syncer-25rqj" (UID: "e7423e8a-7332-4124-82ce-92db8066e036") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:34.928988 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:34.928763    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs podName:52c718e0-4bf0-406b-9c49-1a5e120fcd43 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:50.928754707 +0000 UTC m=+33.180311745 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs") pod "network-metrics-daemon-959p9" (UID: "52c718e0-4bf0-406b-9c49-1a5e120fcd43") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:35.029553 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:35.029509    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967dm\" (UniqueName: \"kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm\") pod \"network-check-target-dd9x4\" (UID: \"fa09d17e-2f73-4047-9d04-031bec2e9927\") " pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:35.029725 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:35.029670    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:35.029725 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:35.029694    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:35.029725 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:35.029708    2571 projected.go:196] Error preparing data for projected volume kube-api-access-967dm for pod openshift-network-diagnostics/network-check-target-dd9x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:35.029851 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:35.029770    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm podName:fa09d17e-2f73-4047-9d04-031bec2e9927 nodeName:}" failed. No retries permitted until 2026-09-15 11:37:51.029750013 +0000 UTC m=+33.281307056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-967dm" (UniqueName: "kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm") pod "network-check-target-dd9x4" (UID: "fa09d17e-2f73-4047-9d04-031bec2e9927") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:35.208020 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:35.207985    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:35.208224 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:35.208112    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:35.208224 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:35.208176    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:35.208348 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:35.208311    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:36.207971 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:36.207934    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:36.208499 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:36.208057    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:37.207944 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:37.207903    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:37.208139 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:37.207952    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:37.208139 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:37.208028    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:37.208557 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:37.208175    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:38.212979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:38.212685    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:38.213272 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:38.212989    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:38.378557 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:38.378498    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal" event={"ID":"4e352b0800062f7f3412fe21ece1ede3","Type":"ContainerStarted","Data":"4dbc446ccd46e9a56a5f21e39f4390af64816af25a8befb4781298219f534f0a"}
Sep 15 11:37:38.380316 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:38.380287    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7z6ww" event={"ID":"a60ed99b-1058-4652-9589-0e97c1bc629c","Type":"ContainerStarted","Data":"3232c18bdae18951cb33364086b0adb88313d5ea77d6aa4aa63f911b1cf4c1bd"}
Sep 15 11:37:38.382623 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:38.382597    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6" event={"ID":"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7","Type":"ContainerStarted","Data":"d9d95857295e12c0f1c19d8cbda96b8365de93eb37132cc5a95e87b3d39e4439"}
Sep 15 11:37:38.392418 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:38.392370    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-110.ec2.internal" podStartSLOduration=19.39235294 podStartE2EDuration="19.39235294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:38.392057848 +0000 UTC m=+20.643614906" watchObservedRunningTime="2026-09-15 11:37:38.39235294 +0000 UTC m=+20.643909997"
Sep 15 11:37:38.409008 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:38.408899    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7z6ww" podStartSLOduration=1.9286185 podStartE2EDuration="20.408885626s" totalImagesPullingTime="18.480267126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:38.408739504 +0000 UTC m=+20.660296562" watchObservedRunningTime="2026-09-15 11:37:38.408885626 +0000 UTC m=+20.660442728"
Sep 15 11:37:39.207748 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.207563    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:39.207910 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.207622    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:39.207910 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:39.207827    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:39.207910 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:39.207898    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:39.387378 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.387340    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vmg9v" event={"ID":"0c1c09d2-5782-4c07-b6da-d8211ecc6bf4","Type":"ContainerStarted","Data":"fc879ab92a736d3e9b757fd2a3a4c79b7913b1bc02448b3858062b5d75b0657b"}
Sep 15 11:37:39.389651 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.389621    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98" event={"ID":"a5c53150-e123-4167-91d4-b3dee53e864b","Type":"ContainerStarted","Data":"32e2d12183b81746de92fd399004e354f2e06783ac632715062298fc5706ecae"}
Sep 15 11:37:39.391269 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.391243    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h4mkd" event={"ID":"7e9ba56b-3290-489b-980d-e8706e503dd6","Type":"ContainerStarted","Data":"0a12a17fa76f249fb3ec1cf442f2fa998285f7dc0569b6511e7aac8fd058ec26"}
Sep 15 11:37:39.394573 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.394552    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 11:37:39.394944 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.394918    2571 generic.go:356] "Generic (PLEG): container finished" podID="6f223f9c-27a1-4c1e-9d40-8d6a557d90b7" containerID="91271ccd25c860e8ab23e556f3555e61a8a781e00b92f333edc5f3896bdc5381" exitCode=1
Sep 15 11:37:39.395045 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.394993    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6" event={"ID":"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7","Type":"ContainerStarted","Data":"426b6f425ebec5a817e724ce73b4179ee4dcf2e216abc9329e35a61f2a277098"}
Sep 15 11:37:39.395101 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.395050    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6" event={"ID":"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7","Type":"ContainerStarted","Data":"b8df0426fc102933974ee3a32e2c932b6c12247bf2ca8f2d3e2670faa4eb097c"}
Sep 15 11:37:39.395101 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.395094    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6" event={"ID":"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7","Type":"ContainerStarted","Data":"eb80b24a1739c698ba485a4b6a43a1cb7dd59286e3b92ca240f819efd149c4cf"}
Sep 15 11:37:39.395202 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.395177    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6" event={"ID":"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7","Type":"ContainerStarted","Data":"29aba53fd6e6b2136a7b3387b22758183057f7ee631d5418a9ff4e400cb9ac0f"}
Sep 15 11:37:39.395247 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.395229    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6" event={"ID":"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7","Type":"ContainerDied","Data":"91271ccd25c860e8ab23e556f3555e61a8a781e00b92f333edc5f3896bdc5381"}
Sep 15 11:37:39.396662 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.396642    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x4p8m" event={"ID":"2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6","Type":"ContainerStarted","Data":"0ac238a971f12d4a84bacd7357f0a1512b9fdbed8b4705fd74f90dfe6308f772"}
Sep 15 11:37:39.398530 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.398507    2571 generic.go:356] "Generic (PLEG): container finished" podID="5a77f882da81efbb546d90096b4f4a6e" containerID="1ab00d6b4c57fa595a53ad1fe75d13a9a0b86d61b9e4cc3731b5fdde12e40381" exitCode=0
Sep 15 11:37:39.398636 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.398583    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" event={"ID":"5a77f882da81efbb546d90096b4f4a6e","Type":"ContainerDied","Data":"1ab00d6b4c57fa595a53ad1fe75d13a9a0b86d61b9e4cc3731b5fdde12e40381"}
Sep 15 11:37:39.400408 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.400386    2571 generic.go:356] "Generic (PLEG): container finished" podID="b257fc07-966b-43b6-a6fd-e4f922c9e907" containerID="fbd9348ad9444cafe287f817f2471ad84f147cc8c9b8c437dc5056b3e7e618e2" exitCode=0
Sep 15 11:37:39.400504 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.400465    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpffd" event={"ID":"b257fc07-966b-43b6-a6fd-e4f922c9e907","Type":"ContainerDied","Data":"fbd9348ad9444cafe287f817f2471ad84f147cc8c9b8c437dc5056b3e7e618e2"}
Sep 15 11:37:39.402360 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.402291    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kgp8h" event={"ID":"719ac105-ddf6-4f1a-937c-d86ec063d9ec","Type":"ContainerStarted","Data":"263d039d8d0e7b3d8e70b403e1634f912bc9e9563d0887a54d56ffc2d2c4b397"}
Sep 15 11:37:39.403070 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.402993    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vmg9v" podStartSLOduration=2.929103481 podStartE2EDuration="21.402977776s" totalImagesPullingTime="18.473874295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:39.402690397 +0000 UTC m=+21.654247454" watchObservedRunningTime="2026-09-15 11:37:39.402977776 +0000 UTC m=+21.654534834"
Sep 15 11:37:39.434714 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.434672    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x4p8m" podStartSLOduration=2.5165169670000003 podStartE2EDuration="21.434652651s" totalImagesPullingTime="18.918135684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:39.434217471 +0000 UTC m=+21.685774529" watchObservedRunningTime="2026-09-15 11:37:39.434652651 +0000 UTC m=+21.686209709"
Sep 15 11:37:39.450148 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.450092    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h4mkd" podStartSLOduration=2.959778008 podStartE2EDuration="21.45005615s" totalImagesPullingTime="18.490278142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:39.449822722 +0000 UTC m=+21.701379780" watchObservedRunningTime="2026-09-15 11:37:39.45005615 +0000 UTC m=+21.701613211"
Sep 15 11:37:39.470663 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.470608    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kgp8h" podStartSLOduration=2.898385811 podStartE2EDuration="21.470586106s" totalImagesPullingTime="18.572200295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:39.470531673 +0000 UTC m=+21.722088731" watchObservedRunningTime="2026-09-15 11:37:39.470586106 +0000 UTC m=+21.722143165"
Sep 15 11:37:39.525727 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.525693    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:39.607707 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.607667    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:39.667982 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.667800    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:39.822958 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.822907    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:39.874014 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.873990    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 11:37:39.890331 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.890303    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:39.984569 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:39.984537    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:40.151783 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.151588    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T11:37:39.874009647Z","UUID":"e64653b5-2621-497e-80fb-70787f44eb29","Handler":null,"Name":"","Endpoint":""}
Sep 15 11:37:40.153275 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.153252    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 11:37:40.153410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.153286    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 11:37:40.208269 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.208238    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:40.208437 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:40.208368    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:40.321088 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.321047    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:40.407405 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.407255    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nb2sr" event={"ID":"529da763-ba66-4010-a0af-b13d2de0ce25","Type":"ContainerStarted","Data":"5174c9f0f2589d04f8e3a638d73b2604a872344ecba2875b29d222e1404bd781"}
Sep 15 11:37:40.409634 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.409604    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" event={"ID":"5a77f882da81efbb546d90096b4f4a6e","Type":"ContainerStarted","Data":"68597595cf883088ce855ec449f7b4ba0d85913278c40522e12cb6d958b2732c"}
Sep 15 11:37:40.412545 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.412264    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98" event={"ID":"a5c53150-e123-4167-91d4-b3dee53e864b","Type":"ContainerStarted","Data":"3345f97a12a7f44dac4ee87c2b10a2f5f70b3137990ab3c6843160cba339a87a"}
Sep 15 11:37:40.444620 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.444571    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nb2sr" podStartSLOduration=7.963622923 podStartE2EDuration="22.444550091s" totalImagesPullingTime="14.480927168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:40.443678714 +0000 UTC m=+22.695235833" watchObservedRunningTime="2026-09-15 11:37:40.444550091 +0000 UTC m=+22.696107151"
Sep 15 11:37:40.460685 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.460619    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-110.ec2.internal" podStartSLOduration=21.460599685 podStartE2EDuration="21.460599685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:40.460046387 +0000 UTC m=+22.711603444" watchObservedRunningTime="2026-09-15 11:37:40.460599685 +0000 UTC m=+22.712156743"
Sep 15 11:37:40.471306 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.471278    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:40.559169 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.559123    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:40.650532 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.650505    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:40.720687 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:40.720653    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:41.207901 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:41.207868    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:41.208078 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:41.207868    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:41.208078 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:41.207998    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:41.208207 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:41.208110    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:41.372534 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:41.372497    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vmg9v_0c1c09d2-5782-4c07-b6da-d8211ecc6bf4/dns-node-resolver/0.log"
Sep 15 11:37:41.417111 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:41.417078    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98" event={"ID":"a5c53150-e123-4167-91d4-b3dee53e864b","Type":"ContainerStarted","Data":"914d7eafea0681157b7931e7b828f9b8db8a660416ec69cc502b8ebadb5f3991"}
Sep 15 11:37:41.420207 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:41.420189    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 11:37:41.420542 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:41.420519    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6" event={"ID":"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7","Type":"ContainerStarted","Data":"609a70d324f551eec9b4d9c18f4cc3e20c1f3659f55f7e56961ea8f191048b9d"}
Sep 15 11:37:41.436364 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:41.436323    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7hk98" podStartSLOduration=3.170786123 podStartE2EDuration="23.43630784s" totalImagesPullingTime="20.265521717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:41.436144016 +0000 UTC m=+23.687701065" watchObservedRunningTime="2026-09-15 11:37:41.43630784 +0000 UTC m=+23.687864926"
Sep 15 11:37:41.837085 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:41.837047    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:41.898557 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:41.898523    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:42.162218 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:42.162131    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:42.207506 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:42.207475    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:42.207676 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:42.207605    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:42.263022 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:42.262965    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:42.553602 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:42.553554    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h4mkd"
Sep 15 11:37:42.554434 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:42.554357    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h4mkd"
Sep 15 11:37:42.574431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:42.574405    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kgp8h_719ac105-ddf6-4f1a-937c-d86ec063d9ec/node-ca/0.log"
Sep 15 11:37:42.761742 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:42.761706    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:42.862521 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:42.862431    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:42.964613 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:42.964588    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:43.089220 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:43.089190    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:43.207489 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:43.207455    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:43.207648 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:43.207458    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:43.207648 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:43.207579    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:43.207725 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:43.207690    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:43.425593 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:43.425519    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h4mkd"
Sep 15 11:37:43.426226 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:43.426210    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h4mkd"
Sep 15 11:37:44.208313 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:44.208284    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:44.208852 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:44.208414    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:45.208258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:45.208074    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:45.208530 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:45.208076    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:45.208530 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:45.208335    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:45.208530 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:45.208454    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:45.433647 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:45.433621    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 11:37:45.434022 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:45.434002    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6" event={"ID":"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7","Type":"ContainerStarted","Data":"fb32a6acbd05c2266aad6c9802374e6050676e289d0505de49181f149e192101"}
Sep 15 11:37:45.434259 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:45.434243    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:45.434484 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:45.434464    2571 scope.go:117] "RemoveContainer" containerID="91271ccd25c860e8ab23e556f3555e61a8a781e00b92f333edc5f3896bdc5381"
Sep 15 11:37:45.436040 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:45.436019    2571 generic.go:356] "Generic (PLEG): container finished" podID="b257fc07-966b-43b6-a6fd-e4f922c9e907" containerID="4b79bc9dcd14d6b4e79717d009d4ef126146a262c6c82268467d4986011d605c" exitCode=0
Sep 15 11:37:45.436129 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:45.436067    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpffd" event={"ID":"b257fc07-966b-43b6-a6fd-e4f922c9e907","Type":"ContainerDied","Data":"4b79bc9dcd14d6b4e79717d009d4ef126146a262c6c82268467d4986011d605c"}
Sep 15 11:37:45.450596 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:45.450572    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:46.207950 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.207914    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:46.208107 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:46.208028    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:46.287240 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.287212    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:46.389452 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.389418    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:46.440329 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.440292    2571 generic.go:356] "Generic (PLEG): container finished" podID="b257fc07-966b-43b6-a6fd-e4f922c9e907" containerID="0c4e89e2b874de180305c50edd5b970c74734c3793a5a5c71fbf1db4e6f74f6a" exitCode=0
Sep 15 11:37:46.440503 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.440366    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpffd" event={"ID":"b257fc07-966b-43b6-a6fd-e4f922c9e907","Type":"ContainerDied","Data":"0c4e89e2b874de180305c50edd5b970c74734c3793a5a5c71fbf1db4e6f74f6a"}
Sep 15 11:37:46.444315 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.444290    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 11:37:46.444646 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.444621    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6" event={"ID":"6f223f9c-27a1-4c1e-9d40-8d6a557d90b7","Type":"ContainerStarted","Data":"32d917438ae184f5a7929c9a387421dab317601f31b0ac7106e7b540acc63df4"}
Sep 15 11:37:46.444825 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.444808    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:46.444886 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.444875    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:46.459741 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.459669    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:37:46.501096 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.501062    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:46.524771 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.523099    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6" podStartSLOduration=10.002898161 podStartE2EDuration="28.523073706s" totalImagesPullingTime="18.520175545s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:46.522485284 +0000 UTC m=+28.774042344" watchObservedRunningTime="2026-09-15 11:37:46.523073706 +0000 UTC m=+28.774630764"
Sep 15 11:37:46.689971 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.689938    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:46.804083 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.803992    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:46.973590 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:46.973554    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:47.207467 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:47.207433    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:47.207659 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:47.207541    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:47.207659 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:47.207590    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:47.207769 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:47.207674    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:47.208479 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:47.208460    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:47.448463 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:47.448435    2571 generic.go:356] "Generic (PLEG): container finished" podID="b257fc07-966b-43b6-a6fd-e4f922c9e907" containerID="85ac15289716a005a59289350ea75acf4c9a861ecb64dc8a65232440f27acdbc" exitCode=0
Sep 15 11:37:47.448952 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:47.448514    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpffd" event={"ID":"b257fc07-966b-43b6-a6fd-e4f922c9e907","Type":"ContainerDied","Data":"85ac15289716a005a59289350ea75acf4c9a861ecb64dc8a65232440f27acdbc"}
Sep 15 11:37:48.174679 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:48.174648    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:48.208284 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:48.208254    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:48.208426 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:48.208342    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:48.378718 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:48.378687    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:48.580232 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:48.580195    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:48.777204 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:48.777165    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:48.980786 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:48.980740    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:49.208006 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:49.207965    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:49.208205 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:49.208084    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:49.208205 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:49.208144    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:49.208336 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:49.208271    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:49.894400 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:49.894367    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:49.995329 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:49.995279    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:50.053721 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:50.053673    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:50.173388 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:50.173308    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:50.208115 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:50.208083    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:50.208294 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:50.208212    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:50.384184 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:50.384140    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:50.578895 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:50.578860    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:50.676460 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:50.676425    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:50.944198 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:50.944169    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs\") pod \"network-metrics-daemon-959p9\" (UID: \"52c718e0-4bf0-406b-9c49-1a5e120fcd43\") " pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:50.944683 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:50.944229    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:50.944683 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:50.944281    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:50.944683 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:50.944329    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:50.944683 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:50.944361    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs podName:52c718e0-4bf0-406b-9c49-1a5e120fcd43 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:22.94434301 +0000 UTC m=+65.195900044 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs") pod "network-metrics-daemon-959p9" (UID: "52c718e0-4bf0-406b-9c49-1a5e120fcd43") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 11:37:50.944683 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:50.944382    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret podName:e7423e8a-7332-4124-82ce-92db8066e036 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:22.944374723 +0000 UTC m=+65.195931758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret") pod "global-pull-secret-syncer-25rqj" (UID: "e7423e8a-7332-4124-82ce-92db8066e036") : object "kube-system"/"original-pull-secret" not registered
Sep 15 11:37:51.044843 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:51.044799    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967dm\" (UniqueName: \"kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm\") pod \"network-check-target-dd9x4\" (UID: \"fa09d17e-2f73-4047-9d04-031bec2e9927\") " pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:51.045040 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:51.044949    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 11:37:51.045040 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:51.044976    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 11:37:51.045040 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:51.044991    2571 projected.go:196] Error preparing data for projected volume kube-api-access-967dm for pod openshift-network-diagnostics/network-check-target-dd9x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:51.045205 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:51.045060    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm podName:fa09d17e-2f73-4047-9d04-031bec2e9927 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:23.045038469 +0000 UTC m=+65.296595509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-967dm" (UniqueName: "kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm") pod "network-check-target-dd9x4" (UID: "fa09d17e-2f73-4047-9d04-031bec2e9927") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 11:37:51.207807 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:51.207733    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:51.208083 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:51.207733    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:51.208083 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:51.207858    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:51.208083 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:51.207936    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:51.582907 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:51.582836    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:51.977383 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:51.977354    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:52.179080 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:52.179034    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:52.207805 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:52.207780    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:52.207929 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:52.207888    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:52.377811 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:52.377776    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:52.462476 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:52.462439    2571 generic.go:356] "Generic (PLEG): container finished" podID="b257fc07-966b-43b6-a6fd-e4f922c9e907" containerID="eb7f908d4b32246452ec45e4c8b8abf54bdc513f25acb54b9ac6a94e47025db4" exitCode=0
Sep 15 11:37:52.462673 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:52.462504    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpffd" event={"ID":"b257fc07-966b-43b6-a6fd-e4f922c9e907","Type":"ContainerDied","Data":"eb7f908d4b32246452ec45e4c8b8abf54bdc513f25acb54b9ac6a94e47025db4"}
Sep 15 11:37:52.578950 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:52.578914    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:52.677805 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:52.677770    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:53.208101 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:53.208066    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:53.208101 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:53.208107    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:53.208534 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:53.208202    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:53.208534 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:53.208332    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:53.373825 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:53.373793    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:53.467787 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:53.467708    2571 generic.go:356] "Generic (PLEG): container finished" podID="b257fc07-966b-43b6-a6fd-e4f922c9e907" containerID="76f779a7fb00cdd83e9a78523659f263e65faefdd31f0dc60608485e41e699d1" exitCode=0
Sep 15 11:37:53.467787 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:53.467754    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpffd" event={"ID":"b257fc07-966b-43b6-a6fd-e4f922c9e907","Type":"ContainerDied","Data":"76f779a7fb00cdd83e9a78523659f263e65faefdd31f0dc60608485e41e699d1"}
Sep 15 11:37:53.987778 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:53.987595    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:54.179309 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:54.179280    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:54.207343 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:54.207321    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:54.207465 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:54.207415    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:54.475618 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:54.475580    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpffd" event={"ID":"b257fc07-966b-43b6-a6fd-e4f922c9e907","Type":"ContainerStarted","Data":"fe6b00b8a302602e4c1a2354a052382d758356314024ea09598301a5e3efe5ad"}
Sep 15 11:37:54.499546 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:54.499489    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xpffd" podStartSLOduration=6.751451181 podStartE2EDuration="36.499474103s" totalImagesPullingTime="29.748022922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:37:54.499448483 +0000 UTC m=+36.751005540" watchObservedRunningTime="2026-09-15 11:37:54.499474103 +0000 UTC m=+36.751031137"
Sep 15 11:37:54.538355 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:54.538311    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:54.596008 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:54.595975    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:54.776949 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:54.776878    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:54.892085 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:54.892053    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:54.993056 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:54.993026    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:55.175427 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:55.175336    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:55.207899 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:55.207869    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:55.208047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:55.207904    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:55.208047 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:55.207996    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:55.208181 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:55.208089    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:55.779252 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:55.779223    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:56.175340 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:56.175234    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:56.207281 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:56.207252    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:56.207408 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:56.207352    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:56.370658 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:56.370627    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:56.783533 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:56.783498    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:56.978302 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:56.978273    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:37:57.208137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:57.208109    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:57.208316 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:57.208109    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:57.208316 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:57.208227    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:57.208316 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:57.208279    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:37:58.208635 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:58.208600    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:37:58.208992 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:58.208698    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:37:59.207919 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:59.207886    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:37:59.208095 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:37:59.207886    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:37:59.208095 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:59.207985    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:37:59.208276 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:37:59.208106    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:38:00.207376 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:00.207343    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:38:00.207724 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:00.207478    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:38:01.208052 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:01.208013    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:38:01.208495 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:01.208114    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:38:01.208495 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:01.208170    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:38:01.208495 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:01.208268    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:38:01.756843 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:01.756806    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:01.861227 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:01.861196    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:01.972475 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:01.972444    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:02.027068 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:02.026992    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:02.207821 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:02.207790    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:38:02.208050 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:02.207901    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:38:02.212419 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:02.212394    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:02.273320 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:02.273293    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:02.413604 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:02.413529    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:02.477982 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:02.477951    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:02.847660 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:02.847631    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:02.909442 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:02.909412    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:03.048984 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:03.048952    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:03.112173 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:03.112084    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:03.207402 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:03.207364    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:38:03.207570 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:03.207477    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:38:03.207570 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:03.207524    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:38:03.207641 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:03.207617    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:38:03.436296 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:03.436214    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:03.535671 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:03.535639    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:03.636671 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:03.636644    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:03.848956 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:03.848929    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:03.935285 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:03.935255    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:04.050495 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:04.050464    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:04.161213 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:04.161116    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:04.207238 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:04.207215    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:38:04.207402 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:04.207311    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:38:04.261909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:04.261870    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:05.207518 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:05.207490    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:38:05.207833 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:05.207593    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:38:05.207833 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:05.207642    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:38:05.207833 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:05.207736    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:38:05.250166 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:05.250123    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:05.310530 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:05.310490    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:05.401011 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:05.400975    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dd9x4"]
Sep 15 11:38:05.404427 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:05.404399    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-25rqj"]
Sep 15 11:38:05.404595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:05.404518    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:38:05.404659 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:05.404637    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:38:05.405343 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:05.405319    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-959p9"]
Sep 15 11:38:05.498667 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:05.498633    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:38:05.498847 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:05.498633    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:38:05.498847 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:05.498737    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:38:05.498847 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:05.498808    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:38:05.611439 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:05.611409    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:05.684913 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:05.684872    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:05.805309 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:05.805231    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:06.744247 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:06.744214    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:07.208276 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:07.208240    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:38:07.208446 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:07.208286    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:38:07.208446 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:07.208246    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:38:07.208446 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:07.208363    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:38:07.208446 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:07.208407    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:38:07.208600 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:07.208490    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:38:09.207784 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:09.207570    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:38:09.208145 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:09.207660    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:38:09.208145 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:09.207861    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25rqj" podUID="e7423e8a-7332-4124-82ce-92db8066e036"
Sep 15 11:38:09.208145 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:09.207673    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:38:09.208145 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:09.207946    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-959p9" podUID="52c718e0-4bf0-406b-9c49-1a5e120fcd43"
Sep 15 11:38:09.208145 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:09.208001    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd9x4" podUID="fa09d17e-2f73-4047-9d04-031bec2e9927"
Sep 15 11:38:09.891971 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:09.891947    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:09.993082 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:09.993048    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:10.004066 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.004041    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-110.ec2.internal" event="NodeReady"
Sep 15 11:38:10.004257 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.004229    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 11:38:10.056887 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.056847    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7t2f7"]
Sep 15 11:38:10.058522 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.058506    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.061355 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.061332    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 11:38:10.061549 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.061531    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qkkmw\""
Sep 15 11:38:10.061783 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.061763    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 11:38:10.062536 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.062515    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lv6nb"]
Sep 15 11:38:10.064446 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.064429    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.066880 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.066859    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 11:38:10.067040 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.067006    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 11:38:10.067040 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.067017    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6nc5j\""
Sep 15 11:38:10.067199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.067087    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 11:38:10.067199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.067093    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 11:38:10.070476 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.070453    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7t2f7"]
Sep 15 11:38:10.076029 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.076003    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lv6nb"]
Sep 15 11:38:10.159604 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.159525    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p8tnd"]
Sep 15 11:38:10.161397 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.161382    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p8tnd"
Sep 15 11:38:10.164303 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.164285    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 11:38:10.164411 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.164346    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t7jqq\""
Sep 15 11:38:10.164468 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.164456    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 11:38:10.164569 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.164549    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 11:38:10.174427 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.174404    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p8tnd"]
Sep 15 11:38:10.179870 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.179846    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6hjb\" (UniqueName: \"kubernetes.io/projected/171badf9-573d-4b76-9da9-538229c17db6-kube-api-access-v6hjb\") pod \"dns-default-7t2f7\" (UID: \"171badf9-573d-4b76-9da9-538229c17db6\") " pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.180016 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.179882    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71f382d5-253d-437e-83c9-5ba6ad99f4d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.180016 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.179909    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj7gm\" (UniqueName: \"kubernetes.io/projected/71f382d5-253d-437e-83c9-5ba6ad99f4d2-kube-api-access-gj7gm\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.180016 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.179994    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71f382d5-253d-437e-83c9-5ba6ad99f4d2-data-volume\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.180173 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.180046    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71f382d5-253d-437e-83c9-5ba6ad99f4d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.180173 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.180076    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/171badf9-573d-4b76-9da9-538229c17db6-metrics-tls\") pod \"dns-default-7t2f7\" (UID: \"171badf9-573d-4b76-9da9-538229c17db6\") " pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.180173 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.180120    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71f382d5-253d-437e-83c9-5ba6ad99f4d2-crio-socket\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.180173 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.180137    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/171badf9-573d-4b76-9da9-538229c17db6-config-volume\") pod \"dns-default-7t2f7\" (UID: \"171badf9-573d-4b76-9da9-538229c17db6\") " pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.180322 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.180176    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/171badf9-573d-4b76-9da9-538229c17db6-tmp-dir\") pod \"dns-default-7t2f7\" (UID: \"171badf9-573d-4b76-9da9-538229c17db6\") " pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.207482 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.207456    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:10.274608 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.274573    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:10.280891 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.280859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71f382d5-253d-437e-83c9-5ba6ad99f4d2-crio-socket\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.280891 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.280889    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/171badf9-573d-4b76-9da9-538229c17db6-config-volume\") pod \"dns-default-7t2f7\" (UID: \"171badf9-573d-4b76-9da9-538229c17db6\") " pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.281087 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.280914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/171badf9-573d-4b76-9da9-538229c17db6-tmp-dir\") pod \"dns-default-7t2f7\" (UID: \"171badf9-573d-4b76-9da9-538229c17db6\") " pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.281087 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.280947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6hjb\" (UniqueName: \"kubernetes.io/projected/171badf9-573d-4b76-9da9-538229c17db6-kube-api-access-v6hjb\") pod \"dns-default-7t2f7\" (UID: \"171badf9-573d-4b76-9da9-538229c17db6\") " pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.281087 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.280982    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71f382d5-253d-437e-83c9-5ba6ad99f4d2-crio-socket\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.281087 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.280993    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71f382d5-253d-437e-83c9-5ba6ad99f4d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.281087 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.281021    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj7gm\" (UniqueName: \"kubernetes.io/projected/71f382d5-253d-437e-83c9-5ba6ad99f4d2-kube-api-access-gj7gm\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.281087 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.281047    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-298dd\" (UniqueName: \"kubernetes.io/projected/08b25302-a7c8-4567-a3c3-329af1bfe5d6-kube-api-access-298dd\") pod \"ingress-canary-p8tnd\" (UID: \"08b25302-a7c8-4567-a3c3-329af1bfe5d6\") " pod="openshift-ingress-canary/ingress-canary-p8tnd"
Sep 15 11:38:10.281087 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.281088    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71f382d5-253d-437e-83c9-5ba6ad99f4d2-data-volume\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.281448 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.281110    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08b25302-a7c8-4567-a3c3-329af1bfe5d6-cert\") pod \"ingress-canary-p8tnd\" (UID: \"08b25302-a7c8-4567-a3c3-329af1bfe5d6\") " pod="openshift-ingress-canary/ingress-canary-p8tnd"
Sep 15 11:38:10.281682 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.281655    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/171badf9-573d-4b76-9da9-538229c17db6-tmp-dir\") pod \"dns-default-7t2f7\" (UID: \"171badf9-573d-4b76-9da9-538229c17db6\") " pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.281797 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.281772    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71f382d5-253d-437e-83c9-5ba6ad99f4d2-data-volume\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.281873 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.281832    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71f382d5-253d-437e-83c9-5ba6ad99f4d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.281918 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.281888    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/171badf9-573d-4b76-9da9-538229c17db6-metrics-tls\") pod \"dns-default-7t2f7\" (UID: \"171badf9-573d-4b76-9da9-538229c17db6\") " pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.281959 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.281912    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/171badf9-573d-4b76-9da9-538229c17db6-config-volume\") pod \"dns-default-7t2f7\" (UID: \"171badf9-573d-4b76-9da9-538229c17db6\") " pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.282838 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.282802    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71f382d5-253d-437e-83c9-5ba6ad99f4d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.286713 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.286683    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/171badf9-573d-4b76-9da9-538229c17db6-metrics-tls\") pod \"dns-default-7t2f7\" (UID: \"171badf9-573d-4b76-9da9-538229c17db6\") " pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.287604 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.287575    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71f382d5-253d-437e-83c9-5ba6ad99f4d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.289874 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.289846    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj7gm\" (UniqueName: \"kubernetes.io/projected/71f382d5-253d-437e-83c9-5ba6ad99f4d2-kube-api-access-gj7gm\") pod \"insights-runtime-extractor-lv6nb\" (UID: \"71f382d5-253d-437e-83c9-5ba6ad99f4d2\") " pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.290421 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.290399    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6hjb\" (UniqueName: \"kubernetes.io/projected/171badf9-573d-4b76-9da9-538229c17db6-kube-api-access-v6hjb\") pod \"dns-default-7t2f7\" (UID: \"171badf9-573d-4b76-9da9-538229c17db6\") " pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.370038 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.369995    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:10.375407 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.375390    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lv6nb"
Sep 15 11:38:10.383216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.383187    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-298dd\" (UniqueName: \"kubernetes.io/projected/08b25302-a7c8-4567-a3c3-329af1bfe5d6-kube-api-access-298dd\") pod \"ingress-canary-p8tnd\" (UID: \"08b25302-a7c8-4567-a3c3-329af1bfe5d6\") " pod="openshift-ingress-canary/ingress-canary-p8tnd"
Sep 15 11:38:10.383327 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.383247    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08b25302-a7c8-4567-a3c3-329af1bfe5d6-cert\") pod \"ingress-canary-p8tnd\" (UID: \"08b25302-a7c8-4567-a3c3-329af1bfe5d6\") " pod="openshift-ingress-canary/ingress-canary-p8tnd"
Sep 15 11:38:10.385923 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.385892    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08b25302-a7c8-4567-a3c3-329af1bfe5d6-cert\") pod \"ingress-canary-p8tnd\" (UID: \"08b25302-a7c8-4567-a3c3-329af1bfe5d6\") " pod="openshift-ingress-canary/ingress-canary-p8tnd"
Sep 15 11:38:10.391986 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.391965    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-298dd\" (UniqueName: \"kubernetes.io/projected/08b25302-a7c8-4567-a3c3-329af1bfe5d6-kube-api-access-298dd\") pod \"ingress-canary-p8tnd\" (UID: \"08b25302-a7c8-4567-a3c3-329af1bfe5d6\") " pod="openshift-ingress-canary/ingress-canary-p8tnd"
Sep 15 11:38:10.469812 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.469776    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p8tnd"
Sep 15 11:38:10.660855 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.660805    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7t2f7"]
Sep 15 11:38:10.661774 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.661451    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lv6nb"]
Sep 15 11:38:10.664211 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:10.664146    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f382d5_253d_437e_83c9_5ba6ad99f4d2.slice/crio-61fa63334c35d87fd831bf7d891749f27d57b92011cce244ef88e73aa406064f WatchSource:0}: Error finding container 61fa63334c35d87fd831bf7d891749f27d57b92011cce244ef88e73aa406064f: Status 404 returned error can't find the container with id 61fa63334c35d87fd831bf7d891749f27d57b92011cce244ef88e73aa406064f
Sep 15 11:38:10.664671 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:10.664653    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171badf9_573d_4b76_9da9_538229c17db6.slice/crio-37858f8211c8732a86637a9f48d50d6aa6aff2ab9d48a1862c1cc2fef71e15ed WatchSource:0}: Error finding container 37858f8211c8732a86637a9f48d50d6aa6aff2ab9d48a1862c1cc2fef71e15ed: Status 404 returned error can't find the container with id 37858f8211c8732a86637a9f48d50d6aa6aff2ab9d48a1862c1cc2fef71e15ed
Sep 15 11:38:10.744099 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:10.744069    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p8tnd"]
Sep 15 11:38:10.747062 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:10.747038    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b25302_a7c8_4567_a3c3_329af1bfe5d6.slice/crio-5a8fc6a498e8aa01a7a273181fbe5390b0780cec0ed42346f4513a405b8056c1 WatchSource:0}: Error finding container 5a8fc6a498e8aa01a7a273181fbe5390b0780cec0ed42346f4513a405b8056c1: Status 404 returned error can't find the container with id 5a8fc6a498e8aa01a7a273181fbe5390b0780cec0ed42346f4513a405b8056c1
Sep 15 11:38:11.208125 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.208092    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:38:11.208339 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.208137    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:38:11.208339 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.208224    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:38:11.212318 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.212291    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 11:38:11.212318 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.212291    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 11:38:11.212559 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.212339    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 11:38:11.212644 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.212627    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-72bfh\""
Sep 15 11:38:11.212838 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.212821    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 11:38:11.212969 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.212952    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w6k5p\""
Sep 15 11:38:11.514259 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.514113    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p8tnd" event={"ID":"08b25302-a7c8-4567-a3c3-329af1bfe5d6","Type":"ContainerStarted","Data":"5a8fc6a498e8aa01a7a273181fbe5390b0780cec0ed42346f4513a405b8056c1"}
Sep 15 11:38:11.516333 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.516304    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lv6nb" event={"ID":"71f382d5-253d-437e-83c9-5ba6ad99f4d2","Type":"ContainerStarted","Data":"362837e972c124d5bb49915700a2ee47aaf5e23c61380879d674ab1f8acf70a8"}
Sep 15 11:38:11.516452 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.516365    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lv6nb" event={"ID":"71f382d5-253d-437e-83c9-5ba6ad99f4d2","Type":"ContainerStarted","Data":"61fa63334c35d87fd831bf7d891749f27d57b92011cce244ef88e73aa406064f"}
Sep 15 11:38:11.517675 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.517647    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7t2f7" event={"ID":"171badf9-573d-4b76-9da9-538229c17db6","Type":"ContainerStarted","Data":"37858f8211c8732a86637a9f48d50d6aa6aff2ab9d48a1862c1cc2fef71e15ed"}
Sep 15 11:38:11.723615 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.723553    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:11.845918 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.845829    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:11.907340 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:11.907311    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:12.524668 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:12.524613    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lv6nb" event={"ID":"71f382d5-253d-437e-83c9-5ba6ad99f4d2","Type":"ContainerStarted","Data":"99c5795eff31c15e777eb37ba18ac51adf1bb42a298e35369fbbb596d74ed787"}
Sep 15 11:38:12.527033 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:12.527001    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7t2f7" event={"ID":"171badf9-573d-4b76-9da9-538229c17db6","Type":"ContainerStarted","Data":"1ae5348c6c0ec4f0a1fe26ac96aae7eb674cc0df835e1185b199a0c852f22e68"}
Sep 15 11:38:12.834844 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:12.834809    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:12.883002 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:12.882968    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"]
Sep 15 11:38:12.885345 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:12.885320    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:12.889184 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:12.889149    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 15 11:38:12.889290 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:12.889205    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 11:38:12.889331 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:12.889147    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 11:38:12.889385 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:12.889148    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 11:38:12.889488 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:12.889474    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vhv9p\""
Sep 15 11:38:12.889574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:12.889560    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 15 11:38:12.896196 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:12.896173    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"]
Sep 15 11:38:12.902511 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:12.902489    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:13.004926 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.004886    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cb82822-44d0-4ab9-80a2-adb72aefe66a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-44jxl\" (UID: \"8cb82822-44d0-4ab9-80a2-adb72aefe66a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.005111 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.004959    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tnbl\" (UniqueName: \"kubernetes.io/projected/8cb82822-44d0-4ab9-80a2-adb72aefe66a-kube-api-access-4tnbl\") pod \"prometheus-operator-68bcd7f987-44jxl\" (UID: \"8cb82822-44d0-4ab9-80a2-adb72aefe66a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.005111 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.004997    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb82822-44d0-4ab9-80a2-adb72aefe66a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-44jxl\" (UID: \"8cb82822-44d0-4ab9-80a2-adb72aefe66a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.005111 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.005038    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cb82822-44d0-4ab9-80a2-adb72aefe66a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-44jxl\" (UID: \"8cb82822-44d0-4ab9-80a2-adb72aefe66a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.105927 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.105839    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tnbl\" (UniqueName: \"kubernetes.io/projected/8cb82822-44d0-4ab9-80a2-adb72aefe66a-kube-api-access-4tnbl\") pod \"prometheus-operator-68bcd7f987-44jxl\" (UID: \"8cb82822-44d0-4ab9-80a2-adb72aefe66a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.105927 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.105904    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb82822-44d0-4ab9-80a2-adb72aefe66a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-44jxl\" (UID: \"8cb82822-44d0-4ab9-80a2-adb72aefe66a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.106175 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.105962    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cb82822-44d0-4ab9-80a2-adb72aefe66a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-44jxl\" (UID: \"8cb82822-44d0-4ab9-80a2-adb72aefe66a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.106175 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.106013    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cb82822-44d0-4ab9-80a2-adb72aefe66a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-44jxl\" (UID: \"8cb82822-44d0-4ab9-80a2-adb72aefe66a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.106175 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:13.106028    2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 15 11:38:13.106175 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:13.106107    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb82822-44d0-4ab9-80a2-adb72aefe66a-prometheus-operator-tls podName:8cb82822-44d0-4ab9-80a2-adb72aefe66a nodeName:}" failed. No retries permitted until 2026-09-15 11:38:13.606080691 +0000 UTC m=+55.857637729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8cb82822-44d0-4ab9-80a2-adb72aefe66a-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-44jxl" (UID: "8cb82822-44d0-4ab9-80a2-adb72aefe66a") : secret "prometheus-operator-tls" not found
Sep 15 11:38:13.106826 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.106799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cb82822-44d0-4ab9-80a2-adb72aefe66a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-44jxl\" (UID: \"8cb82822-44d0-4ab9-80a2-adb72aefe66a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.109979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.109953    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cb82822-44d0-4ab9-80a2-adb72aefe66a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-44jxl\" (UID: \"8cb82822-44d0-4ab9-80a2-adb72aefe66a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.118794 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.118767    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tnbl\" (UniqueName: \"kubernetes.io/projected/8cb82822-44d0-4ab9-80a2-adb72aefe66a-kube-api-access-4tnbl\") pod \"prometheus-operator-68bcd7f987-44jxl\" (UID: \"8cb82822-44d0-4ab9-80a2-adb72aefe66a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.268107 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.268071    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-795b6fdc8b-x2q2w"]
Sep 15 11:38:13.273075 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.273032    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.275974 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.275945    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 15 11:38:13.276121 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.276098    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 11:38:13.276343 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.276322    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 15 11:38:13.276979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.276959    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 15 11:38:13.277134 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.276982    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 15 11:38:13.277134 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.277001    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 11:38:13.277377 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.277355    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 15 11:38:13.277473 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.277404    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vcxrj\""
Sep 15 11:38:13.285696 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.285672    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-795b6fdc8b-x2q2w"]
Sep 15 11:38:13.344683 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.344649    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:13.408890 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.408801    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-oauth-serving-cert\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.408890 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.408836    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-service-ca\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.408890 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.408870    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdxzx\" (UniqueName: \"kubernetes.io/projected/27c80f02-28b8-4ef0-97a0-30fe81186eea-kube-api-access-gdxzx\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.409139 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.408933    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-oauth-config\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.409139 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.408978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-config\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.409139 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.409017    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-serving-cert\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.445207 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.445173    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:13.509869 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.509827    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-serving-cert\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.510031 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.510009    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-oauth-serving-cert\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.510073 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.510035    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-service-ca\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.510073 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.510056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdxzx\" (UniqueName: \"kubernetes.io/projected/27c80f02-28b8-4ef0-97a0-30fe81186eea-kube-api-access-gdxzx\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.510206 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.510084    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-oauth-config\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.510206 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.510116    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-config\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.510845 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.510820    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-config\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.510943 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.510817    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-oauth-serving-cert\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.510943 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.510917    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-service-ca\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.512964 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.512940    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-oauth-config\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.513432 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.513413    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-serving-cert\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.520008 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.519985    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdxzx\" (UniqueName: \"kubernetes.io/projected/27c80f02-28b8-4ef0-97a0-30fe81186eea-kube-api-access-gdxzx\") pod \"console-795b6fdc8b-x2q2w\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") " pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.584147 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.584105    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:13.611439 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.611411    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb82822-44d0-4ab9-80a2-adb72aefe66a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-44jxl\" (UID: \"8cb82822-44d0-4ab9-80a2-adb72aefe66a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.613712 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.613685    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8cb82822-44d0-4ab9-80a2-adb72aefe66a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-44jxl\" (UID: \"8cb82822-44d0-4ab9-80a2-adb72aefe66a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.796634 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.796584    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"
Sep 15 11:38:13.911247 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:13.911206    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-795b6fdc8b-x2q2w"]
Sep 15 11:38:13.913949 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:13.913886    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c80f02_28b8_4ef0_97a0_30fe81186eea.slice/crio-25240ff0bc42d534ba5586df5e75761e9bd1e4fa002a3cc46ff837007fb56eb2 WatchSource:0}: Error finding container 25240ff0bc42d534ba5586df5e75761e9bd1e4fa002a3cc46ff837007fb56eb2: Status 404 returned error can't find the container with id 25240ff0bc42d534ba5586df5e75761e9bd1e4fa002a3cc46ff837007fb56eb2
Sep 15 11:38:14.088013 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:14.087982    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-44jxl"]
Sep 15 11:38:14.091349 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:14.091318    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb82822_44d0_4ab9_80a2_adb72aefe66a.slice/crio-367df479b4414966b240641d550407e2a2f05eb5420d70e9320b9c5e2ba1c0c2 WatchSource:0}: Error finding container 367df479b4414966b240641d550407e2a2f05eb5420d70e9320b9c5e2ba1c0c2: Status 404 returned error can't find the container with id 367df479b4414966b240641d550407e2a2f05eb5420d70e9320b9c5e2ba1c0c2
Sep 15 11:38:14.536677 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:14.536640    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7t2f7" event={"ID":"171badf9-573d-4b76-9da9-538229c17db6","Type":"ContainerStarted","Data":"c9045062f9c8597776f36bd4afb14acf8853c9c1b82fd8a18106347b5a0c898c"}
Sep 15 11:38:14.536870 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:14.536765    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:14.538202 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:14.538180    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl" event={"ID":"8cb82822-44d0-4ab9-80a2-adb72aefe66a","Type":"ContainerStarted","Data":"367df479b4414966b240641d550407e2a2f05eb5420d70e9320b9c5e2ba1c0c2"}
Sep 15 11:38:14.539600 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:14.539568    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795b6fdc8b-x2q2w" event={"ID":"27c80f02-28b8-4ef0-97a0-30fe81186eea","Type":"ContainerStarted","Data":"25240ff0bc42d534ba5586df5e75761e9bd1e4fa002a3cc46ff837007fb56eb2"}
Sep 15 11:38:14.541265 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:14.541241    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p8tnd" event={"ID":"08b25302-a7c8-4567-a3c3-329af1bfe5d6","Type":"ContainerStarted","Data":"192f0227c1d32b9c2050414fe74db3741565f87beb953c91092e4a24feacf62c"}
Sep 15 11:38:14.543738 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:14.543713    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lv6nb" event={"ID":"71f382d5-253d-437e-83c9-5ba6ad99f4d2","Type":"ContainerStarted","Data":"3dbe820c5d784aa94385d89a0fc3b1528151a6635f9ba5f3baf0c0c34531d444"}
Sep 15 11:38:14.589498 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:14.589435    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7t2f7" podStartSLOduration=2.86221084 podStartE2EDuration="4.589411328s" totalImagesPullingTime="1.727200488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:14.563794262 +0000 UTC m=+56.815351320" watchObservedRunningTime="2026-09-15 11:38:14.589411328 +0000 UTC m=+56.840968387"
Sep 15 11:38:14.589894 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:14.589564    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p8tnd" podStartSLOduration=1.7097619769999999 podStartE2EDuration="4.589555289s" totalImagesPullingTime="2.879793312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:14.588909196 +0000 UTC m=+56.840466258" watchObservedRunningTime="2026-09-15 11:38:14.589555289 +0000 UTC m=+56.841112347"
Sep 15 11:38:14.621693 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:14.621630    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lv6nb" podStartSLOduration=1.804387378 podStartE2EDuration="4.621607059s" totalImagesPullingTime="2.817219681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:14.6211788 +0000 UTC m=+56.872735856" watchObservedRunningTime="2026-09-15 11:38:14.621607059 +0000 UTC m=+56.873164117"
Sep 15 11:38:16.928280 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:16.928239    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:17.055681 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:17.055641    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:17.205396 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:17.205367    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:17.337993 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:17.337958    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:17.449970 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:17.449940    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:17.557770 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:17.557680    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl" event={"ID":"8cb82822-44d0-4ab9-80a2-adb72aefe66a","Type":"ContainerStarted","Data":"fdcf0aa8445495d8349d843db025aca4d8a983b36e2ef279051c045e4763aaca"}
Sep 15 11:38:17.557770 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:17.557749    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl" event={"ID":"8cb82822-44d0-4ab9-80a2-adb72aefe66a","Type":"ContainerStarted","Data":"028541d20bda205d16bbd67cd98a45dab26804b05e9edcea9b6fd4738e51ee8a"}
Sep 15 11:38:17.559272 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:17.559245    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795b6fdc8b-x2q2w" event={"ID":"27c80f02-28b8-4ef0-97a0-30fe81186eea","Type":"ContainerStarted","Data":"3737862afecf0c91f3e87917db3b6745ef9955d5d93edab2bd89025b78d1c584"}
Sep 15 11:38:17.590424 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:17.590364    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-44jxl" podStartSLOduration=2.844420489 podStartE2EDuration="5.590345834s" totalImagesPullingTime="2.745925345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:17.588906082 +0000 UTC m=+59.840463139" watchObservedRunningTime="2026-09-15 11:38:17.590345834 +0000 UTC m=+59.841902890"
Sep 15 11:38:17.618872 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:17.618822    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-795b6fdc8b-x2q2w" podStartSLOduration=1.6723094889999999 podStartE2EDuration="4.618808426s" totalImagesPullingTime="2.946498937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:17.617365158 +0000 UTC m=+59.868922215" watchObservedRunningTime="2026-09-15 11:38:17.618808426 +0000 UTC m=+59.870365481"
Sep 15 11:38:17.837143 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:17.837060    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:17.931968 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:17.931939    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:18.460875 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:18.460843    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4n9x6"
Sep 15 11:38:18.669352 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:18.669319    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:18.771668 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:18.771578    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:19.137430 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.137340    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:19.251692 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.251658    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:19.415777 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.415686    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:19.480625 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.480591    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"]
Sep 15 11:38:19.483296 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.483280    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:19.487623 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.487597    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 15 11:38:19.487900 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.487883    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 15 11:38:19.488502 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.488482    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qmsnm\""
Sep 15 11:38:19.508793 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.508765    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"]
Sep 15 11:38:19.511258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.511234    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"]
Sep 15 11:38:19.511402 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.511339    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.514874 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.514853    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 15 11:38:19.515272 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.515254    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-k4sqz\""
Sep 15 11:38:19.515403 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.515389    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 15 11:38:19.516472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.516452    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 15 11:38:19.524609 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.524582    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vtsf4"]
Sep 15 11:38:19.526546 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.526530    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.530541 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.530515    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 11:38:19.530722 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.530707    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 11:38:19.531059 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.531044    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 11:38:19.531099 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.531075    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-842fw\""
Sep 15 11:38:19.541800 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.541775    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"]
Sep 15 11:38:19.556670 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556633    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-sys\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.556670 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556673    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfhvq\" (UniqueName: \"kubernetes.io/projected/de026d1d-2b60-499d-b723-b194b2053e6a-kube-api-access-cfhvq\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.556869 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556696    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2rwm\" (UniqueName: \"kubernetes.io/projected/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-kube-api-access-h2rwm\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.556869 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556711    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de026d1d-2b60-499d-b723-b194b2053e6a-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.556869 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556726    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cdbb6f7-510b-43d0-90d0-f974bf353f02-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-ctqmr\" (UID: \"4cdbb6f7-510b-43d0-90d0-f974bf353f02\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:19.556869 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556764    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7mhh\" (UniqueName: \"kubernetes.io/projected/4cdbb6f7-510b-43d0-90d0-f974bf353f02-kube-api-access-s7mhh\") pod \"openshift-state-metrics-67dcf8c979-ctqmr\" (UID: \"4cdbb6f7-510b-43d0-90d0-f974bf353f02\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:19.556869 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556793    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-tls\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.556869 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556849    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-metrics-client-ca\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.557047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556875    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de026d1d-2b60-499d-b723-b194b2053e6a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.557047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556891    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.557047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556909    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-wtmp\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.557047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556939    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-textfile\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.557047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de026d1d-2b60-499d-b723-b194b2053e6a-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.557047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.556992    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-root\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.557047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.557026    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.557267 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.557055    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cdbb6f7-510b-43d0-90d0-f974bf353f02-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-ctqmr\" (UID: \"4cdbb6f7-510b-43d0-90d0-f974bf353f02\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:19.557267 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.557072    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cdbb6f7-510b-43d0-90d0-f974bf353f02-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-ctqmr\" (UID: \"4cdbb6f7-510b-43d0-90d0-f974bf353f02\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:19.557267 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.557088    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/de026d1d-2b60-499d-b723-b194b2053e6a-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.557267 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.557126    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/de026d1d-2b60-499d-b723-b194b2053e6a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.608343 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.608314    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:19.657542 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657507    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-wtmp\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.657542 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657545    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-textfile\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.657780 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657568    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de026d1d-2b60-499d-b723-b194b2053e6a-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.657780 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657590    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-root\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.657780 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657614    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.657780 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657643    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cdbb6f7-510b-43d0-90d0-f974bf353f02-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-ctqmr\" (UID: \"4cdbb6f7-510b-43d0-90d0-f974bf353f02\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:19.657780 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657665    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cdbb6f7-510b-43d0-90d0-f974bf353f02-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-ctqmr\" (UID: \"4cdbb6f7-510b-43d0-90d0-f974bf353f02\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:19.657780 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657693    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/de026d1d-2b60-499d-b723-b194b2053e6a-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.657780 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657695    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-wtmp\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.657780 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657733    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/de026d1d-2b60-499d-b723-b194b2053e6a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.657780 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657754    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-root\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.657780 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657760    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-sys\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.658271 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657796    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfhvq\" (UniqueName: \"kubernetes.io/projected/de026d1d-2b60-499d-b723-b194b2053e6a-kube-api-access-cfhvq\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.658271 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:19.657802    2571 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 15 11:38:19.658271 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657832    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2rwm\" (UniqueName: \"kubernetes.io/projected/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-kube-api-access-h2rwm\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.658271 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657862    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de026d1d-2b60-499d-b723-b194b2053e6a-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.658271 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:19.657890    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cdbb6f7-510b-43d0-90d0-f974bf353f02-openshift-state-metrics-tls podName:4cdbb6f7-510b-43d0-90d0-f974bf353f02 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:20.157867784 +0000 UTC m=+62.409424837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4cdbb6f7-510b-43d0-90d0-f974bf353f02-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-ctqmr" (UID: "4cdbb6f7-510b-43d0-90d0-f974bf353f02") : secret "openshift-state-metrics-tls" not found
Sep 15 11:38:19.658271 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657926    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cdbb6f7-510b-43d0-90d0-f974bf353f02-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-ctqmr\" (UID: \"4cdbb6f7-510b-43d0-90d0-f974bf353f02\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:19.658271 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657953    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-textfile\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.658271 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.657975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7mhh\" (UniqueName: \"kubernetes.io/projected/4cdbb6f7-510b-43d0-90d0-f974bf353f02-kube-api-access-s7mhh\") pod \"openshift-state-metrics-67dcf8c979-ctqmr\" (UID: \"4cdbb6f7-510b-43d0-90d0-f974bf353f02\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:19.658271 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.658000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-tls\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.658271 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.658017    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-sys\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.658271 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.658059    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-metrics-client-ca\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.658271 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.658096    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de026d1d-2b60-499d-b723-b194b2053e6a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.658271 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.658120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.658883 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.658440    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de026d1d-2b60-499d-b723-b194b2053e6a-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.658883 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.658450    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/de026d1d-2b60-499d-b723-b194b2053e6a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.658883 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:19.658536    2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 15 11:38:19.658883 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:19.658594    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-tls podName:7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:20.158577056 +0000 UTC m=+62.410134094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-tls") pod "node-exporter-vtsf4" (UID: "7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9") : secret "node-exporter-tls" not found
Sep 15 11:38:19.658883 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.658704    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cdbb6f7-510b-43d0-90d0-f974bf353f02-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-ctqmr\" (UID: \"4cdbb6f7-510b-43d0-90d0-f974bf353f02\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:19.658883 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.658709    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.659121 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.658907    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/de026d1d-2b60-499d-b723-b194b2053e6a-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.659121 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.658973    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-metrics-client-ca\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.660538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.660500    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cdbb6f7-510b-43d0-90d0-f974bf353f02-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-ctqmr\" (UID: \"4cdbb6f7-510b-43d0-90d0-f974bf353f02\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:19.660796 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.660775    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/de026d1d-2b60-499d-b723-b194b2053e6a-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.660860 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.660775    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.661110 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.661092    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de026d1d-2b60-499d-b723-b194b2053e6a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.672849 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.672777    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2rwm\" (UniqueName: \"kubernetes.io/projected/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-kube-api-access-h2rwm\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:19.673857 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.673834    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7mhh\" (UniqueName: \"kubernetes.io/projected/4cdbb6f7-510b-43d0-90d0-f974bf353f02-kube-api-access-s7mhh\") pod \"openshift-state-metrics-67dcf8c979-ctqmr\" (UID: \"4cdbb6f7-510b-43d0-90d0-f974bf353f02\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:19.675701 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.675678    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfhvq\" (UniqueName: \"kubernetes.io/projected/de026d1d-2b60-499d-b723-b194b2053e6a-kube-api-access-cfhvq\") pod \"kube-state-metrics-59fbdd77d-jhstw\" (UID: \"de026d1d-2b60-499d-b723-b194b2053e6a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.708039 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.708001    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:19.811195 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.811162    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:19.820132 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.820110    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"
Sep 15 11:38:19.921061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:19.921031    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:20.104804 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.104770    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw"]
Sep 15 11:38:20.107623 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:20.107597    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde026d1d_2b60_499d_b723_b194b2053e6a.slice/crio-9a67c66b4480b6564f5fb65028e28c5ce7f03ede8a74570434c5d1c9176eb019 WatchSource:0}: Error finding container 9a67c66b4480b6564f5fb65028e28c5ce7f03ede8a74570434c5d1c9176eb019: Status 404 returned error can't find the container with id 9a67c66b4480b6564f5fb65028e28c5ce7f03ede8a74570434c5d1c9176eb019
Sep 15 11:38:20.161412 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.161376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-tls\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:20.161780 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.161438    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cdbb6f7-510b-43d0-90d0-f974bf353f02-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-ctqmr\" (UID: \"4cdbb6f7-510b-43d0-90d0-f974bf353f02\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:20.162977 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.162950    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:20.163761 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.163742    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9-node-exporter-tls\") pod \"node-exporter-vtsf4\" (UID: \"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9\") " pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:20.163942 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.163926    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cdbb6f7-510b-43d0-90d0-f974bf353f02-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-ctqmr\" (UID: \"4cdbb6f7-510b-43d0-90d0-f974bf353f02\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:20.287396 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.287360    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:20.391939 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.391858    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"
Sep 15 11:38:20.435318 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.435283    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vtsf4"
Sep 15 11:38:20.446798 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:20.446770    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ddf3bbe_79ac_43bc_b3c4_9d869615d0a9.slice/crio-69c6f2b4bd67845dbdc2e54bc36da7c29981c2b9723c6815cbf644f098d84a42 WatchSource:0}: Error finding container 69c6f2b4bd67845dbdc2e54bc36da7c29981c2b9723c6815cbf644f098d84a42: Status 404 returned error can't find the container with id 69c6f2b4bd67845dbdc2e54bc36da7c29981c2b9723c6815cbf644f098d84a42
Sep 15 11:38:20.462802 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.462758    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:20.570523 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.570449    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vtsf4" event={"ID":"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9","Type":"ContainerStarted","Data":"69c6f2b4bd67845dbdc2e54bc36da7c29981c2b9723c6815cbf644f098d84a42"}
Sep 15 11:38:20.571711 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.571686    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw" event={"ID":"de026d1d-2b60-499d-b723-b194b2053e6a","Type":"ContainerStarted","Data":"9a67c66b4480b6564f5fb65028e28c5ce7f03ede8a74570434c5d1c9176eb019"}
Sep 15 11:38:20.579627 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.579597    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:20.580259 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.580240    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:38:20.583135 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.583117    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.588265 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.588241    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 11:38:20.588850 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.588770    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 11:38:20.588850 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.588790    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 11:38:20.591212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.591012    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 11:38:20.591212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.591062    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 11:38:20.591212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.591205    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 11:38:20.591431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.591407    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 11:38:20.591513 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.591407    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 11:38:20.591513 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.591507    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x6kxj\""
Sep 15 11:38:20.591609 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.591583    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 11:38:20.612478 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.612443    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:38:20.665203 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.665100    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.665203 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.665149    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7p77\" (UniqueName: \"kubernetes.io/projected/aadf3aeb-e233-40da-94d0-9fd0f00a993c-kube-api-access-x7p77\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.665203 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.665197    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aadf3aeb-e233-40da-94d0-9fd0f00a993c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.665461 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.665232    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aadf3aeb-e233-40da-94d0-9fd0f00a993c-config-out\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.665461 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.665263    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aadf3aeb-e233-40da-94d0-9fd0f00a993c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.665461 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.665294    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aadf3aeb-e233-40da-94d0-9fd0f00a993c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.665461 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.665321    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-config-volume\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.665461 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.665390    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.665461 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.665406    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.665461 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.665452    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.665804 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.665513    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.665804 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.665539    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-web-config\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.665804 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.665564    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aadf3aeb-e233-40da-94d0-9fd0f00a993c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.671887 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.671854    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr"]
Sep 15 11:38:20.677654 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:20.677622    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cdbb6f7_510b_43d0_90d0_f974bf353f02.slice/crio-e73be5b7c177c0a2cf10de75b75fd4ab3581d367f869959dddb441f38cdb8d67 WatchSource:0}: Error finding container e73be5b7c177c0a2cf10de75b75fd4ab3581d367f869959dddb441f38cdb8d67: Status 404 returned error can't find the container with id e73be5b7c177c0a2cf10de75b75fd4ab3581d367f869959dddb441f38cdb8d67
Sep 15 11:38:20.766525 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.766247    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aadf3aeb-e233-40da-94d0-9fd0f00a993c-config-out\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.766525 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.766303    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aadf3aeb-e233-40da-94d0-9fd0f00a993c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.766525 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.766345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aadf3aeb-e233-40da-94d0-9fd0f00a993c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.766525 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.766374    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-config-volume\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.766842 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.766685    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.766842 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.766724    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.766842 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.766802    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.766842 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.766837    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.767035 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.766851    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aadf3aeb-e233-40da-94d0-9fd0f00a993c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.767035 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.766862    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-web-config\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.767035 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.766995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aadf3aeb-e233-40da-94d0-9fd0f00a993c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.767148 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.767062    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.767402 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.767345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7p77\" (UniqueName: \"kubernetes.io/projected/aadf3aeb-e233-40da-94d0-9fd0f00a993c-kube-api-access-x7p77\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.768752 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.767510    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aadf3aeb-e233-40da-94d0-9fd0f00a993c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.768752 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.767831    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aadf3aeb-e233-40da-94d0-9fd0f00a993c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.768752 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.768528    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aadf3aeb-e233-40da-94d0-9fd0f00a993c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.769971 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.769943    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.770407 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.770365    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-web-config\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.771238 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.771194    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.771665 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.771637    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.772439 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.772395    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.772559 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.772538    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-config-volume\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.772781 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.772760    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aadf3aeb-e233-40da-94d0-9fd0f00a993c-config-out\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.774277 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.774236    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.774774 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.774753    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aadf3aeb-e233-40da-94d0-9fd0f00a993c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.778655 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.778630    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7p77\" (UniqueName: \"kubernetes.io/projected/aadf3aeb-e233-40da-94d0-9fd0f00a993c-kube-api-access-x7p77\") pod \"alertmanager-main-0\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.825365 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.825337    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:20.893872 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.893817    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:38:20.925484 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:20.925389    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:21.197984 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.197920    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:38:21.268398 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.268188    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cd44746d7-wr67z"]
Sep 15 11:38:21.270533 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.270508    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.278534 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.278505    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 15 11:38:21.283031 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.283002    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cd44746d7-wr67z"]
Sep 15 11:38:21.347500 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:21.347469    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaadf3aeb_e233_40da_94d0_9fd0f00a993c.slice/crio-6cc28b3d2eff2a122d1a5b992fb504a45f9fb2997832351cb984038dd4b72160 WatchSource:0}: Error finding container 6cc28b3d2eff2a122d1a5b992fb504a45f9fb2997832351cb984038dd4b72160: Status 404 returned error can't find the container with id 6cc28b3d2eff2a122d1a5b992fb504a45f9fb2997832351cb984038dd4b72160
Sep 15 11:38:21.374145 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.374096    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sphbw\" (UniqueName: \"kubernetes.io/projected/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-kube-api-access-sphbw\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.374360 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.374179    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-serving-cert\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.374360 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.374228    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-service-ca\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.374360 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.374250    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-trusted-ca-bundle\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.374360 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.374281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-config\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.374360 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.374315    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-oauth-config\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.374559 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.374403    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-oauth-serving-cert\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.475607 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.475508    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-oauth-config\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.475607 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.475607    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-oauth-serving-cert\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.475847 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.475677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sphbw\" (UniqueName: \"kubernetes.io/projected/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-kube-api-access-sphbw\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.475847 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.475711    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-serving-cert\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.475847 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.475749    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-service-ca\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.475847 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.475773    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-trusted-ca-bundle\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.475847 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.475807    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-config\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.476479 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.476448    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-config\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.476605 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.476491    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-oauth-serving-cert\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.476658 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.476631    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-service-ca\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.477119 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.477095    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-trusted-ca-bundle\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.478377 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.478358    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-oauth-config\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.479061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.479037    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-serving-cert\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.488022 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.487992    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sphbw\" (UniqueName: \"kubernetes.io/projected/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-kube-api-access-sphbw\") pod \"console-6cd44746d7-wr67z\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") " pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.576416 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.576375    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerStarted","Data":"6cc28b3d2eff2a122d1a5b992fb504a45f9fb2997832351cb984038dd4b72160"}
Sep 15 11:38:21.578082 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.578059    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr" event={"ID":"4cdbb6f7-510b-43d0-90d0-f974bf353f02","Type":"ContainerStarted","Data":"6260bc591288578d8dfc58867292ed374f81a1555b8579c7ff515a3ed44615cf"}
Sep 15 11:38:21.578189 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.578111    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr" event={"ID":"4cdbb6f7-510b-43d0-90d0-f974bf353f02","Type":"ContainerStarted","Data":"351c1a4049dac7ec26827ad2c1d0186df7f2582744a0358e8992219dbedc8fa3"}
Sep 15 11:38:21.578189 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.578131    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr" event={"ID":"4cdbb6f7-510b-43d0-90d0-f974bf353f02","Type":"ContainerStarted","Data":"e73be5b7c177c0a2cf10de75b75fd4ab3581d367f869959dddb441f38cdb8d67"}
Sep 15 11:38:21.582279 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.582260    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:21.884113 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:21.884079    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cd44746d7-wr67z"]
Sep 15 11:38:21.888722 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:21.887114    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bfeba80_f440_4f8c_8a12_4d263b1fddd4.slice/crio-08c5cecff144f123de131b0968ec47383e3cdcc897fd4362ca00f91c6326f7ce WatchSource:0}: Error finding container 08c5cecff144f123de131b0968ec47383e3cdcc897fd4362ca00f91c6326f7ce: Status 404 returned error can't find the container with id 08c5cecff144f123de131b0968ec47383e3cdcc897fd4362ca00f91c6326f7ce
Sep 15 11:38:22.379099 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.379064    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:22.439585 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.439551    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-548d966f65-4n9lm"]
Sep 15 11:38:22.454169 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.454124    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.461798 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.461766    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-lbxqq\""
Sep 15 11:38:22.461957 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.461942    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 15 11:38:22.462028 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.462013    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 15 11:38:22.462088 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.462061    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bn2547tf0qsem\""
Sep 15 11:38:22.462170 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.462019    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 15 11:38:22.462258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.462179    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 15 11:38:22.462884 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.462863    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 15 11:38:22.479696 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.479667    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-548d966f65-4n9lm"]
Sep 15 11:38:22.486227 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.486199    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h5mn\" (UniqueName: \"kubernetes.io/projected/0a42c349-5157-4e0c-a851-c6013a82d765-kube-api-access-5h5mn\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.486389 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.486337    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-tls\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.486389 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.486379    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.486480 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.486410    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.486480 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.486436    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.486480 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.486465    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.486614 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.486483    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a42c349-5157-4e0c-a851-c6013a82d765-metrics-client-ca\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.486614 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.486507    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-grpc-tls\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.505866 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.505824    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:22.584459 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.584418    2571 generic.go:356] "Generic (PLEG): container finished" podID="7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9" containerID="ba98dfd4733f0be391b6ebf11be42a1d3beb38a7c504fbbd936bb09d336e19eb" exitCode=0
Sep 15 11:38:22.584632 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.584517    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vtsf4" event={"ID":"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9","Type":"ContainerDied","Data":"ba98dfd4733f0be391b6ebf11be42a1d3beb38a7c504fbbd936bb09d336e19eb"}
Sep 15 11:38:22.586766 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.586685    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd44746d7-wr67z" event={"ID":"7bfeba80-f440-4f8c-8a12-4d263b1fddd4","Type":"ContainerStarted","Data":"ea149465cd84c9c0b0ebd89ad0fdc154e03ded8fbf3f18151c733b67efd8df06"}
Sep 15 11:38:22.586766 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.586737    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd44746d7-wr67z" event={"ID":"7bfeba80-f440-4f8c-8a12-4d263b1fddd4","Type":"ContainerStarted","Data":"08c5cecff144f123de131b0968ec47383e3cdcc897fd4362ca00f91c6326f7ce"}
Sep 15 11:38:22.587028 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.587006    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.587134 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.587038    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a42c349-5157-4e0c-a851-c6013a82d765-metrics-client-ca\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.587134 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.587063    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-grpc-tls\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.587134 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.587107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h5mn\" (UniqueName: \"kubernetes.io/projected/0a42c349-5157-4e0c-a851-c6013a82d765-kube-api-access-5h5mn\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.587337 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.587299    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-tls\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.587392 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.587335    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.587392 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.587366    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.587490 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.587389    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.588687 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.587909    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a42c349-5157-4e0c-a851-c6013a82d765-metrics-client-ca\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.590053 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.590019    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw" event={"ID":"de026d1d-2b60-499d-b723-b194b2053e6a","Type":"ContainerStarted","Data":"c6a8c4f69632dbf00054a34d1b25e878a14d6a0cff5090a53bfbe5e74c91dc33"}
Sep 15 11:38:22.590191 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.590098    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw" event={"ID":"de026d1d-2b60-499d-b723-b194b2053e6a","Type":"ContainerStarted","Data":"33fd1924c056a923a54164805e34a7f45cb50994cbf90d5d414d70c600d7150d"}
Sep 15 11:38:22.590191 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.590130    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw" event={"ID":"de026d1d-2b60-499d-b723-b194b2053e6a","Type":"ContainerStarted","Data":"1ca1f2b6f87b00720f96ab5e7196d797ca839d1bfd048dd40d2ca93955facc5e"}
Sep 15 11:38:22.590320 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.590247    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.590458 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.590435    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-tls\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.590528 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.590470    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.591208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.591136    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-grpc-tls\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.591355 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.591329    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.591948 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.591925    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0a42c349-5157-4e0c-a851-c6013a82d765-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.600578 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.600553    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h5mn\" (UniqueName: \"kubernetes.io/projected/0a42c349-5157-4e0c-a851-c6013a82d765-kube-api-access-5h5mn\") pod \"thanos-querier-548d966f65-4n9lm\" (UID: \"0a42c349-5157-4e0c-a851-c6013a82d765\") " pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.657857 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.657775    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:22.671489 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.671431    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cd44746d7-wr67z" podStartSLOduration=1.6714144690000001 podStartE2EDuration="1.671414469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:22.671222759 +0000 UTC m=+64.922779816" watchObservedRunningTime="2026-09-15 11:38:22.671414469 +0000 UTC m=+64.922971523"
Sep 15 11:38:22.671838 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.671816    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jhstw" podStartSLOduration=2.185692056 podStartE2EDuration="3.671807121s" totalImagesPullingTime="1.486115065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:22.648071535 +0000 UTC m=+64.899628591" watchObservedRunningTime="2026-09-15 11:38:22.671807121 +0000 UTC m=+64.923364169"
Sep 15 11:38:22.767223 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.767182    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:22.811719 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.811683    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:22.991983 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.991944    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs\") pod \"network-metrics-daemon-959p9\" (UID: \"52c718e0-4bf0-406b-9c49-1a5e120fcd43\") " pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:38:22.992141 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.991999    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:38:22.994664 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.994643    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 11:38:22.994761 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:22.994741    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 11:38:23.005009 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.004977    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52c718e0-4bf0-406b-9c49-1a5e120fcd43-metrics-certs\") pod \"network-metrics-daemon-959p9\" (UID: \"52c718e0-4bf0-406b-9c49-1a5e120fcd43\") " pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:38:23.005112 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.004989    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e7423e8a-7332-4124-82ce-92db8066e036-original-pull-secret\") pod \"global-pull-secret-syncer-25rqj\" (UID: \"e7423e8a-7332-4124-82ce-92db8066e036\") " pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:38:23.092900 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.092855    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967dm\" (UniqueName: \"kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm\") pod \"network-check-target-dd9x4\" (UID: \"fa09d17e-2f73-4047-9d04-031bec2e9927\") " pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:38:23.096004 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.095980    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 11:38:23.106730 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.106703    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 11:38:23.117451 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.117428    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-967dm\" (UniqueName: \"kubernetes.io/projected/fa09d17e-2f73-4047-9d04-031bec2e9927-kube-api-access-967dm\") pod \"network-check-target-dd9x4\" (UID: \"fa09d17e-2f73-4047-9d04-031bec2e9927\") " pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:38:23.222964 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.222945    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-72bfh\""
Sep 15 11:38:23.229481 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.229446    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:38:23.229674 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.229658    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w6k5p\""
Sep 15 11:38:23.233829 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.233813    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25rqj"
Sep 15 11:38:23.238117 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.238093    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-959p9"
Sep 15 11:38:23.427412 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.427269    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-548d966f65-4n9lm"]
Sep 15 11:38:23.439100 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:23.439068    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a42c349_5157_4e0c_a851_c6013a82d765.slice/crio-af40f29078d0ca6032052667e5e46a2e84f77f8bd85c42a5215f3105dd6af299 WatchSource:0}: Error finding container af40f29078d0ca6032052667e5e46a2e84f77f8bd85c42a5215f3105dd6af299: Status 404 returned error can't find the container with id af40f29078d0ca6032052667e5e46a2e84f77f8bd85c42a5215f3105dd6af299
Sep 15 11:38:23.539495 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.539396    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dd9x4"]
Sep 15 11:38:23.542490 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:23.542456    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa09d17e_2f73_4047_9d04_031bec2e9927.slice/crio-1ecc4553862e524c8505038719d3ffbf58e09accf79f13ae4b80f8eddf06e8cc WatchSource:0}: Error finding container 1ecc4553862e524c8505038719d3ffbf58e09accf79f13ae4b80f8eddf06e8cc: Status 404 returned error can't find the container with id 1ecc4553862e524c8505038719d3ffbf58e09accf79f13ae4b80f8eddf06e8cc
Sep 15 11:38:23.563781 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.563743    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-25rqj"]
Sep 15 11:38:23.566363 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:23.566332    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7423e8a_7332_4124_82ce_92db8066e036.slice/crio-29bdb2fe50ab1f671a8e96808cdd1372b9709b743786036ee5fa81be48552ff7 WatchSource:0}: Error finding container 29bdb2fe50ab1f671a8e96808cdd1372b9709b743786036ee5fa81be48552ff7: Status 404 returned error can't find the container with id 29bdb2fe50ab1f671a8e96808cdd1372b9709b743786036ee5fa81be48552ff7
Sep 15 11:38:23.584755 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.584723    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:23.584875 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.584843    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:23.589765 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.589742    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:23.596041 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.596011    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-25rqj" event={"ID":"e7423e8a-7332-4124-82ce-92db8066e036","Type":"ContainerStarted","Data":"29bdb2fe50ab1f671a8e96808cdd1372b9709b743786036ee5fa81be48552ff7"}
Sep 15 11:38:23.598135 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.598111    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vtsf4" event={"ID":"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9","Type":"ContainerStarted","Data":"6785f56170b89936a18a78513fcd2615d6962b5b354814619f0dc3436a328036"}
Sep 15 11:38:23.598284 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.598148    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vtsf4" event={"ID":"7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9","Type":"ContainerStarted","Data":"c1c92ae03dfd47dfda7665d61f6b6983090db2ebc61877b515ff3b627e3d8e0c"}
Sep 15 11:38:23.600268 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.600248    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr" event={"ID":"4cdbb6f7-510b-43d0-90d0-f974bf353f02","Type":"ContainerStarted","Data":"161d8884abbc517eecf592706dad760965d4c27bbb5b03b40f2e3928febd1ca1"}
Sep 15 11:38:23.601662 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.601638    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dd9x4" event={"ID":"fa09d17e-2f73-4047-9d04-031bec2e9927","Type":"ContainerStarted","Data":"1ecc4553862e524c8505038719d3ffbf58e09accf79f13ae4b80f8eddf06e8cc"}
Sep 15 11:38:23.603095 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.603075    2571 generic.go:356] "Generic (PLEG): container finished" podID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerID="6fa43af5b0310df6088989fa2ba706d5a6b590d1152fd38249ecacdfc6657f08" exitCode=0
Sep 15 11:38:23.603216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.603183    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerDied","Data":"6fa43af5b0310df6088989fa2ba706d5a6b590d1152fd38249ecacdfc6657f08"}
Sep 15 11:38:23.604440 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.604418    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm" event={"ID":"0a42c349-5157-4e0c-a851-c6013a82d765","Type":"ContainerStarted","Data":"af40f29078d0ca6032052667e5e46a2e84f77f8bd85c42a5215f3105dd6af299"}
Sep 15 11:38:23.608336 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.608317    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-959p9"]
Sep 15 11:38:23.608993 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.608957    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:38:23.619150 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:23.619124    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c718e0_4bf0_406b_9c49_1a5e120fcd43.slice/crio-3253202d9fb1c5fa02b52e4830dfbea291ff51b92d6dbd2c574ce685c66f9115 WatchSource:0}: Error finding container 3253202d9fb1c5fa02b52e4830dfbea291ff51b92d6dbd2c574ce685c66f9115: Status 404 returned error can't find the container with id 3253202d9fb1c5fa02b52e4830dfbea291ff51b92d6dbd2c574ce685c66f9115
Sep 15 11:38:23.680298 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.680241    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ctqmr" podStartSLOduration=2.372747706 podStartE2EDuration="4.680225311s" totalImagesPullingTime="2.307477605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:23.67934038 +0000 UTC m=+65.930897443" watchObservedRunningTime="2026-09-15 11:38:23.680225311 +0000 UTC m=+65.931782368"
Sep 15 11:38:23.709596 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.709549    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vtsf4" podStartSLOduration=3.468304436 podStartE2EDuration="4.709534404s" totalImagesPullingTime="1.146049795s" totalInitContainerRuntime="95.180173ms" isStatefulPod=true podCreationTimestamp="2026-09-15 11:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:23.707948903 +0000 UTC m=+65.959505961" watchObservedRunningTime="2026-09-15 11:38:23.709534404 +0000 UTC m=+65.961091460"
Sep 15 11:38:23.940186 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.940067    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:23.949603 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.949574    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6cb8d757ff-fb94k"]
Sep 15 11:38:23.954096 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.954075    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:23.956679 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.956658    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 15 11:38:23.957750 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.957708    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 15 11:38:23.957892 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.957779    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-73t9r9k8ko0g1\""
Sep 15 11:38:23.957892 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.957812    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-btnf9\""
Sep 15 11:38:23.957892 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.957863    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 15 11:38:23.958053 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.957942    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 15 11:38:23.963576 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:23.963554    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6cb8d757ff-fb94k"]
Sep 15 11:38:24.006939 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.006903    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/91dda7c6-9576-4326-b9ff-ae70437dfe0f-metrics-server-audit-profiles\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.006939 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.006941    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/91dda7c6-9576-4326-b9ff-ae70437dfe0f-secret-metrics-server-tls\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.007214 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.007000    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91dda7c6-9576-4326-b9ff-ae70437dfe0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.007214 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.007031    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91dda7c6-9576-4326-b9ff-ae70437dfe0f-client-ca-bundle\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.007214 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.007079    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/91dda7c6-9576-4326-b9ff-ae70437dfe0f-secret-metrics-server-client-certs\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.007214 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.007104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/91dda7c6-9576-4326-b9ff-ae70437dfe0f-audit-log\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.007214 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.007129    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89vfz\" (UniqueName: \"kubernetes.io/projected/91dda7c6-9576-4326-b9ff-ae70437dfe0f-kube-api-access-89vfz\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.042392 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.042351    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:24.081655 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.081622    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"]
Sep 15 11:38:24.085276 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.085245    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"
Sep 15 11:38:24.088814 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.088787    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bhqlv\""
Sep 15 11:38:24.088959 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.088894    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 15 11:38:24.096888 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.096863    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"]
Sep 15 11:38:24.109713 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.109684    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/91dda7c6-9576-4326-b9ff-ae70437dfe0f-metrics-server-audit-profiles\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.109887 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.109724    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/91dda7c6-9576-4326-b9ff-ae70437dfe0f-secret-metrics-server-tls\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.109887 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.109808    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b2997e6-4546-4050-ba96-8412f38ccee1-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-drxr6\" (UID: \"4b2997e6-4546-4050-ba96-8412f38ccee1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"
Sep 15 11:38:24.109887 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.109835    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkv8m\" (UniqueName: \"kubernetes.io/projected/4b2997e6-4546-4050-ba96-8412f38ccee1-kube-api-access-zkv8m\") pod \"monitoring-plugin-5d85778b9d-drxr6\" (UID: \"4b2997e6-4546-4050-ba96-8412f38ccee1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"
Sep 15 11:38:24.109887 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.109868    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91dda7c6-9576-4326-b9ff-ae70437dfe0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.110093 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.109894    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91dda7c6-9576-4326-b9ff-ae70437dfe0f-client-ca-bundle\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.110093 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.109955    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/91dda7c6-9576-4326-b9ff-ae70437dfe0f-secret-metrics-server-client-certs\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.110093 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.109983    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/91dda7c6-9576-4326-b9ff-ae70437dfe0f-audit-log\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.110093 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.110027    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89vfz\" (UniqueName: \"kubernetes.io/projected/91dda7c6-9576-4326-b9ff-ae70437dfe0f-kube-api-access-89vfz\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.110846 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.110816    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/91dda7c6-9576-4326-b9ff-ae70437dfe0f-metrics-server-audit-profiles\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.111011 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.110988    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91dda7c6-9576-4326-b9ff-ae70437dfe0f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.111078 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.111041    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/91dda7c6-9576-4326-b9ff-ae70437dfe0f-audit-log\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.113811 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.113766    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/91dda7c6-9576-4326-b9ff-ae70437dfe0f-secret-metrics-server-client-certs\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.118016 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.117940    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91dda7c6-9576-4326-b9ff-ae70437dfe0f-client-ca-bundle\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.118408 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.118364    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/91dda7c6-9576-4326-b9ff-ae70437dfe0f-secret-metrics-server-tls\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.121429 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.121401    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89vfz\" (UniqueName: \"kubernetes.io/projected/91dda7c6-9576-4326-b9ff-ae70437dfe0f-kube-api-access-89vfz\") pod \"metrics-server-6cb8d757ff-fb94k\" (UID: \"91dda7c6-9576-4326-b9ff-ae70437dfe0f\") " pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.140418 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.140356    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:24.211208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.210550    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b2997e6-4546-4050-ba96-8412f38ccee1-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-drxr6\" (UID: \"4b2997e6-4546-4050-ba96-8412f38ccee1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"
Sep 15 11:38:24.211208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.210594    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkv8m\" (UniqueName: \"kubernetes.io/projected/4b2997e6-4546-4050-ba96-8412f38ccee1-kube-api-access-zkv8m\") pod \"monitoring-plugin-5d85778b9d-drxr6\" (UID: \"4b2997e6-4546-4050-ba96-8412f38ccee1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"
Sep 15 11:38:24.211208 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:24.211015    2571 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 15 11:38:24.211208 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:24.211084    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b2997e6-4546-4050-ba96-8412f38ccee1-monitoring-plugin-cert podName:4b2997e6-4546-4050-ba96-8412f38ccee1 nodeName:}" failed. No retries permitted until 2026-09-15 11:38:24.711062266 +0000 UTC m=+66.962619308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/4b2997e6-4546-4050-ba96-8412f38ccee1-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-drxr6" (UID: "4b2997e6-4546-4050-ba96-8412f38ccee1") : secret "monitoring-plugin-cert" not found
Sep 15 11:38:24.229798 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.229731    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkv8m\" (UniqueName: \"kubernetes.io/projected/4b2997e6-4546-4050-ba96-8412f38ccee1-kube-api-access-zkv8m\") pod \"monitoring-plugin-5d85778b9d-drxr6\" (UID: \"4b2997e6-4546-4050-ba96-8412f38ccee1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"
Sep 15 11:38:24.264633 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.264291    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:24.356989 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.356948    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:24.552529 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.552452    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7t2f7"
Sep 15 11:38:24.591634 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.590406    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6cb8d757ff-fb94k"]
Sep 15 11:38:24.615110 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.615077    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-959p9" event={"ID":"52c718e0-4bf0-406b-9c49-1a5e120fcd43","Type":"ContainerStarted","Data":"3253202d9fb1c5fa02b52e4830dfbea291ff51b92d6dbd2c574ce685c66f9115"}
Sep 15 11:38:24.688954 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.687308    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5f4f899dc-txt4g"]
Sep 15 11:38:24.692871 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.692803    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.697250 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.697221    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 15 11:38:24.697809 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.697788    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 15 11:38:24.698182 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.698164    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 15 11:38:24.698958 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.698940    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 15 11:38:24.699559 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.699534    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 15 11:38:24.700987 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.700598    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fqhf9\""
Sep 15 11:38:24.715195 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.711518    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f4f899dc-txt4g"]
Sep 15 11:38:24.716110 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.716079    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 15 11:38:24.716322 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.716297    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-serving-certs-ca-bundle\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.716399 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.716345    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-secret-telemeter-client\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.716456 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.716412    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-telemeter-client-tls\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.717421 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.717397    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b2997e6-4546-4050-ba96-8412f38ccee1-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-drxr6\" (UID: \"4b2997e6-4546-4050-ba96-8412f38ccee1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"
Sep 15 11:38:24.717580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.717563    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.719025 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.717851    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-federate-client-tls\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.719025 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.717929    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.719025 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.718010    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btn7b\" (UniqueName: \"kubernetes.io/projected/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-kube-api-access-btn7b\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.719025 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.718069    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-metrics-client-ca\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.720813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.720788    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b2997e6-4546-4050-ba96-8412f38ccee1-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-drxr6\" (UID: \"4b2997e6-4546-4050-ba96-8412f38ccee1\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"
Sep 15 11:38:24.745055 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.744987    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:24.829472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.819020    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.829472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.819109    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-federate-client-tls\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.829472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.819145    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.829472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.819204    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btn7b\" (UniqueName: \"kubernetes.io/projected/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-kube-api-access-btn7b\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.829472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.819234    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-metrics-client-ca\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.829472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.819283    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-serving-certs-ca-bundle\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.829472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.819320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-secret-telemeter-client\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.829472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.819344    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-telemeter-client-tls\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.829472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.821108    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.829472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.821882    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-serving-certs-ca-bundle\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.829472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.822487    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-metrics-client-ca\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.829472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.825234    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-secret-telemeter-client\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.829472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.826560    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-telemeter-client-tls\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.833020 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.832987    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.833698 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.833635    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-federate-client-tls\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.837273 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.837219    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btn7b\" (UniqueName: \"kubernetes.io/projected/e0bbd6bf-4d12-4e0d-b99e-9de526307cfd-kube-api-access-btn7b\") pod \"telemeter-client-5f4f899dc-txt4g\" (UID: \"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd\") " pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:24.846641 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.846573    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:24.998379 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:24.998102    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"
Sep 15 11:38:25.038139 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.038086    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g"
Sep 15 11:38:25.290341 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.289539    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cd44746d7-wr67z"]
Sep 15 11:38:25.311090 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.311055    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:25.334114 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.334075    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7755df8f66-pkqx6"]
Sep 15 11:38:25.337951 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.337927    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.352538 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.352506    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7755df8f66-pkqx6"]
Sep 15 11:38:25.398106 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.398072    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:25.424212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.423851    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-config\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.424212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.423897    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-service-ca\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.424212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.423936    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-trusted-ca-bundle\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.424212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.424033    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-serving-cert\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.424212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.424074    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-oauth-serving-cert\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.424212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.424099    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nrpl\" (UniqueName: \"kubernetes.io/projected/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-kube-api-access-4nrpl\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.424212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.424148    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-oauth-config\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.525710 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.525649    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-config\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.525710 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.525694    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-service-ca\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.525951 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.525730    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-trusted-ca-bundle\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.525951 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.525800    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-serving-cert\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.525951 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.525841    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-oauth-serving-cert\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.525951 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.525865    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nrpl\" (UniqueName: \"kubernetes.io/projected/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-kube-api-access-4nrpl\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.525951 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.525906    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-oauth-config\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.527808 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.526860    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-config\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.527808 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.527272    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-service-ca\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.527808 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.527431    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-oauth-serving-cert\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.527998 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.527931    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-trusted-ca-bundle\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.530859 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.530808    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-oauth-config\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.532133 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.532110    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-serving-cert\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.539747 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.539724    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nrpl\" (UniqueName: \"kubernetes.io/projected/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-kube-api-access-4nrpl\") pod \"console-7755df8f66-pkqx6\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") " pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.653608 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.653571    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:25.859101 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.857023    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:38:25.863356 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.863255    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.872378    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.872643    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.872873    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.872933    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.873132    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.873259    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.873287    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.872883    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.873439    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.873752    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.874080    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9mtvv1496r916\""
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.874353    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.874556    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 15 11:38:25.879410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.879277    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 15 11:38:25.882948 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.882916    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tvrvj\""
Sep 15 11:38:25.886819 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.886727    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:25.887251 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.887229    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 15 11:38:25.907296 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.907010    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:38:25.930806 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.930712    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.930806 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.930766    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.931057 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.930920    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.931283 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.931248    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.931383 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.931364    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.931459 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.931394    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932056 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.931624    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94d67ff2-2493-4269-9f32-fd9eaae02e5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932056 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.931674    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932056 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.931874    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932056 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.931905    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932056 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.931932    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcjxb\" (UniqueName: \"kubernetes.io/projected/94d67ff2-2493-4269-9f32-fd9eaae02e5a-kube-api-access-tcjxb\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932056 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.931976    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932056 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.932005    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932056 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.932029    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94d67ff2-2493-4269-9f32-fd9eaae02e5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932479 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.932056    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932479 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.932205    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932479 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.932234    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932479 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.932262    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-config\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932479 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.932286    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:25.932479 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:25.932369    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.032946 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.032908    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033106 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.032998    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033106 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033043    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-config\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033106 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033288 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033126    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033288 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033148    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033288 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033200    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033288 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033243    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033288 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033268    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033467 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033295    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033467 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033467 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033377    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94d67ff2-2493-4269-9f32-fd9eaae02e5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033467 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033467 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033452    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033627 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033476    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033627 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033502    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcjxb\" (UniqueName: \"kubernetes.io/projected/94d67ff2-2493-4269-9f32-fd9eaae02e5a-kube-api-access-tcjxb\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033627 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033536    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033627 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033568    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033627 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033596    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94d67ff2-2493-4269-9f32-fd9eaae02e5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.033627 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.033620    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.034260 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.034230    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.039142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.039107    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.040384 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.040357    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.041010 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.040984    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.041937 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.041910    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.042718 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.042685    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.043220 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.043199    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.046266 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.045745    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.050019 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.049993    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.050882 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.050853    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.051018 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.050993    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcjxb\" (UniqueName: \"kubernetes.io/projected/94d67ff2-2493-4269-9f32-fd9eaae02e5a-kube-api-access-tcjxb\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.051237 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.051219    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.054066 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.054038    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.055499 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.055451    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94d67ff2-2493-4269-9f32-fd9eaae02e5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.056063 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.055692    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-config\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.061134 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.061104    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.061819 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.061707    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.061819 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.061742    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94d67ff2-2493-4269-9f32-fd9eaae02e5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.062446 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.062377    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.063065 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.063041    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.184622 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.184434    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:26.626607 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:26.626533    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k" event={"ID":"91dda7c6-9576-4326-b9ff-ae70437dfe0f","Type":"ContainerStarted","Data":"6a9e6589db1ff5c67b756e08a3d66656e028179a6c3f447ebb582b43967d2027"}
Sep 15 11:38:27.319903 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:27.319863    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:27.373698 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:27.373661    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:27.707878 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:27.707848    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:27.808533 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:27.808468    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:27.909879 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:27.909841    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:27.972097 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:27.971981    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"]
Sep 15 11:38:28.682362 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:28.682326    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:28.778699 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:28.778658    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:29.121768 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:29.121744    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2997e6_4546_4050_ba96_8412f38ccee1.slice/crio-791966eb6efef44b492d957b27b5935a4776801c21e3c5e4f295e082be6f3b60 WatchSource:0}: Error finding container 791966eb6efef44b492d957b27b5935a4776801c21e3c5e4f295e082be6f3b60: Status 404 returned error can't find the container with id 791966eb6efef44b492d957b27b5935a4776801c21e3c5e4f295e082be6f3b60
Sep 15 11:38:29.413785 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:29.413752    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f4f899dc-txt4g"]
Sep 15 11:38:29.527830 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:29.527792    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0bbd6bf_4d12_4e0d_b99e_9de526307cfd.slice/crio-bf86685afd73b41d4f80edcc16d749dcff742efbe0068603c07782eb4cbb376b WatchSource:0}: Error finding container bf86685afd73b41d4f80edcc16d749dcff742efbe0068603c07782eb4cbb376b: Status 404 returned error can't find the container with id bf86685afd73b41d4f80edcc16d749dcff742efbe0068603c07782eb4cbb376b
Sep 15 11:38:29.659540 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:29.659506    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g" event={"ID":"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd","Type":"ContainerStarted","Data":"bf86685afd73b41d4f80edcc16d749dcff742efbe0068603c07782eb4cbb376b"}
Sep 15 11:38:29.661841 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:29.661784    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6" event={"ID":"4b2997e6-4546-4050-ba96-8412f38ccee1","Type":"ContainerStarted","Data":"791966eb6efef44b492d957b27b5935a4776801c21e3c5e4f295e082be6f3b60"}
Sep 15 11:38:29.808087 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:29.807914    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7755df8f66-pkqx6"]
Sep 15 11:38:29.814047 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:29.813994    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f2dd6c_5f15_4f72_a38d_b49717ab4c55.slice/crio-7451af5b90afc02b8b54df2cef53dc5c351124ce13cfbfefea565527e4ae5983 WatchSource:0}: Error finding container 7451af5b90afc02b8b54df2cef53dc5c351124ce13cfbfefea565527e4ae5983: Status 404 returned error can't find the container with id 7451af5b90afc02b8b54df2cef53dc5c351124ce13cfbfefea565527e4ae5983
Sep 15 11:38:29.893165 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:29.893070    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d67ff2_2493_4269_9f32_fd9eaae02e5a.slice/crio-62050ab0395f46b510e744868f7ec57ff0d975fa6fd610bff3a8b57cfbf46419 WatchSource:0}: Error finding container 62050ab0395f46b510e744868f7ec57ff0d975fa6fd610bff3a8b57cfbf46419: Status 404 returned error can't find the container with id 62050ab0395f46b510e744868f7ec57ff0d975fa6fd610bff3a8b57cfbf46419
Sep 15 11:38:29.900594 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:29.900571    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:38:30.682448 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.682398    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-25rqj" event={"ID":"e7423e8a-7332-4124-82ce-92db8066e036","Type":"ContainerStarted","Data":"8b47eba3ea0db99a9aa0f98c433106a8443466ee5a137565e4791a7414634cad"}
Sep 15 11:38:30.685785 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.685743    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dd9x4" event={"ID":"fa09d17e-2f73-4047-9d04-031bec2e9927","Type":"ContainerStarted","Data":"c966a2b7addf98870ee537e3d8c16516b144247dbcf77ee167f0e45ab1f842a2"}
Sep 15 11:38:30.685967 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.685844    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:38:30.689326 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.689284    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-959p9" event={"ID":"52c718e0-4bf0-406b-9c49-1a5e120fcd43","Type":"ContainerStarted","Data":"8828a22f7315e4646f31c8e9665b72ade7d88d7bc8f08cc4d47d93a4227f076a"}
Sep 15 11:38:30.689501 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.689356    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-959p9" event={"ID":"52c718e0-4bf0-406b-9c49-1a5e120fcd43","Type":"ContainerStarted","Data":"17228851d22f76f6ef2b883f5295c5faea3d06fdbfd9a7b0b88bc161f0d999ac"}
Sep 15 11:38:30.692401 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.692372    2571 generic.go:356] "Generic (PLEG): container finished" podID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerID="a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f" exitCode=0
Sep 15 11:38:30.693483 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.692592    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerDied","Data":"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"}
Sep 15 11:38:30.693880 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.693861    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerStarted","Data":"62050ab0395f46b510e744868f7ec57ff0d975fa6fd610bff3a8b57cfbf46419"}
Sep 15 11:38:30.697080 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.697056    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k" event={"ID":"91dda7c6-9576-4326-b9ff-ae70437dfe0f","Type":"ContainerStarted","Data":"804b2d3c5e8ae02cf96a37c8e53c449cfb9bcaca691012fff180e37e90a442eb"}
Sep 15 11:38:30.700279 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.700254    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7755df8f66-pkqx6" event={"ID":"27f2dd6c-5f15-4f72-a38d-b49717ab4c55","Type":"ContainerStarted","Data":"c123d891e8bdbd0a53bd284f7b75d1b896bd9b719216471b3803f784dbc6cf9b"}
Sep 15 11:38:30.700454 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.700437    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7755df8f66-pkqx6" event={"ID":"27f2dd6c-5f15-4f72-a38d-b49717ab4c55","Type":"ContainerStarted","Data":"7451af5b90afc02b8b54df2cef53dc5c351124ce13cfbfefea565527e4ae5983"}
Sep 15 11:38:30.702977 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.702865    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-25rqj" podStartSLOduration=66.695099119 podStartE2EDuration="1m12.702850897s" totalImagesPullingTime="6.007751778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 11:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:30.700928655 +0000 UTC m=+72.952485726" watchObservedRunningTime="2026-09-15 11:38:30.702850897 +0000 UTC m=+72.954407951"
Sep 15 11:38:30.710244 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.710198    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerStarted","Data":"5738cfa981b72e207deef38c1195a5270d5c2b9bcf6abb272bcca84363251dc0"}
Sep 15 11:38:30.710417 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.710300    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerStarted","Data":"c561ed7c410731aa349b2dacff886bad8181fe7b154a4a988fa95ff8817b4fb8"}
Sep 15 11:38:30.710417 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.710347    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerStarted","Data":"e5e0f4ffc4c3b49678abfd7df8443d125353af167ebe8464d60baddb070f5069"}
Sep 15 11:38:30.710417 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.710388    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerStarted","Data":"2578f70632241b5cf1f28f3e62e7e7b46d2e3a74e0ac69558294e81c5fdbb838"}
Sep 15 11:38:30.710619 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.710423    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerStarted","Data":"fa5a01c296f7c2f208c04cbc97243174d13fae15bd4027fbdd684f52ac551a4e"}
Sep 15 11:38:30.714230 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.714025    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm" event={"ID":"0a42c349-5157-4e0c-a851-c6013a82d765","Type":"ContainerStarted","Data":"2410a8fc95636eb2658b925c659b66e65f8a1b97eb5d28dc79967e2ce2e603a3"}
Sep 15 11:38:30.714230 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.714110    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm" event={"ID":"0a42c349-5157-4e0c-a851-c6013a82d765","Type":"ContainerStarted","Data":"7f51d2903eafd47537c765ab86331ea6e227908d26c37268b4a5a3628af74ac1"}
Sep 15 11:38:30.714230 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.714149    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm" event={"ID":"0a42c349-5157-4e0c-a851-c6013a82d765","Type":"ContainerStarted","Data":"466f7f3bf539c7d07552c0117a40345ec5c3fdcafeba759c9f2244efb1bbe8ce"}
Sep 15 11:38:30.755692 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.755588    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k" podStartSLOduration=3.86870598 podStartE2EDuration="7.755562098s" totalImagesPullingTime="3.886856118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:30.752788518 +0000 UTC m=+73.004345603" watchObservedRunningTime="2026-09-15 11:38:30.755562098 +0000 UTC m=+73.007119156"
Sep 15 11:38:30.774282 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.774218    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7755df8f66-pkqx6" podStartSLOduration=5.774195153 podStartE2EDuration="5.774195153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:30.771872532 +0000 UTC m=+73.023429603" watchObservedRunningTime="2026-09-15 11:38:30.774195153 +0000 UTC m=+73.025752210"
Sep 15 11:38:30.794993 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.794914    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-959p9" podStartSLOduration=68.712091726 podStartE2EDuration="1m12.794895117s" totalImagesPullingTime="4.082803391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:30.793458707 +0000 UTC m=+73.045015764" watchObservedRunningTime="2026-09-15 11:38:30.794895117 +0000 UTC m=+73.046452174"
Sep 15 11:38:30.819104 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.819032    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dd9x4" podStartSLOduration=66.802904025 podStartE2EDuration="1m12.81900903s" totalImagesPullingTime="6.016105005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:30.817105319 +0000 UTC m=+73.068662371" watchObservedRunningTime="2026-09-15 11:38:30.81900903 +0000 UTC m=+73.070566078"
Sep 15 11:38:30.961588 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:30.961550    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:31.061198 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:31.061140    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:31.583205 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:31.583102    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:31.722179 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:31.722123    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6" event={"ID":"4b2997e6-4546-4050-ba96-8412f38ccee1","Type":"ContainerStarted","Data":"110212fffd624e70992b0f0e17bcaa351840e92a3770e59bbc9927a14d92cbd0"}
Sep 15 11:38:31.722342 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:31.722206    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"
Sep 15 11:38:31.728256 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:31.728219    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerStarted","Data":"134eefdd88a8b3c65067942225c712a9b0636a435ee5a9fa93f9981348de7c49"}
Sep 15 11:38:31.729272 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:31.729250    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6"
Sep 15 11:38:31.732534 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:31.732375    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm" event={"ID":"0a42c349-5157-4e0c-a851-c6013a82d765","Type":"ContainerStarted","Data":"07affd733dedfcf8e400f6263eff2fadbaa3fb9bf47959a608ee20b70f8ab03b"}
Sep 15 11:38:31.732534 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:31.732443    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm" event={"ID":"0a42c349-5157-4e0c-a851-c6013a82d765","Type":"ContainerStarted","Data":"592e9eb8786e9a56effc2892653afe51769f93e7e0be691fb2fef4ad7c7fc667"}
Sep 15 11:38:31.732534 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:31.732484    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm" event={"ID":"0a42c349-5157-4e0c-a851-c6013a82d765","Type":"ContainerStarted","Data":"4852ae3e6fa5cb5e880d7410f53d9bf22765c45265f4bb3060dfa2f2dc54912a"}
Sep 15 11:38:31.747371 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:31.747307    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-drxr6" podStartSLOduration=5.82228976 podStartE2EDuration="7.747284537s" totalImagesPullingTime="1.924994777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:31.744289259 +0000 UTC m=+73.995846316" watchObservedRunningTime="2026-09-15 11:38:31.747284537 +0000 UTC m=+73.998841594"
Sep 15 11:38:31.787312 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:31.787218    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.596190474 podStartE2EDuration="11.787198657s" totalImagesPullingTime="8.169721909s" totalInitContainerRuntime="21.286274ms" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:31.77929751 +0000 UTC m=+74.030854568" watchObservedRunningTime="2026-09-15 11:38:31.787198657 +0000 UTC m=+74.038755713"
Sep 15 11:38:31.841884 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:31.841770    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm" podStartSLOduration=3.072824849 podStartE2EDuration="9.841744654s" totalImagesPullingTime="6.768919805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:31.839546685 +0000 UTC m=+74.091103743" watchObservedRunningTime="2026-09-15 11:38:31.841744654 +0000 UTC m=+74.093301713"
Sep 15 11:38:32.143087 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:32.143061    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:32.243680 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:32.243611    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:32.740812 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:32.740773    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g" event={"ID":"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd","Type":"ContainerStarted","Data":"f1de9e76375f1d4e45e64b29b54da140c5b60679783362070e2559683374e8c6"}
Sep 15 11:38:32.740969 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:32.740847    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g" event={"ID":"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd","Type":"ContainerStarted","Data":"06cf2ce95901ac1316a43a2813a8b9992d72f3433431dc7838e6c4b573765c24"}
Sep 15 11:38:32.740969 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:32.740883    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g" event={"ID":"e0bbd6bf-4d12-4e0d-b99e-9de526307cfd","Type":"ContainerStarted","Data":"e2163304e4fcf256d503c55df75de4134aa0cc73d096cc41b928415752d152d3"}
Sep 15 11:38:32.741613 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:32.741559    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:32.770170 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:32.770031    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5f4f899dc-txt4g" podStartSLOduration=6.378048784 podStartE2EDuration="8.770004892s" totalImagesPullingTime="2.391956108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:32.768082054 +0000 UTC m=+75.019639125" watchObservedRunningTime="2026-09-15 11:38:32.770004892 +0000 UTC m=+75.021561969"
Sep 15 11:38:32.901181 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:32.901135    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7755df8f66-pkqx6"]
Sep 15 11:38:32.938011 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:32.937976    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d7489fb4-7skb5"]
Sep 15 11:38:32.942665 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:32.942639    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:32.951820 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:32.951792    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7489fb4-7skb5"]
Sep 15 11:38:33.016372 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.016288    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-service-ca\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.016372 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.016336    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-console-config\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.016578 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.016371    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4pzr\" (UniqueName: \"kubernetes.io/projected/82d0272a-1f6e-4051-8616-af3a1789c22c-kube-api-access-k4pzr\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.016578 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.016406    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-trusted-ca-bundle\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.016578 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.016478    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82d0272a-1f6e-4051-8616-af3a1789c22c-console-serving-cert\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.016578 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.016560    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82d0272a-1f6e-4051-8616-af3a1789c22c-console-oauth-config\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.016821 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.016629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-oauth-serving-cert\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.117577 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.117534    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4pzr\" (UniqueName: \"kubernetes.io/projected/82d0272a-1f6e-4051-8616-af3a1789c22c-kube-api-access-k4pzr\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.117764 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.117596    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-trusted-ca-bundle\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.117832 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.117775    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82d0272a-1f6e-4051-8616-af3a1789c22c-console-serving-cert\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.117887 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.117855    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82d0272a-1f6e-4051-8616-af3a1789c22c-console-oauth-config\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.117969 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.117894    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-oauth-serving-cert\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.118018 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.117984    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-service-ca\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.118068 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.118019    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-console-config\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.118578 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.118503    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-trusted-ca-bundle\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.118706 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.118592    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-oauth-serving-cert\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.118766 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.118713    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-console-config\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.118766 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.118732    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-service-ca\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.120515 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.120495    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82d0272a-1f6e-4051-8616-af3a1789c22c-console-oauth-config\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.120662 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.120645    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82d0272a-1f6e-4051-8616-af3a1789c22c-console-serving-cert\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.126184 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.126133    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4pzr\" (UniqueName: \"kubernetes.io/projected/82d0272a-1f6e-4051-8616-af3a1789c22c-kube-api-access-k4pzr\") pod \"console-7d7489fb4-7skb5\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") " pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:33.256682 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:33.256634    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:34.002457 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:34.002366    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7489fb4-7skb5"]
Sep 15 11:38:34.007305 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:38:34.006256    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82d0272a_1f6e_4051_8616_af3a1789c22c.slice/crio-2b917799dc29c967e6b0812d6b3dee526086e5ddef617fb059ad8802f5816983 WatchSource:0}: Error finding container 2b917799dc29c967e6b0812d6b3dee526086e5ddef617fb059ad8802f5816983: Status 404 returned error can't find the container with id 2b917799dc29c967e6b0812d6b3dee526086e5ddef617fb059ad8802f5816983
Sep 15 11:38:34.757236 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:34.757198    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerStarted","Data":"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"}
Sep 15 11:38:34.757397 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:34.757265    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerStarted","Data":"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"}
Sep 15 11:38:34.757397 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:34.757306    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerStarted","Data":"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"}
Sep 15 11:38:34.757397 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:34.757342    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerStarted","Data":"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"}
Sep 15 11:38:34.757397 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:34.757374    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerStarted","Data":"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"}
Sep 15 11:38:34.757576 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:34.757412    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerStarted","Data":"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"}
Sep 15 11:38:34.758783 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:34.758759    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7489fb4-7skb5" event={"ID":"82d0272a-1f6e-4051-8616-af3a1789c22c","Type":"ContainerStarted","Data":"41ae63e6603a25dceceb67374965a2071fc110f034f6de18b1a0ff23786f2eb7"}
Sep 15 11:38:34.758870 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:34.758798    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7489fb4-7skb5" event={"ID":"82d0272a-1f6e-4051-8616-af3a1789c22c","Type":"ContainerStarted","Data":"2b917799dc29c967e6b0812d6b3dee526086e5ddef617fb059ad8802f5816983"}
Sep 15 11:38:34.793219 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:34.793170    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.663479734 podStartE2EDuration="9.793139111s" totalImagesPullingTime="3.101101218s" totalInitContainerRuntime="28.558159ms" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:34.790802886 +0000 UTC m=+77.042359982" watchObservedRunningTime="2026-09-15 11:38:34.793139111 +0000 UTC m=+77.044696167"
Sep 15 11:38:34.809562 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:34.809507    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d7489fb4-7skb5" podStartSLOduration=2.809489443 podStartE2EDuration="2.809489443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:38:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:38:34.807898849 +0000 UTC m=+77.059455918" watchObservedRunningTime="2026-09-15 11:38:34.809489443 +0000 UTC m=+77.061046503"
Sep 15 11:38:35.266345 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:35.266310    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:35.367746 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:35.367705    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:35.654800 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:35.654728    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:36.185167 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:36.185131    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:38:37.757421 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:37.757372    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:37.860205 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:37.860174    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:38.756148 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:38.756121    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-548d966f65-4n9lm"
Sep 15 11:38:39.937384 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:39.937351    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:39.996933 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:39.996875    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:43.257514 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:43.257390    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:43.257514 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:43.257456    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:43.262527 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:43.262502    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:43.801446 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:43.801417    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:38:43.857400 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:43.857366    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-795b6fdc8b-x2q2w"]
Sep 15 11:38:43.983465 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:43.983432    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:44.103088 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:44.103015    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:44.202526 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:44.202491    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:44.265300 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:44.265242    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:44.265300 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:44.265316    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:38:50.314813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.314767    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6cd44746d7-wr67z" podUID="7bfeba80-f440-4f8c-8a12-4d263b1fddd4" containerName="console" containerID="cri-o://ea149465cd84c9c0b0ebd89ad0fdc154e03ded8fbf3f18151c733b67efd8df06" gracePeriod=15
Sep 15 11:38:50.557745 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.557719    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:50.579774 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.579682    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-trusted-ca-bundle\") pod \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") "
Sep 15 11:38:50.579923 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.579840    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-serving-cert\") pod \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") "
Sep 15 11:38:50.579923 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.579876    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sphbw\" (UniqueName: \"kubernetes.io/projected/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-kube-api-access-sphbw\") pod \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") "
Sep 15 11:38:50.579923 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.579913    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-service-ca\") pod \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") "
Sep 15 11:38:50.580069 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.579952    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-oauth-serving-cert\") pod \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") "
Sep 15 11:38:50.580069 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.580025    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-config\") pod \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") "
Sep 15 11:38:50.580069 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.580063    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-oauth-config\") pod \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\" (UID: \"7bfeba80-f440-4f8c-8a12-4d263b1fddd4\") "
Sep 15 11:38:50.580246 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.580129    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7bfeba80-f440-4f8c-8a12-4d263b1fddd4" (UID: "7bfeba80-f440-4f8c-8a12-4d263b1fddd4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:38:50.580418 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.580389    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-trusted-ca-bundle\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:50.580582 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.580500    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-service-ca" (OuterVolumeSpecName: "service-ca") pod "7bfeba80-f440-4f8c-8a12-4d263b1fddd4" (UID: "7bfeba80-f440-4f8c-8a12-4d263b1fddd4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:38:50.580691 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.580637    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7bfeba80-f440-4f8c-8a12-4d263b1fddd4" (UID: "7bfeba80-f440-4f8c-8a12-4d263b1fddd4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:38:50.580743 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.580712    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-config" (OuterVolumeSpecName: "console-config") pod "7bfeba80-f440-4f8c-8a12-4d263b1fddd4" (UID: "7bfeba80-f440-4f8c-8a12-4d263b1fddd4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:38:50.582729 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.582700    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-kube-api-access-sphbw" (OuterVolumeSpecName: "kube-api-access-sphbw") pod "7bfeba80-f440-4f8c-8a12-4d263b1fddd4" (UID: "7bfeba80-f440-4f8c-8a12-4d263b1fddd4"). InnerVolumeSpecName "kube-api-access-sphbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:38:50.582824 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.582758    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7bfeba80-f440-4f8c-8a12-4d263b1fddd4" (UID: "7bfeba80-f440-4f8c-8a12-4d263b1fddd4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:38:50.582922 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.582900    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7bfeba80-f440-4f8c-8a12-4d263b1fddd4" (UID: "7bfeba80-f440-4f8c-8a12-4d263b1fddd4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:38:50.681571 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.681536    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-serving-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:50.681571 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.681563    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sphbw\" (UniqueName: \"kubernetes.io/projected/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-kube-api-access-sphbw\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:50.681571 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.681574    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:50.681795 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.681583    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-oauth-serving-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:50.681795 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.681593    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:50.681795 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.681601    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bfeba80-f440-4f8c-8a12-4d263b1fddd4-console-oauth-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:50.829532 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.829494    2571 generic.go:356] "Generic (PLEG): container finished" podID="7bfeba80-f440-4f8c-8a12-4d263b1fddd4" containerID="ea149465cd84c9c0b0ebd89ad0fdc154e03ded8fbf3f18151c733b67efd8df06" exitCode=0
Sep 15 11:38:50.829688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.829538    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd44746d7-wr67z"
Sep 15 11:38:50.829688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.829579    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd44746d7-wr67z" event={"ID":"7bfeba80-f440-4f8c-8a12-4d263b1fddd4","Type":"ContainerDied","Data":"ea149465cd84c9c0b0ebd89ad0fdc154e03ded8fbf3f18151c733b67efd8df06"}
Sep 15 11:38:50.829688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.829630    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd44746d7-wr67z" event={"ID":"7bfeba80-f440-4f8c-8a12-4d263b1fddd4","Type":"ContainerDied","Data":"08c5cecff144f123de131b0968ec47383e3cdcc897fd4362ca00f91c6326f7ce"}
Sep 15 11:38:50.829688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.829660    2571 scope.go:117] "RemoveContainer" containerID="ea149465cd84c9c0b0ebd89ad0fdc154e03ded8fbf3f18151c733b67efd8df06"
Sep 15 11:38:50.838439 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.838418    2571 scope.go:117] "RemoveContainer" containerID="ea149465cd84c9c0b0ebd89ad0fdc154e03ded8fbf3f18151c733b67efd8df06"
Sep 15 11:38:50.838696 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:50.838676    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea149465cd84c9c0b0ebd89ad0fdc154e03ded8fbf3f18151c733b67efd8df06\": container with ID starting with ea149465cd84c9c0b0ebd89ad0fdc154e03ded8fbf3f18151c733b67efd8df06 not found: ID does not exist" containerID="ea149465cd84c9c0b0ebd89ad0fdc154e03ded8fbf3f18151c733b67efd8df06"
Sep 15 11:38:50.838767 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.838704    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea149465cd84c9c0b0ebd89ad0fdc154e03ded8fbf3f18151c733b67efd8df06"} err="failed to get container status \"ea149465cd84c9c0b0ebd89ad0fdc154e03ded8fbf3f18151c733b67efd8df06\": rpc error: code = NotFound desc = could not find container \"ea149465cd84c9c0b0ebd89ad0fdc154e03ded8fbf3f18151c733b67efd8df06\": container with ID starting with ea149465cd84c9c0b0ebd89ad0fdc154e03ded8fbf3f18151c733b67efd8df06 not found: ID does not exist"
Sep 15 11:38:50.852563 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.852539    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cd44746d7-wr67z"]
Sep 15 11:38:50.860847 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:50.860819    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cd44746d7-wr67z"]
Sep 15 11:38:52.212745 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:52.212705    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bfeba80-f440-4f8c-8a12-4d263b1fddd4" path="/var/lib/kubelet/pods/7bfeba80-f440-4f8c-8a12-4d263b1fddd4/volumes"
Sep 15 11:38:54.896994 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:54.896958    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:54.963512 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:54.963473    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:57.246816 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:57.246780    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:57.299413 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:57.299381    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:38:57.927928 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:57.927890    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7755df8f66-pkqx6" podUID="27f2dd6c-5f15-4f72-a38d-b49717ab4c55" containerName="console" containerID="cri-o://c123d891e8bdbd0a53bd284f7b75d1b896bd9b719216471b3803f784dbc6cf9b" gracePeriod=15
Sep 15 11:38:58.174106 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.174079    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:58.251987 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.251954    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-trusted-ca-bundle\") pod \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") "
Sep 15 11:38:58.252413 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252000    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-service-ca\") pod \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") "
Sep 15 11:38:58.252413 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252038    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-config\") pod \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") "
Sep 15 11:38:58.252413 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252143    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nrpl\" (UniqueName: \"kubernetes.io/projected/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-kube-api-access-4nrpl\") pod \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") "
Sep 15 11:38:58.252413 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252201    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-oauth-config\") pod \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") "
Sep 15 11:38:58.252413 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252252    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-oauth-serving-cert\") pod \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") "
Sep 15 11:38:58.252413 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252340    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-serving-cert\") pod \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\" (UID: \"27f2dd6c-5f15-4f72-a38d-b49717ab4c55\") "
Sep 15 11:38:58.252698 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252411    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "27f2dd6c-5f15-4f72-a38d-b49717ab4c55" (UID: "27f2dd6c-5f15-4f72-a38d-b49717ab4c55"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:38:58.252698 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252461    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-service-ca" (OuterVolumeSpecName: "service-ca") pod "27f2dd6c-5f15-4f72-a38d-b49717ab4c55" (UID: "27f2dd6c-5f15-4f72-a38d-b49717ab4c55"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:38:58.252698 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252661    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27f2dd6c-5f15-4f72-a38d-b49717ab4c55" (UID: "27f2dd6c-5f15-4f72-a38d-b49717ab4c55"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:38:58.252853 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252751    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-config" (OuterVolumeSpecName: "console-config") pod "27f2dd6c-5f15-4f72-a38d-b49717ab4c55" (UID: "27f2dd6c-5f15-4f72-a38d-b49717ab4c55"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:38:58.252853 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252838    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:58.252955 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252859    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-oauth-serving-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:58.252955 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252874    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-trusted-ca-bundle\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:58.252955 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.252886    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:58.254480 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.254458    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27f2dd6c-5f15-4f72-a38d-b49717ab4c55" (UID: "27f2dd6c-5f15-4f72-a38d-b49717ab4c55"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:38:58.254607 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.254499    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-kube-api-access-4nrpl" (OuterVolumeSpecName: "kube-api-access-4nrpl") pod "27f2dd6c-5f15-4f72-a38d-b49717ab4c55" (UID: "27f2dd6c-5f15-4f72-a38d-b49717ab4c55"). InnerVolumeSpecName "kube-api-access-4nrpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:38:58.254607 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.254515    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27f2dd6c-5f15-4f72-a38d-b49717ab4c55" (UID: "27f2dd6c-5f15-4f72-a38d-b49717ab4c55"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:38:58.353605 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.353568    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-serving-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:58.353605 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.353597    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nrpl\" (UniqueName: \"kubernetes.io/projected/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-kube-api-access-4nrpl\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:58.353605 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.353607    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27f2dd6c-5f15-4f72-a38d-b49717ab4c55-console-oauth-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:38:58.867085 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.867047    2571 generic.go:356] "Generic (PLEG): container finished" podID="27f2dd6c-5f15-4f72-a38d-b49717ab4c55" containerID="c123d891e8bdbd0a53bd284f7b75d1b896bd9b719216471b3803f784dbc6cf9b" exitCode=0
Sep 15 11:38:58.867308 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.867097    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7755df8f66-pkqx6"
Sep 15 11:38:58.867308 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.867116    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7755df8f66-pkqx6" event={"ID":"27f2dd6c-5f15-4f72-a38d-b49717ab4c55","Type":"ContainerDied","Data":"c123d891e8bdbd0a53bd284f7b75d1b896bd9b719216471b3803f784dbc6cf9b"}
Sep 15 11:38:58.867308 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.867174    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7755df8f66-pkqx6" event={"ID":"27f2dd6c-5f15-4f72-a38d-b49717ab4c55","Type":"ContainerDied","Data":"7451af5b90afc02b8b54df2cef53dc5c351124ce13cfbfefea565527e4ae5983"}
Sep 15 11:38:58.867308 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.867195    2571 scope.go:117] "RemoveContainer" containerID="c123d891e8bdbd0a53bd284f7b75d1b896bd9b719216471b3803f784dbc6cf9b"
Sep 15 11:38:58.875676 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.875659    2571 scope.go:117] "RemoveContainer" containerID="c123d891e8bdbd0a53bd284f7b75d1b896bd9b719216471b3803f784dbc6cf9b"
Sep 15 11:38:58.875931 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:38:58.875912    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c123d891e8bdbd0a53bd284f7b75d1b896bd9b719216471b3803f784dbc6cf9b\": container with ID starting with c123d891e8bdbd0a53bd284f7b75d1b896bd9b719216471b3803f784dbc6cf9b not found: ID does not exist" containerID="c123d891e8bdbd0a53bd284f7b75d1b896bd9b719216471b3803f784dbc6cf9b"
Sep 15 11:38:58.875972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.875941    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c123d891e8bdbd0a53bd284f7b75d1b896bd9b719216471b3803f784dbc6cf9b"} err="failed to get container status \"c123d891e8bdbd0a53bd284f7b75d1b896bd9b719216471b3803f784dbc6cf9b\": rpc error: code = NotFound desc = could not find container \"c123d891e8bdbd0a53bd284f7b75d1b896bd9b719216471b3803f784dbc6cf9b\": container with ID starting with c123d891e8bdbd0a53bd284f7b75d1b896bd9b719216471b3803f784dbc6cf9b not found: ID does not exist"
Sep 15 11:38:58.889086 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.889058    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7755df8f66-pkqx6"]
Sep 15 11:38:58.892170 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:38:58.892124    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7755df8f66-pkqx6"]
Sep 15 11:39:00.212839 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:00.212797    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27f2dd6c-5f15-4f72-a38d-b49717ab4c55" path="/var/lib/kubelet/pods/27f2dd6c-5f15-4f72-a38d-b49717ab4c55/volumes"
Sep 15 11:39:01.735624 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:01.735592    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dd9x4"
Sep 15 11:39:04.271027 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:04.270998    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:39:04.274877 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:04.274854    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6cb8d757ff-fb94k"
Sep 15 11:39:08.877773 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:08.877721    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-795b6fdc8b-x2q2w" podUID="27c80f02-28b8-4ef0-97a0-30fe81186eea" containerName="console" containerID="cri-o://3737862afecf0c91f3e87917db3b6745ef9955d5d93edab2bd89025b78d1c584" gracePeriod=15
Sep 15 11:39:09.156536 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.156504    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:39:09.261009 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.260975    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-service-ca\") pod \"27c80f02-28b8-4ef0-97a0-30fe81186eea\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") "
Sep 15 11:39:09.261177 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.261019    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdxzx\" (UniqueName: \"kubernetes.io/projected/27c80f02-28b8-4ef0-97a0-30fe81186eea-kube-api-access-gdxzx\") pod \"27c80f02-28b8-4ef0-97a0-30fe81186eea\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") "
Sep 15 11:39:09.261233 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.261194    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-oauth-config\") pod \"27c80f02-28b8-4ef0-97a0-30fe81186eea\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") "
Sep 15 11:39:09.261278 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.261253    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-oauth-serving-cert\") pod \"27c80f02-28b8-4ef0-97a0-30fe81186eea\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") "
Sep 15 11:39:09.261337 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.261277    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-config\") pod \"27c80f02-28b8-4ef0-97a0-30fe81186eea\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") "
Sep 15 11:39:09.261392 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.261340    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-serving-cert\") pod \"27c80f02-28b8-4ef0-97a0-30fe81186eea\" (UID: \"27c80f02-28b8-4ef0-97a0-30fe81186eea\") "
Sep 15 11:39:09.261448 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.261397    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-service-ca" (OuterVolumeSpecName: "service-ca") pod "27c80f02-28b8-4ef0-97a0-30fe81186eea" (UID: "27c80f02-28b8-4ef0-97a0-30fe81186eea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:09.261583 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.261560    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27c80f02-28b8-4ef0-97a0-30fe81186eea" (UID: "27c80f02-28b8-4ef0-97a0-30fe81186eea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:09.261657 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.261627    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-config" (OuterVolumeSpecName: "console-config") pod "27c80f02-28b8-4ef0-97a0-30fe81186eea" (UID: "27c80f02-28b8-4ef0-97a0-30fe81186eea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:09.261725 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.261704    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:09.261786 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.261730    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-oauth-serving-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:09.261786 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.261747    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:09.263513 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.263484    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27c80f02-28b8-4ef0-97a0-30fe81186eea" (UID: "27c80f02-28b8-4ef0-97a0-30fe81186eea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:09.263775 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.263750    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27c80f02-28b8-4ef0-97a0-30fe81186eea" (UID: "27c80f02-28b8-4ef0-97a0-30fe81186eea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:09.263775 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.263757    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c80f02-28b8-4ef0-97a0-30fe81186eea-kube-api-access-gdxzx" (OuterVolumeSpecName: "kube-api-access-gdxzx") pod "27c80f02-28b8-4ef0-97a0-30fe81186eea" (UID: "27c80f02-28b8-4ef0-97a0-30fe81186eea"). InnerVolumeSpecName "kube-api-access-gdxzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:39:09.363133 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.363099    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdxzx\" (UniqueName: \"kubernetes.io/projected/27c80f02-28b8-4ef0-97a0-30fe81186eea-kube-api-access-gdxzx\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:09.363133 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.363131    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-oauth-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:09.363133 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.363141    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27c80f02-28b8-4ef0-97a0-30fe81186eea-console-serving-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:09.923181 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.919864    2571 generic.go:356] "Generic (PLEG): container finished" podID="27c80f02-28b8-4ef0-97a0-30fe81186eea" containerID="3737862afecf0c91f3e87917db3b6745ef9955d5d93edab2bd89025b78d1c584" exitCode=0
Sep 15 11:39:09.923181 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.919942    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795b6fdc8b-x2q2w" event={"ID":"27c80f02-28b8-4ef0-97a0-30fe81186eea","Type":"ContainerDied","Data":"3737862afecf0c91f3e87917db3b6745ef9955d5d93edab2bd89025b78d1c584"}
Sep 15 11:39:09.923181 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.919998    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795b6fdc8b-x2q2w" event={"ID":"27c80f02-28b8-4ef0-97a0-30fe81186eea","Type":"ContainerDied","Data":"25240ff0bc42d534ba5586df5e75761e9bd1e4fa002a3cc46ff837007fb56eb2"}
Sep 15 11:39:09.923181 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.920030    2571 scope.go:117] "RemoveContainer" containerID="3737862afecf0c91f3e87917db3b6745ef9955d5d93edab2bd89025b78d1c584"
Sep 15 11:39:09.923181 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.920227    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795b6fdc8b-x2q2w"
Sep 15 11:39:09.943259 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.943234    2571 scope.go:117] "RemoveContainer" containerID="3737862afecf0c91f3e87917db3b6745ef9955d5d93edab2bd89025b78d1c584"
Sep 15 11:39:09.943742 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:39:09.943716    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3737862afecf0c91f3e87917db3b6745ef9955d5d93edab2bd89025b78d1c584\": container with ID starting with 3737862afecf0c91f3e87917db3b6745ef9955d5d93edab2bd89025b78d1c584 not found: ID does not exist" containerID="3737862afecf0c91f3e87917db3b6745ef9955d5d93edab2bd89025b78d1c584"
Sep 15 11:39:09.943836 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.943785    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3737862afecf0c91f3e87917db3b6745ef9955d5d93edab2bd89025b78d1c584"} err="failed to get container status \"3737862afecf0c91f3e87917db3b6745ef9955d5d93edab2bd89025b78d1c584\": rpc error: code = NotFound desc = could not find container \"3737862afecf0c91f3e87917db3b6745ef9955d5d93edab2bd89025b78d1c584\": container with ID starting with 3737862afecf0c91f3e87917db3b6745ef9955d5d93edab2bd89025b78d1c584 not found: ID does not exist"
Sep 15 11:39:09.954936 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.954906    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-795b6fdc8b-x2q2w"]
Sep 15 11:39:09.959360 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:09.959337    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-795b6fdc8b-x2q2w"]
Sep 15 11:39:10.217217 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:10.217184    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27c80f02-28b8-4ef0-97a0-30fe81186eea" path="/var/lib/kubelet/pods/27c80f02-28b8-4ef0-97a0-30fe81186eea/volumes"
Sep 15 11:39:11.964735 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:11.964693    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:26.185133 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:26.185087    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:26.204167 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:26.204125    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:26.816034 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:26.815979    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:27.006121 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:27.006093    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:35.582567 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:35.582532    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:35.647890 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:35.647859    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:37.479824 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.479789    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-674bf65bdd-jrjnr"]
Sep 15 11:39:37.480208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.480148    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27f2dd6c-5f15-4f72-a38d-b49717ab4c55" containerName="console"
Sep 15 11:39:37.480208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.480174    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="27f2dd6c-5f15-4f72-a38d-b49717ab4c55" containerName="console"
Sep 15 11:39:37.480208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.480193    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bfeba80-f440-4f8c-8a12-4d263b1fddd4" containerName="console"
Sep 15 11:39:37.480208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.480200    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bfeba80-f440-4f8c-8a12-4d263b1fddd4" containerName="console"
Sep 15 11:39:37.480208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.480206    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c80f02-28b8-4ef0-97a0-30fe81186eea" containerName="console"
Sep 15 11:39:37.480368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.480212    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c80f02-28b8-4ef0-97a0-30fe81186eea" containerName="console"
Sep 15 11:39:37.480368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.480284    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="27c80f02-28b8-4ef0-97a0-30fe81186eea" containerName="console"
Sep 15 11:39:37.480368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.480294    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bfeba80-f440-4f8c-8a12-4d263b1fddd4" containerName="console"
Sep 15 11:39:37.480368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.480301    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="27f2dd6c-5f15-4f72-a38d-b49717ab4c55" containerName="console"
Sep 15 11:39:37.484692 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.484672    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.496227 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.496201    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-674bf65bdd-jrjnr"]
Sep 15 11:39:37.515742 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.515706    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-oauth-config\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.515906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.515749    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-serving-cert\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.515906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.515849    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-config\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.515906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.515880    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-trusted-ca-bundle\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.516006 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.515917    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-service-ca\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.516006 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.515968    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvnsj\" (UniqueName: \"kubernetes.io/projected/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-kube-api-access-nvnsj\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.516074 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.516012    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-oauth-serving-cert\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.571167 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.571131    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:37.617516 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.617469    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-oauth-config\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.617516 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.617523    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-serving-cert\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.617762 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.617571    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-config\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.617762 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.617591    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-trusted-ca-bundle\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.617762 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.617617    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-service-ca\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.617762 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.617644    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvnsj\" (UniqueName: \"kubernetes.io/projected/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-kube-api-access-nvnsj\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.617762 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.617677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-oauth-serving-cert\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.618461 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.618430    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-config\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.618580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.618512    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-oauth-serving-cert\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.618580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.618522    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-service-ca\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.618580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.618563    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-trusted-ca-bundle\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.620071 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.620050    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-oauth-config\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.620252 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.620234    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-serving-cert\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.629001 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.628980    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvnsj\" (UniqueName: \"kubernetes.io/projected/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-kube-api-access-nvnsj\") pod \"console-674bf65bdd-jrjnr\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") " pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:37.671391 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.671352    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:37.742016 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.741931    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:37.794595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:37.794557    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:38.068098 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:38.068028    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-674bf65bdd-jrjnr"]
Sep 15 11:39:38.256575 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:38.256546    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:38.322680 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:38.322580    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:39.039666 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:39.039628    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674bf65bdd-jrjnr" event={"ID":"d6183a79-ba68-4c9d-a993-39ae1a4c8e02","Type":"ContainerStarted","Data":"2dc5d8a71c8b57199a6632d508345b67539b4e7ee4cf255fc146aa25cc404b4e"}
Sep 15 11:39:39.040058 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:39.039709    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674bf65bdd-jrjnr" event={"ID":"d6183a79-ba68-4c9d-a993-39ae1a4c8e02","Type":"ContainerStarted","Data":"fde924b56129a95e26d9bc46943826a8779e1d847594ce8ac1f4ee931477197f"}
Sep 15 11:39:39.058455 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:39.058402    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-674bf65bdd-jrjnr" podStartSLOduration=2.058385651 podStartE2EDuration="2.058385651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:39.057490408 +0000 UTC m=+141.309047466" watchObservedRunningTime="2026-09-15 11:39:39.058385651 +0000 UTC m=+141.309942708"
Sep 15 11:39:39.311579 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:39.311500    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:39.855263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:39.855224    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:39:39.855598 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:39.855572    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="alertmanager" containerID="cri-o://fa5a01c296f7c2f208c04cbc97243174d13fae15bd4027fbdd684f52ac551a4e" gracePeriod=120
Sep 15 11:39:39.855695 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:39.855654    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="kube-rbac-proxy-web" containerID="cri-o://e5e0f4ffc4c3b49678abfd7df8443d125353af167ebe8464d60baddb070f5069" gracePeriod=120
Sep 15 11:39:39.855760 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:39.855654    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="kube-rbac-proxy-metric" containerID="cri-o://5738cfa981b72e207deef38c1195a5270d5c2b9bcf6abb272bcca84363251dc0" gracePeriod=120
Sep 15 11:39:39.855760 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:39.855703    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="config-reloader" containerID="cri-o://2578f70632241b5cf1f28f3e62e7e7b46d2e3a74e0ac69558294e81c5fdbb838" gracePeriod=120
Sep 15 11:39:39.855851 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:39.855682    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="kube-rbac-proxy" containerID="cri-o://c561ed7c410731aa349b2dacff886bad8181fe7b154a4a988fa95ff8817b4fb8" gracePeriod=120
Sep 15 11:39:39.855851 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:39.855839    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="prom-label-proxy" containerID="cri-o://134eefdd88a8b3c65067942225c712a9b0636a435ee5a9fa93f9981348de7c49" gracePeriod=120
Sep 15 11:39:40.047100 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:40.047060    2571 generic.go:356] "Generic (PLEG): container finished" podID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerID="134eefdd88a8b3c65067942225c712a9b0636a435ee5a9fa93f9981348de7c49" exitCode=0
Sep 15 11:39:40.047100 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:40.047097    2571 generic.go:356] "Generic (PLEG): container finished" podID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerID="c561ed7c410731aa349b2dacff886bad8181fe7b154a4a988fa95ff8817b4fb8" exitCode=0
Sep 15 11:39:40.047100 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:40.047105    2571 generic.go:356] "Generic (PLEG): container finished" podID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerID="2578f70632241b5cf1f28f3e62e7e7b46d2e3a74e0ac69558294e81c5fdbb838" exitCode=0
Sep 15 11:39:40.047100 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:40.047111    2571 generic.go:356] "Generic (PLEG): container finished" podID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerID="fa5a01c296f7c2f208c04cbc97243174d13fae15bd4027fbdd684f52ac551a4e" exitCode=0
Sep 15 11:39:40.047574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:40.047135    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerDied","Data":"134eefdd88a8b3c65067942225c712a9b0636a435ee5a9fa93f9981348de7c49"}
Sep 15 11:39:40.047574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:40.047219    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerDied","Data":"c561ed7c410731aa349b2dacff886bad8181fe7b154a4a988fa95ff8817b4fb8"}
Sep 15 11:39:40.047574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:40.047249    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerDied","Data":"2578f70632241b5cf1f28f3e62e7e7b46d2e3a74e0ac69558294e81c5fdbb838"}
Sep 15 11:39:40.047574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:40.047274    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerDied","Data":"fa5a01c296f7c2f208c04cbc97243174d13fae15bd4027fbdd684f52ac551a4e"}
Sep 15 11:39:41.055823 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.055793    2571 generic.go:356] "Generic (PLEG): container finished" podID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerID="5738cfa981b72e207deef38c1195a5270d5c2b9bcf6abb272bcca84363251dc0" exitCode=0
Sep 15 11:39:41.055823 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.055816    2571 generic.go:356] "Generic (PLEG): container finished" podID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerID="e5e0f4ffc4c3b49678abfd7df8443d125353af167ebe8464d60baddb070f5069" exitCode=0
Sep 15 11:39:41.056219 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.055861    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerDied","Data":"5738cfa981b72e207deef38c1195a5270d5c2b9bcf6abb272bcca84363251dc0"}
Sep 15 11:39:41.056219 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.055937    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerDied","Data":"e5e0f4ffc4c3b49678abfd7df8443d125353af167ebe8464d60baddb070f5069"}
Sep 15 11:39:41.103554 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.103527    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:41.147320 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.147280    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-web-config\") pod \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") "
Sep 15 11:39:41.147503 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.147340    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") "
Sep 15 11:39:41.147503 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.147379    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7p77\" (UniqueName: \"kubernetes.io/projected/aadf3aeb-e233-40da-94d0-9fd0f00a993c-kube-api-access-x7p77\") pod \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") "
Sep 15 11:39:41.147503 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.147410    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aadf3aeb-e233-40da-94d0-9fd0f00a993c-config-out\") pod \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") "
Sep 15 11:39:41.147503 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.147442    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aadf3aeb-e233-40da-94d0-9fd0f00a993c-alertmanager-main-db\") pod \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") "
Sep 15 11:39:41.147503 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.147479    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aadf3aeb-e233-40da-94d0-9fd0f00a993c-alertmanager-trusted-ca-bundle\") pod \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") "
Sep 15 11:39:41.147776 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.147509    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aadf3aeb-e233-40da-94d0-9fd0f00a993c-tls-assets\") pod \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") "
Sep 15 11:39:41.147776 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.147555    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-main-tls\") pod \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") "
Sep 15 11:39:41.147776 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.147620    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aadf3aeb-e233-40da-94d0-9fd0f00a993c-metrics-client-ca\") pod \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") "
Sep 15 11:39:41.147776 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.147646    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-config-volume\") pod \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") "
Sep 15 11:39:41.147776 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.147679    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-cluster-tls-config\") pod \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") "
Sep 15 11:39:41.147776 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.147754    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy-web\") pod \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") "
Sep 15 11:39:41.148073 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.147954    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aadf3aeb-e233-40da-94d0-9fd0f00a993c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "aadf3aeb-e233-40da-94d0-9fd0f00a993c" (UID: "aadf3aeb-e233-40da-94d0-9fd0f00a993c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:39:41.149428 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.148504    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy\") pod \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\" (UID: \"aadf3aeb-e233-40da-94d0-9fd0f00a993c\") "
Sep 15 11:39:41.149428 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.148823    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aadf3aeb-e233-40da-94d0-9fd0f00a993c-alertmanager-main-db\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:41.149428 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.149387    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aadf3aeb-e233-40da-94d0-9fd0f00a993c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "aadf3aeb-e233-40da-94d0-9fd0f00a993c" (UID: "aadf3aeb-e233-40da-94d0-9fd0f00a993c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:41.149428 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.149395    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aadf3aeb-e233-40da-94d0-9fd0f00a993c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "aadf3aeb-e233-40da-94d0-9fd0f00a993c" (UID: "aadf3aeb-e233-40da-94d0-9fd0f00a993c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:41.150891 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.150849    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "aadf3aeb-e233-40da-94d0-9fd0f00a993c" (UID: "aadf3aeb-e233-40da-94d0-9fd0f00a993c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:41.152311 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.152272    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "aadf3aeb-e233-40da-94d0-9fd0f00a993c" (UID: "aadf3aeb-e233-40da-94d0-9fd0f00a993c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:41.153288 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.153227    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "aadf3aeb-e233-40da-94d0-9fd0f00a993c" (UID: "aadf3aeb-e233-40da-94d0-9fd0f00a993c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:41.153903 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.153843    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-config-volume" (OuterVolumeSpecName: "config-volume") pod "aadf3aeb-e233-40da-94d0-9fd0f00a993c" (UID: "aadf3aeb-e233-40da-94d0-9fd0f00a993c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:41.153903 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.153870    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aadf3aeb-e233-40da-94d0-9fd0f00a993c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "aadf3aeb-e233-40da-94d0-9fd0f00a993c" (UID: "aadf3aeb-e233-40da-94d0-9fd0f00a993c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:39:41.154306 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.154280    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aadf3aeb-e233-40da-94d0-9fd0f00a993c-config-out" (OuterVolumeSpecName: "config-out") pod "aadf3aeb-e233-40da-94d0-9fd0f00a993c" (UID: "aadf3aeb-e233-40da-94d0-9fd0f00a993c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:39:41.154424 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.154406    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aadf3aeb-e233-40da-94d0-9fd0f00a993c-kube-api-access-x7p77" (OuterVolumeSpecName: "kube-api-access-x7p77") pod "aadf3aeb-e233-40da-94d0-9fd0f00a993c" (UID: "aadf3aeb-e233-40da-94d0-9fd0f00a993c"). InnerVolumeSpecName "kube-api-access-x7p77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:39:41.154787 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.154755    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "aadf3aeb-e233-40da-94d0-9fd0f00a993c" (UID: "aadf3aeb-e233-40da-94d0-9fd0f00a993c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:41.159042 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.159019    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "aadf3aeb-e233-40da-94d0-9fd0f00a993c" (UID: "aadf3aeb-e233-40da-94d0-9fd0f00a993c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:41.164745 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.164719    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-web-config" (OuterVolumeSpecName: "web-config") pod "aadf3aeb-e233-40da-94d0-9fd0f00a993c" (UID: "aadf3aeb-e233-40da-94d0-9fd0f00a993c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:41.249390 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.249356    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:41.249390 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.249386    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:41.249390 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.249396    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-web-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:41.249633 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.249406    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:41.249633 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.249415    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7p77\" (UniqueName: \"kubernetes.io/projected/aadf3aeb-e233-40da-94d0-9fd0f00a993c-kube-api-access-x7p77\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:41.249633 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.249424    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aadf3aeb-e233-40da-94d0-9fd0f00a993c-config-out\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:41.249633 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.249433    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aadf3aeb-e233-40da-94d0-9fd0f00a993c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:41.249633 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.249442    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aadf3aeb-e233-40da-94d0-9fd0f00a993c-tls-assets\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:41.249633 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.249450    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-secret-alertmanager-main-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:41.249633 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.249458    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aadf3aeb-e233-40da-94d0-9fd0f00a993c-metrics-client-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:41.249633 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.249466    2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:41.249633 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:41.249482    2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aadf3aeb-e233-40da-94d0-9fd0f00a993c-cluster-tls-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:42.063796 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.063761    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aadf3aeb-e233-40da-94d0-9fd0f00a993c","Type":"ContainerDied","Data":"6cc28b3d2eff2a122d1a5b992fb504a45f9fb2997832351cb984038dd4b72160"}
Sep 15 11:39:42.064248 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.063814    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.064248 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.063864    2571 scope.go:117] "RemoveContainer" containerID="134eefdd88a8b3c65067942225c712a9b0636a435ee5a9fa93f9981348de7c49"
Sep 15 11:39:42.072639 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.072621    2571 scope.go:117] "RemoveContainer" containerID="5738cfa981b72e207deef38c1195a5270d5c2b9bcf6abb272bcca84363251dc0"
Sep 15 11:39:42.079630 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.079610    2571 scope.go:117] "RemoveContainer" containerID="c561ed7c410731aa349b2dacff886bad8181fe7b154a4a988fa95ff8817b4fb8"
Sep 15 11:39:42.086639 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.086617    2571 scope.go:117] "RemoveContainer" containerID="e5e0f4ffc4c3b49678abfd7df8443d125353af167ebe8464d60baddb070f5069"
Sep 15 11:39:42.087967 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.087951    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:39:42.094778 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.094761    2571 scope.go:117] "RemoveContainer" containerID="2578f70632241b5cf1f28f3e62e7e7b46d2e3a74e0ac69558294e81c5fdbb838"
Sep 15 11:39:42.095347 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.095327    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:39:42.101924 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.101908    2571 scope.go:117] "RemoveContainer" containerID="fa5a01c296f7c2f208c04cbc97243174d13fae15bd4027fbdd684f52ac551a4e"
Sep 15 11:39:42.108907 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.108891    2571 scope.go:117] "RemoveContainer" containerID="6fa43af5b0310df6088989fa2ba706d5a6b590d1152fd38249ecacdfc6657f08"
Sep 15 11:39:42.123013 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.122991    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:39:42.123322 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123306    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="alertmanager"
Sep 15 11:39:42.123369 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123325    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="alertmanager"
Sep 15 11:39:42.123369 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123333    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="config-reloader"
Sep 15 11:39:42.123369 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123339    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="config-reloader"
Sep 15 11:39:42.123369 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123347    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="init-config-reloader"
Sep 15 11:39:42.123369 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123352    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="init-config-reloader"
Sep 15 11:39:42.123369 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123362    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="kube-rbac-proxy-web"
Sep 15 11:39:42.123369 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123367    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="kube-rbac-proxy-web"
Sep 15 11:39:42.123574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123376    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="kube-rbac-proxy"
Sep 15 11:39:42.123574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123382    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="kube-rbac-proxy"
Sep 15 11:39:42.123574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123388    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="kube-rbac-proxy-metric"
Sep 15 11:39:42.123574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123393    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="kube-rbac-proxy-metric"
Sep 15 11:39:42.123574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123400    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="prom-label-proxy"
Sep 15 11:39:42.123574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123406    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="prom-label-proxy"
Sep 15 11:39:42.123574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123460    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="kube-rbac-proxy-web"
Sep 15 11:39:42.123574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123469    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="prom-label-proxy"
Sep 15 11:39:42.123574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123477    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="config-reloader"
Sep 15 11:39:42.123574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123484    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="alertmanager"
Sep 15 11:39:42.123574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123490    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="kube-rbac-proxy-metric"
Sep 15 11:39:42.123574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.123495    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" containerName="kube-rbac-proxy"
Sep 15 11:39:42.126896 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.126874    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.129567 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.129520    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 11:39:42.129772 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.129753    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 11:39:42.129862 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.129751    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 11:39:42.129916 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.129751    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x6kxj\""
Sep 15 11:39:42.129916 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.129753    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 11:39:42.130103 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.129955    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 11:39:42.130103 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.129963    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 11:39:42.130382 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.130366    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 11:39:42.130459 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.130383    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 11:39:42.134961 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.134943    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 11:39:42.149717 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.147579    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:39:42.213320 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.213291    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aadf3aeb-e233-40da-94d0-9fd0f00a993c" path="/var/lib/kubelet/pods/aadf3aeb-e233-40da-94d0-9fd0f00a993c/volumes"
Sep 15 11:39:42.263822 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.263786    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.263970 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.263830    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.263970 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.263866    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk2qm\" (UniqueName: \"kubernetes.io/projected/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-kube-api-access-dk2qm\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.263970 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.263888    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.263970 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.263908    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.263970 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.263934    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.263970 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.263961    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-config-out\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.264205 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.264003    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.264205 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.264039    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.264205 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.264062    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-web-config\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.264205 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.264081    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.264205 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.264179    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.264349 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.264230    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-config-volume\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.364660 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.364617    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.364660 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.364666    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk2qm\" (UniqueName: \"kubernetes.io/projected/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-kube-api-access-dk2qm\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.364917 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.364697    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.364917 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.364723    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.364917 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.364746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.364917 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.364773    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-config-out\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.364917 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.364801    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.364917 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.364827    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.364917 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.364861    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-web-config\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.364917 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.364888    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.365343 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.364933    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.365343 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.364988    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-config-volume\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.365343 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.365026    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.365743 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.365716    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.366333 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.365949    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.366626 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.366547    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.367877 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.367831    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.367979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.367881    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.367979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.367893    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.368351 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.368328    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.368458 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.368420    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.368519 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.368476    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-config-out\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.368519 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.368486    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-config-volume\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.369389 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.369371    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.369485 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.369468    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-web-config\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.374241 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.374218    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk2qm\" (UniqueName: \"kubernetes.io/projected/6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b-kube-api-access-dk2qm\") pod \"alertmanager-main-0\" (UID: \"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.436424 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.436387    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 11:39:42.720306 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:42.720277    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 11:39:42.721621 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:39:42.721589    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aedcf2a_efdf_4008_8fb4_c47fb0e2a84b.slice/crio-8c2bcbf184859b59e077b336af63d6d941fad6be4d07b394fbc2dd848473e85b WatchSource:0}: Error finding container 8c2bcbf184859b59e077b336af63d6d941fad6be4d07b394fbc2dd848473e85b: Status 404 returned error can't find the container with id 8c2bcbf184859b59e077b336af63d6d941fad6be4d07b394fbc2dd848473e85b
Sep 15 11:39:43.070326 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:43.070241    2571 generic.go:356] "Generic (PLEG): container finished" podID="6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b" containerID="c8245c96df5f25053ca227630784fa0f13cdaa8421a1a0226090ffeea81e22c7" exitCode=0
Sep 15 11:39:43.070326 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:43.070299    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b","Type":"ContainerDied","Data":"c8245c96df5f25053ca227630784fa0f13cdaa8421a1a0226090ffeea81e22c7"}
Sep 15 11:39:43.070708 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:43.070358    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b","Type":"ContainerStarted","Data":"8c2bcbf184859b59e077b336af63d6d941fad6be4d07b394fbc2dd848473e85b"}
Sep 15 11:39:44.078143 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.078098    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b","Type":"ContainerStarted","Data":"47d92300a38eb8f1a01768239d8d8af5d46ede5eeeeeee3e620ff5e642773793"}
Sep 15 11:39:44.078568 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.078228    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b","Type":"ContainerStarted","Data":"2f56f431e56c468cc4f8dd3a4eff171753e29652bdb4e37ea252a84e8cb2d1ae"}
Sep 15 11:39:44.078568 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.078274    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b","Type":"ContainerStarted","Data":"423f1ebcddb0507c7d1ae5d7027962d2a260376e1bf39e54d582dfdabe17a7f3"}
Sep 15 11:39:44.078568 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.078324    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b","Type":"ContainerStarted","Data":"1b10d67d30c3b53c783441a97998b2d4b196199d7095646c7373767cd122a6b0"}
Sep 15 11:39:44.078568 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.078360    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b","Type":"ContainerStarted","Data":"31f889d326f81c6284c29a889ae9b52725ac86ecfc13cc28559bec7a6249d3d4"}
Sep 15 11:39:44.078568 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.078398    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b","Type":"ContainerStarted","Data":"4192143b177a4756ee438dd38d5035fa062e2dbcb70529700348c06d88be327b"}
Sep 15 11:39:44.118929 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.118869    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.10310971 podStartE2EDuration="2.118849251s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.739541ms" isStatefulPod=false podCreationTimestamp="2026-09-15 11:39:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:44.116495653 +0000 UTC m=+146.368052723" watchObservedRunningTime="2026-09-15 11:39:44.118849251 +0000 UTC m=+146.370406308"
Sep 15 11:39:44.144817 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.144755    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:39:44.145100 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.145070    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="prometheus" containerID="cri-o://8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea" gracePeriod=600
Sep 15 11:39:44.145210 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.145095    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="kube-rbac-proxy" containerID="cri-o://d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131" gracePeriod=600
Sep 15 11:39:44.145210 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.145127    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="kube-rbac-proxy-web" containerID="cri-o://ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158" gracePeriod=600
Sep 15 11:39:44.145210 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.145119    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="config-reloader" containerID="cri-o://b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f" gracePeriod=600
Sep 15 11:39:44.145381 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.145257    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67" gracePeriod=600
Sep 15 11:39:44.145484 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.145454    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="thanos-sidecar" containerID="cri-o://5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce" gracePeriod=600
Sep 15 11:39:44.418146 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.417807    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:44.498745 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.498710    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-tls\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.498907 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.498766    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-serving-certs-ca-bundle\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.498907 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.498794    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-thanos-prometheus-http-client-file\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499019 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.498926    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-config\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499019 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.498966    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-0\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499019 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499005    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499033    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-kube-rbac-proxy\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499062    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-grpc-tls\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499108    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-db\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499135    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-trusted-ca-bundle\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499181    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-1\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499177    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:44.499208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499208    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499565 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499265    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-kubelet-serving-ca-bundle\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499565 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499307    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-web-config\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499565 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499335    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94d67ff2-2493-4269-9f32-fd9eaae02e5a-config-out\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499565 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499361    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-metrics-client-certs\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499565 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499388    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-metrics-client-ca\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499565 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499421    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcjxb\" (UniqueName: \"kubernetes.io/projected/94d67ff2-2493-4269-9f32-fd9eaae02e5a-kube-api-access-tcjxb\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499565 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499458    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94d67ff2-2493-4269-9f32-fd9eaae02e5a-tls-assets\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499565 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499490    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-2\") pod \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\" (UID: \"94d67ff2-2493-4269-9f32-fd9eaae02e5a\") "
Sep 15 11:39:44.499974 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.499794    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.500070 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.500040    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:44.500199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.500128    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:44.501063 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.500585    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:44.501327 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.501302    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:44.502411 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.502226    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:44.502411 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.502379    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:39:44.502579 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.502507    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:39:44.502899 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.502858    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94d67ff2-2493-4269-9f32-fd9eaae02e5a-kube-api-access-tcjxb" (OuterVolumeSpecName: "kube-api-access-tcjxb") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "kube-api-access-tcjxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:39:44.503195 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.503172    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:44.503395 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.503375    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-config" (OuterVolumeSpecName: "config") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:44.503609 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.503505    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94d67ff2-2493-4269-9f32-fd9eaae02e5a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:39:44.503609 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.503530    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:44.503847 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.503806    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:44.503981 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.503958    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:44.504706 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.504673    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d67ff2-2493-4269-9f32-fd9eaae02e5a-config-out" (OuterVolumeSpecName: "config-out") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:39:44.505061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.505041    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:44.505189 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.505129    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:44.505469 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.505447    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:44.515413 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.515388    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-web-config" (OuterVolumeSpecName: "web-config") pod "94d67ff2-2493-4269-9f32-fd9eaae02e5a" (UID: "94d67ff2-2493-4269-9f32-fd9eaae02e5a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:39:44.600900 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600857    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-web-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.600900 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600885    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94d67ff2-2493-4269-9f32-fd9eaae02e5a-config-out\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.600900 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600894    2571 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-metrics-client-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.600900 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600904    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-metrics-client-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.600900 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600913    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcjxb\" (UniqueName: \"kubernetes.io/projected/94d67ff2-2493-4269-9f32-fd9eaae02e5a-kube-api-access-tcjxb\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600921    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94d67ff2-2493-4269-9f32-fd9eaae02e5a-tls-assets\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600930    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600939    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600948    2571 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600957    2571 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600965    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600976    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600984    2571 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-kube-rbac-proxy\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.600992    2571 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-grpc-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.601001    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-db\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.601009    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.601016    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.601025    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94d67ff2-2493-4269-9f32-fd9eaae02e5a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:44.601199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:44.601034    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d67ff2-2493-4269-9f32-fd9eaae02e5a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:39:45.085123 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085093    2571 generic.go:356] "Generic (PLEG): container finished" podID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerID="aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67" exitCode=0
Sep 15 11:39:45.085123 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085116    2571 generic.go:356] "Generic (PLEG): container finished" podID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerID="d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131" exitCode=0
Sep 15 11:39:45.085123 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085122    2571 generic.go:356] "Generic (PLEG): container finished" podID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerID="ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158" exitCode=0
Sep 15 11:39:45.085123 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085127    2571 generic.go:356] "Generic (PLEG): container finished" podID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerID="5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce" exitCode=0
Sep 15 11:39:45.085123 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085133    2571 generic.go:356] "Generic (PLEG): container finished" podID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerID="b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f" exitCode=0
Sep 15 11:39:45.085694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085138    2571 generic.go:356] "Generic (PLEG): container finished" podID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerID="8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea" exitCode=0
Sep 15 11:39:45.085694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085177    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.085694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085181    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerDied","Data":"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"}
Sep 15 11:39:45.085694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085250    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerDied","Data":"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"}
Sep 15 11:39:45.085694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085278    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerDied","Data":"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"}
Sep 15 11:39:45.085694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085303    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerDied","Data":"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"}
Sep 15 11:39:45.085694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085327    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerDied","Data":"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"}
Sep 15 11:39:45.085694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085353    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerDied","Data":"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"}
Sep 15 11:39:45.085694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085377    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94d67ff2-2493-4269-9f32-fd9eaae02e5a","Type":"ContainerDied","Data":"62050ab0395f46b510e744868f7ec57ff0d975fa6fd610bff3a8b57cfbf46419"}
Sep 15 11:39:45.085694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.085327    2571 scope.go:117] "RemoveContainer" containerID="aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"
Sep 15 11:39:45.094265 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.094248    2571 scope.go:117] "RemoveContainer" containerID="d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"
Sep 15 11:39:45.101178 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.101162    2571 scope.go:117] "RemoveContainer" containerID="ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"
Sep 15 11:39:45.107819 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.107771    2571 scope.go:117] "RemoveContainer" containerID="5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"
Sep 15 11:39:45.110768 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.110749    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:39:45.115037 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.115018    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:39:45.115344 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.115330    2571 scope.go:117] "RemoveContainer" containerID="b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"
Sep 15 11:39:45.121835 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.121821    2571 scope.go:117] "RemoveContainer" containerID="8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"
Sep 15 11:39:45.128799 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.128783    2571 scope.go:117] "RemoveContainer" containerID="a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"
Sep 15 11:39:45.135089 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.135073    2571 scope.go:117] "RemoveContainer" containerID="aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"
Sep 15 11:39:45.135363 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:39:45.135346    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67\": container with ID starting with aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67 not found: ID does not exist" containerID="aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"
Sep 15 11:39:45.135409 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.135370    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"} err="failed to get container status \"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67\": rpc error: code = NotFound desc = could not find container \"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67\": container with ID starting with aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67 not found: ID does not exist"
Sep 15 11:39:45.135409 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.135387    2571 scope.go:117] "RemoveContainer" containerID="d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"
Sep 15 11:39:45.135656 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:39:45.135640    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131\": container with ID starting with d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131 not found: ID does not exist" containerID="d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"
Sep 15 11:39:45.135716 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.135658    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"} err="failed to get container status \"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131\": rpc error: code = NotFound desc = could not find container \"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131\": container with ID starting with d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131 not found: ID does not exist"
Sep 15 11:39:45.135716 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.135670    2571 scope.go:117] "RemoveContainer" containerID="ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"
Sep 15 11:39:45.135863 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:39:45.135850    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158\": container with ID starting with ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158 not found: ID does not exist" containerID="ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"
Sep 15 11:39:45.135909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.135866    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"} err="failed to get container status \"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158\": rpc error: code = NotFound desc = could not find container \"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158\": container with ID starting with ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158 not found: ID does not exist"
Sep 15 11:39:45.135909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.135877    2571 scope.go:117] "RemoveContainer" containerID="5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"
Sep 15 11:39:45.136064 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:39:45.136049    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce\": container with ID starting with 5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce not found: ID does not exist" containerID="5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"
Sep 15 11:39:45.136100 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.136066    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"} err="failed to get container status \"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce\": rpc error: code = NotFound desc = could not find container \"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce\": container with ID starting with 5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce not found: ID does not exist"
Sep 15 11:39:45.136100 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.136078    2571 scope.go:117] "RemoveContainer" containerID="b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"
Sep 15 11:39:45.136338 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:39:45.136321    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f\": container with ID starting with b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f not found: ID does not exist" containerID="b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"
Sep 15 11:39:45.136386 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.136342    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"} err="failed to get container status \"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f\": rpc error: code = NotFound desc = could not find container \"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f\": container with ID starting with b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f not found: ID does not exist"
Sep 15 11:39:45.136386 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.136355    2571 scope.go:117] "RemoveContainer" containerID="8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"
Sep 15 11:39:45.136578 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:39:45.136562    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea\": container with ID starting with 8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea not found: ID does not exist" containerID="8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"
Sep 15 11:39:45.136624 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.136582    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"} err="failed to get container status \"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea\": rpc error: code = NotFound desc = could not find container \"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea\": container with ID starting with 8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea not found: ID does not exist"
Sep 15 11:39:45.136624 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.136595    2571 scope.go:117] "RemoveContainer" containerID="a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"
Sep 15 11:39:45.136820 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:39:45.136805    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f\": container with ID starting with a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f not found: ID does not exist" containerID="a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"
Sep 15 11:39:45.136869 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.136825    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"} err="failed to get container status \"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f\": rpc error: code = NotFound desc = could not find container \"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f\": container with ID starting with a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f not found: ID does not exist"
Sep 15 11:39:45.136869 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.136843    2571 scope.go:117] "RemoveContainer" containerID="aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"
Sep 15 11:39:45.137054 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.137038    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"} err="failed to get container status \"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67\": rpc error: code = NotFound desc = could not find container \"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67\": container with ID starting with aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67 not found: ID does not exist"
Sep 15 11:39:45.137098 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.137054    2571 scope.go:117] "RemoveContainer" containerID="d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"
Sep 15 11:39:45.137323 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.137301    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"} err="failed to get container status \"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131\": rpc error: code = NotFound desc = could not find container \"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131\": container with ID starting with d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131 not found: ID does not exist"
Sep 15 11:39:45.137382 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.137327    2571 scope.go:117] "RemoveContainer" containerID="ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"
Sep 15 11:39:45.137573 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.137556    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"} err="failed to get container status \"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158\": rpc error: code = NotFound desc = could not find container \"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158\": container with ID starting with ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158 not found: ID does not exist"
Sep 15 11:39:45.137620 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.137573    2571 scope.go:117] "RemoveContainer" containerID="5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"
Sep 15 11:39:45.137811 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.137796    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"} err="failed to get container status \"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce\": rpc error: code = NotFound desc = could not find container \"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce\": container with ID starting with 5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce not found: ID does not exist"
Sep 15 11:39:45.137811 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.137811    2571 scope.go:117] "RemoveContainer" containerID="b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"
Sep 15 11:39:45.138023 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.138003    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"} err="failed to get container status \"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f\": rpc error: code = NotFound desc = could not find container \"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f\": container with ID starting with b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f not found: ID does not exist"
Sep 15 11:39:45.138081 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.138024    2571 scope.go:117] "RemoveContainer" containerID="8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"
Sep 15 11:39:45.138333 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.138309    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"} err="failed to get container status \"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea\": rpc error: code = NotFound desc = could not find container \"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea\": container with ID starting with 8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea not found: ID does not exist"
Sep 15 11:39:45.138389 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.138333    2571 scope.go:117] "RemoveContainer" containerID="a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"
Sep 15 11:39:45.138661 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.138643    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"} err="failed to get container status \"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f\": rpc error: code = NotFound desc = could not find container \"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f\": container with ID starting with a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f not found: ID does not exist"
Sep 15 11:39:45.138719 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.138663    2571 scope.go:117] "RemoveContainer" containerID="aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"
Sep 15 11:39:45.138962 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.138938    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"} err="failed to get container status \"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67\": rpc error: code = NotFound desc = could not find container \"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67\": container with ID starting with aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67 not found: ID does not exist"
Sep 15 11:39:45.139047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.139030    2571 scope.go:117] "RemoveContainer" containerID="d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"
Sep 15 11:39:45.139343 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.139324    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"} err="failed to get container status \"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131\": rpc error: code = NotFound desc = could not find container \"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131\": container with ID starting with d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131 not found: ID does not exist"
Sep 15 11:39:45.139343 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.139342    2571 scope.go:117] "RemoveContainer" containerID="ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"
Sep 15 11:39:45.139560 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.139544    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"} err="failed to get container status \"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158\": rpc error: code = NotFound desc = could not find container \"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158\": container with ID starting with ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158 not found: ID does not exist"
Sep 15 11:39:45.139607 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.139561    2571 scope.go:117] "RemoveContainer" containerID="5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"
Sep 15 11:39:45.139773 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.139758    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"} err="failed to get container status \"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce\": rpc error: code = NotFound desc = could not find container \"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce\": container with ID starting with 5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce not found: ID does not exist"
Sep 15 11:39:45.139816 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.139773    2571 scope.go:117] "RemoveContainer" containerID="b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"
Sep 15 11:39:45.140015 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.139998    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"} err="failed to get container status \"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f\": rpc error: code = NotFound desc = could not find container \"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f\": container with ID starting with b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f not found: ID does not exist"
Sep 15 11:39:45.140052 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.140015    2571 scope.go:117] "RemoveContainer" containerID="8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"
Sep 15 11:39:45.140231 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.140214    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"} err="failed to get container status \"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea\": rpc error: code = NotFound desc = could not find container \"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea\": container with ID starting with 8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea not found: ID does not exist"
Sep 15 11:39:45.140279 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.140231    2571 scope.go:117] "RemoveContainer" containerID="a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"
Sep 15 11:39:45.140428 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.140414    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"} err="failed to get container status \"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f\": rpc error: code = NotFound desc = could not find container \"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f\": container with ID starting with a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f not found: ID does not exist"
Sep 15 11:39:45.140465 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.140428    2571 scope.go:117] "RemoveContainer" containerID="aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"
Sep 15 11:39:45.140644 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.140628    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"} err="failed to get container status \"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67\": rpc error: code = NotFound desc = could not find container \"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67\": container with ID starting with aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67 not found: ID does not exist"
Sep 15 11:39:45.140702 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.140644    2571 scope.go:117] "RemoveContainer" containerID="d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"
Sep 15 11:39:45.140848 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.140827    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"} err="failed to get container status \"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131\": rpc error: code = NotFound desc = could not find container \"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131\": container with ID starting with d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131 not found: ID does not exist"
Sep 15 11:39:45.140848 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.140847    2571 scope.go:117] "RemoveContainer" containerID="ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"
Sep 15 11:39:45.141039 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.141021    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"} err="failed to get container status \"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158\": rpc error: code = NotFound desc = could not find container \"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158\": container with ID starting with ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158 not found: ID does not exist"
Sep 15 11:39:45.141076 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.141041    2571 scope.go:117] "RemoveContainer" containerID="5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"
Sep 15 11:39:45.141268 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.141252    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"} err="failed to get container status \"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce\": rpc error: code = NotFound desc = could not find container \"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce\": container with ID starting with 5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce not found: ID does not exist"
Sep 15 11:39:45.141268 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.141267    2571 scope.go:117] "RemoveContainer" containerID="b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"
Sep 15 11:39:45.141477 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.141461    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"} err="failed to get container status \"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f\": rpc error: code = NotFound desc = could not find container \"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f\": container with ID starting with b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f not found: ID does not exist"
Sep 15 11:39:45.141516 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.141477    2571 scope.go:117] "RemoveContainer" containerID="8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"
Sep 15 11:39:45.141661 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.141644    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"} err="failed to get container status \"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea\": rpc error: code = NotFound desc = could not find container \"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea\": container with ID starting with 8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea not found: ID does not exist"
Sep 15 11:39:45.141699 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.141662    2571 scope.go:117] "RemoveContainer" containerID="a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"
Sep 15 11:39:45.141854 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.141840    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"} err="failed to get container status \"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f\": rpc error: code = NotFound desc = could not find container \"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f\": container with ID starting with a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f not found: ID does not exist"
Sep 15 11:39:45.141854 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.141854    2571 scope.go:117] "RemoveContainer" containerID="aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"
Sep 15 11:39:45.142061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.142048    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"} err="failed to get container status \"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67\": rpc error: code = NotFound desc = could not find container \"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67\": container with ID starting with aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67 not found: ID does not exist"
Sep 15 11:39:45.142061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.142060    2571 scope.go:117] "RemoveContainer" containerID="d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"
Sep 15 11:39:45.142283 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.142265    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"} err="failed to get container status \"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131\": rpc error: code = NotFound desc = could not find container \"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131\": container with ID starting with d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131 not found: ID does not exist"
Sep 15 11:39:45.142336 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.142283    2571 scope.go:117] "RemoveContainer" containerID="ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"
Sep 15 11:39:45.142511 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.142494    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"} err="failed to get container status \"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158\": rpc error: code = NotFound desc = could not find container \"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158\": container with ID starting with ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158 not found: ID does not exist"
Sep 15 11:39:45.142555 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.142511    2571 scope.go:117] "RemoveContainer" containerID="5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"
Sep 15 11:39:45.142735 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.142720    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"} err="failed to get container status \"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce\": rpc error: code = NotFound desc = could not find container \"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce\": container with ID starting with 5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce not found: ID does not exist"
Sep 15 11:39:45.142777 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.142735    2571 scope.go:117] "RemoveContainer" containerID="b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"
Sep 15 11:39:45.142939 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.142923    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"} err="failed to get container status \"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f\": rpc error: code = NotFound desc = could not find container \"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f\": container with ID starting with b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f not found: ID does not exist"
Sep 15 11:39:45.142981 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.142939    2571 scope.go:117] "RemoveContainer" containerID="8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"
Sep 15 11:39:45.143121 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.143106    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"} err="failed to get container status \"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea\": rpc error: code = NotFound desc = could not find container \"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea\": container with ID starting with 8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea not found: ID does not exist"
Sep 15 11:39:45.143178 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.143121    2571 scope.go:117] "RemoveContainer" containerID="a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"
Sep 15 11:39:45.143373 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.143352    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"} err="failed to get container status \"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f\": rpc error: code = NotFound desc = could not find container \"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f\": container with ID starting with a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f not found: ID does not exist"
Sep 15 11:39:45.143425 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.143375    2571 scope.go:117] "RemoveContainer" containerID="aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"
Sep 15 11:39:45.143622 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.143603    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67"} err="failed to get container status \"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67\": rpc error: code = NotFound desc = could not find container \"aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67\": container with ID starting with aa270cbaa43ac9cc31296d76c2780edb1ded84aad58a6655368366aa851e0e67 not found: ID does not exist"
Sep 15 11:39:45.143664 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.143623    2571 scope.go:117] "RemoveContainer" containerID="d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"
Sep 15 11:39:45.143857 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.143835    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131"} err="failed to get container status \"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131\": rpc error: code = NotFound desc = could not find container \"d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131\": container with ID starting with d5c6d96892aa9163fb6d69d8b8620b5108eccbf58cbea54aa42afacc03f0e131 not found: ID does not exist"
Sep 15 11:39:45.143929 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.143858    2571 scope.go:117] "RemoveContainer" containerID="ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"
Sep 15 11:39:45.144073 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.144056    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158"} err="failed to get container status \"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158\": rpc error: code = NotFound desc = could not find container \"ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158\": container with ID starting with ae9011508458160a849bd17cc3c162f1d923904871c18aae0e030c9e85021158 not found: ID does not exist"
Sep 15 11:39:45.144123 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.144074    2571 scope.go:117] "RemoveContainer" containerID="5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"
Sep 15 11:39:45.144304 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.144288    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce"} err="failed to get container status \"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce\": rpc error: code = NotFound desc = could not find container \"5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce\": container with ID starting with 5217b721662c38142e0a4e023f6d427c895463f7dca010bec6859b90c736d2ce not found: ID does not exist"
Sep 15 11:39:45.144356 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.144305    2571 scope.go:117] "RemoveContainer" containerID="b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"
Sep 15 11:39:45.144491 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.144473    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f"} err="failed to get container status \"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f\": rpc error: code = NotFound desc = could not find container \"b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f\": container with ID starting with b0f6680fe13d14ceadd8006f74ca67a2f1d3f46b21c4744fe30a184de8177f7f not found: ID does not exist"
Sep 15 11:39:45.144551 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.144493    2571 scope.go:117] "RemoveContainer" containerID="8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"
Sep 15 11:39:45.144693 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.144677    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea"} err="failed to get container status \"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea\": rpc error: code = NotFound desc = could not find container \"8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea\": container with ID starting with 8b9e2a1223fb87bc1973d2456de0cd4078f4c457a4ff394b310f2a0fa32639ea not found: ID does not exist"
Sep 15 11:39:45.144738 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.144694    2571 scope.go:117] "RemoveContainer" containerID="a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"
Sep 15 11:39:45.144862 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.144845    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f"} err="failed to get container status \"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f\": rpc error: code = NotFound desc = could not find container \"a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f\": container with ID starting with a5e6573b17062cc30eceddf983fcc203d34045030bf2d5b993248683e3aa425f not found: ID does not exist"
Sep 15 11:39:45.147880 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.147862    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:39:45.148185 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148171    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="init-config-reloader"
Sep 15 11:39:45.148225 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148186    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="init-config-reloader"
Sep 15 11:39:45.148225 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148196    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="kube-rbac-proxy"
Sep 15 11:39:45.148225 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148202    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="kube-rbac-proxy"
Sep 15 11:39:45.148225 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148208    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="kube-rbac-proxy-thanos"
Sep 15 11:39:45.148225 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148216    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="kube-rbac-proxy-thanos"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148229    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="thanos-sidecar"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148236    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="thanos-sidecar"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148242    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="kube-rbac-proxy-web"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148247    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="kube-rbac-proxy-web"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148253    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="prometheus"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148258    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="prometheus"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148264    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="config-reloader"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148270    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="config-reloader"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148335    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="prometheus"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148341    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="thanos-sidecar"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148349    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="config-reloader"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148355    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="kube-rbac-proxy"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148361    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="kube-rbac-proxy-thanos"
Sep 15 11:39:45.148368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.148367    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" containerName="kube-rbac-proxy-web"
Sep 15 11:39:45.151623 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.151608    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.154241 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.154224    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 15 11:39:45.154451 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.154424    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 15 11:39:45.154535 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.154502    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 15 11:39:45.154593 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.154502    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 15 11:39:45.154593 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.154571    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9mtvv1496r916\""
Sep 15 11:39:45.154762 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.154565    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tvrvj\""
Sep 15 11:39:45.154892 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.154864    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 15 11:39:45.154982 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.154964    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 15 11:39:45.155137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.155121    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 15 11:39:45.155430 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.155409    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 15 11:39:45.155501 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.155475    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 15 11:39:45.155501 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.155483    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 15 11:39:45.155606 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.155539    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 15 11:39:45.155846 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.155827    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 15 11:39:45.158243 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.158225    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 15 11:39:45.164809 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.164787    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 15 11:39:45.172100 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.172079    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:39:45.308831 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.308786    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.308831 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.308848    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309050 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.308882    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-config\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309050 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.308909    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309050 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.308955    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309050 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309001    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309050 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309038    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309236 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309066    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309236 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309236 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309124    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309236 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309236 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309176    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309236 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309200    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309236 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309236 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309233    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcnv4\" (UniqueName: \"kubernetes.io/projected/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-kube-api-access-mcnv4\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309478 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309248    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309478 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309263    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309478 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309478 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309302    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.309478 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.309319    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.409662 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.409620    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcnv4\" (UniqueName: \"kubernetes.io/projected/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-kube-api-access-mcnv4\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.409662 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.409664    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.409873 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.409681    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.409873 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.409700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.409873 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.409736    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.409873 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.409763    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.409873 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.409798    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.409873 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.409831    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.409873 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.409855    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-config\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.409883    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.409941    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.409987    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.410013    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.410042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.410070    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.410096    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.410134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.410182    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.410212    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410716 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.410240    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410716 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.410247    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410716 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.410421    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.410716 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.410575    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.411656 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.411625    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.413797 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.412738    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.413797 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.412869    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.413797 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.412924    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.413797 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.413180    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.413797 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.413501    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.413797 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.413517    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.414147 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.413866    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.414147 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.414128    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.414268 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.414221    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.414419 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.414370    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-config\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.414848 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.414808    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.415537 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.415518    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.416119 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.416090    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.416215 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.416138    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.416342 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.416325    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.420727 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.420706    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcnv4\" (UniqueName: \"kubernetes.io/projected/f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2-kube-api-access-mcnv4\") pod \"prometheus-k8s-0\" (UID: \"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.463524 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.463500    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:45.748058 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:45.748028    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 11:39:45.749052 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:39:45.749024    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f46f0d_c21a_4ecb_a6ed_7e147ad516c2.slice/crio-74c5edee17719ad03b0b0eed5a9981007560867f2f70020d9e1b8c5dee3044e4 WatchSource:0}: Error finding container 74c5edee17719ad03b0b0eed5a9981007560867f2f70020d9e1b8c5dee3044e4: Status 404 returned error can't find the container with id 74c5edee17719ad03b0b0eed5a9981007560867f2f70020d9e1b8c5dee3044e4
Sep 15 11:39:46.090827 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:46.090738    2571 generic.go:356] "Generic (PLEG): container finished" podID="f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2" containerID="8f7035e505fe50fc9ad3cd6996df032769ec158d13c18109d46de9e31d9341eb" exitCode=0
Sep 15 11:39:46.091248 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:46.090826    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2","Type":"ContainerDied","Data":"8f7035e505fe50fc9ad3cd6996df032769ec158d13c18109d46de9e31d9341eb"}
Sep 15 11:39:46.091248 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:46.090900    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2","Type":"ContainerStarted","Data":"74c5edee17719ad03b0b0eed5a9981007560867f2f70020d9e1b8c5dee3044e4"}
Sep 15 11:39:46.215268 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:46.215243    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94d67ff2-2493-4269-9f32-fd9eaae02e5a" path="/var/lib/kubelet/pods/94d67ff2-2493-4269-9f32-fd9eaae02e5a/volumes"
Sep 15 11:39:47.099599 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:47.099564    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2","Type":"ContainerStarted","Data":"a3f04d0495098f32de19a49e754eaee4f5466a0ecb97308144643432fd8d629b"}
Sep 15 11:39:47.100004 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:47.099653    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2","Type":"ContainerStarted","Data":"73730e25ee235f2acb72fd886672481aabe6a4566c93663c5bca1aa9cd7d7c57"}
Sep 15 11:39:47.100004 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:47.099685    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2","Type":"ContainerStarted","Data":"8fde918f297921615be21974ec41e8dd9333e435f49994654098cd4020770461"}
Sep 15 11:39:47.100004 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:47.099708    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2","Type":"ContainerStarted","Data":"b3097e22a909fba7c490ad1dfb46c246918349c1da95d73ab169dab081150d8b"}
Sep 15 11:39:47.100004 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:47.099730    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2","Type":"ContainerStarted","Data":"7692dd3336a800a344c408d2f46563d4c06dfcacc028826d1f621176d91f39e9"}
Sep 15 11:39:47.100004 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:47.099754    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2","Type":"ContainerStarted","Data":"5a99a751c25ee521afb63a985f17b846015f985e903069b71b434ca85f2d997a"}
Sep 15 11:39:47.132708 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:47.132657    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.116153181 podStartE2EDuration="2.132641077s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.487896ms" isStatefulPod=false podCreationTimestamp="2026-09-15 11:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:39:47.129887754 +0000 UTC m=+149.381444802" watchObservedRunningTime="2026-09-15 11:39:47.132641077 +0000 UTC m=+149.384198128"
Sep 15 11:39:47.433621 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:47.433545    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:47.489290 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:47.489262    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:47.795059 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:47.795027    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:47.795233 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:47.795103    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:47.799951 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:47.799930    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:48.107894 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:48.107820    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:39:48.155544 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:48.155512    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7489fb4-7skb5"]
Sep 15 11:39:48.295595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:48.295559    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:48.357985 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:48.357915    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:48.422522 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:48.422495    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:50.464360 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:50.464326    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:39:54.897930 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:54.897898    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:55.004026 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:55.003986    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:39:55.069811 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:39:55.069777    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:13.174711 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.174598    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d7489fb4-7skb5" podUID="82d0272a-1f6e-4051-8616-af3a1789c22c" containerName="console" containerID="cri-o://41ae63e6603a25dceceb67374965a2071fc110f034f6de18b1a0ff23786f2eb7" gracePeriod=15
Sep 15 11:40:13.411758 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.411736    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:40:13.454842 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.454819    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-trusted-ca-bundle\") pod \"82d0272a-1f6e-4051-8616-af3a1789c22c\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") "
Sep 15 11:40:13.454972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.454872    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82d0272a-1f6e-4051-8616-af3a1789c22c-console-oauth-config\") pod \"82d0272a-1f6e-4051-8616-af3a1789c22c\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") "
Sep 15 11:40:13.454972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.454938    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82d0272a-1f6e-4051-8616-af3a1789c22c-console-serving-cert\") pod \"82d0272a-1f6e-4051-8616-af3a1789c22c\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") "
Sep 15 11:40:13.454972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.454973    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-service-ca\") pod \"82d0272a-1f6e-4051-8616-af3a1789c22c\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") "
Sep 15 11:40:13.455120 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.454999    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4pzr\" (UniqueName: \"kubernetes.io/projected/82d0272a-1f6e-4051-8616-af3a1789c22c-kube-api-access-k4pzr\") pod \"82d0272a-1f6e-4051-8616-af3a1789c22c\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") "
Sep 15 11:40:13.455120 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.455021    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-oauth-serving-cert\") pod \"82d0272a-1f6e-4051-8616-af3a1789c22c\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") "
Sep 15 11:40:13.455120 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.455042    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-console-config\") pod \"82d0272a-1f6e-4051-8616-af3a1789c22c\" (UID: \"82d0272a-1f6e-4051-8616-af3a1789c22c\") "
Sep 15 11:40:13.455369 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.455241    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "82d0272a-1f6e-4051-8616-af3a1789c22c" (UID: "82d0272a-1f6e-4051-8616-af3a1789c22c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:13.455493 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.455457    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "82d0272a-1f6e-4051-8616-af3a1789c22c" (UID: "82d0272a-1f6e-4051-8616-af3a1789c22c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:13.455493 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.455471    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-service-ca" (OuterVolumeSpecName: "service-ca") pod "82d0272a-1f6e-4051-8616-af3a1789c22c" (UID: "82d0272a-1f6e-4051-8616-af3a1789c22c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:13.455679 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.455544    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-console-config" (OuterVolumeSpecName: "console-config") pod "82d0272a-1f6e-4051-8616-af3a1789c22c" (UID: "82d0272a-1f6e-4051-8616-af3a1789c22c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:40:13.457132 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.457108    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82d0272a-1f6e-4051-8616-af3a1789c22c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "82d0272a-1f6e-4051-8616-af3a1789c22c" (UID: "82d0272a-1f6e-4051-8616-af3a1789c22c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:40:13.457241 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.457127    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82d0272a-1f6e-4051-8616-af3a1789c22c-kube-api-access-k4pzr" (OuterVolumeSpecName: "kube-api-access-k4pzr") pod "82d0272a-1f6e-4051-8616-af3a1789c22c" (UID: "82d0272a-1f6e-4051-8616-af3a1789c22c"). InnerVolumeSpecName "kube-api-access-k4pzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:40:13.457241 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.457135    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82d0272a-1f6e-4051-8616-af3a1789c22c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "82d0272a-1f6e-4051-8616-af3a1789c22c" (UID: "82d0272a-1f6e-4051-8616-af3a1789c22c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:40:13.556436 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.556405    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-trusted-ca-bundle\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.556436 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.556433    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82d0272a-1f6e-4051-8616-af3a1789c22c-console-oauth-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.556601 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.556446    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82d0272a-1f6e-4051-8616-af3a1789c22c-console-serving-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.556601 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.556460    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.556601 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.556473    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4pzr\" (UniqueName: \"kubernetes.io/projected/82d0272a-1f6e-4051-8616-af3a1789c22c-kube-api-access-k4pzr\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.556601 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.556485    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-oauth-serving-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:40:13.556601 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:13.556497    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82d0272a-1f6e-4051-8616-af3a1789c22c-console-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:40:14.215432 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:14.215398    2571 generic.go:356] "Generic (PLEG): container finished" podID="82d0272a-1f6e-4051-8616-af3a1789c22c" containerID="41ae63e6603a25dceceb67374965a2071fc110f034f6de18b1a0ff23786f2eb7" exitCode=0
Sep 15 11:40:14.215833 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:14.215438    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7489fb4-7skb5"
Sep 15 11:40:14.215833 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:14.215429    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7489fb4-7skb5" event={"ID":"82d0272a-1f6e-4051-8616-af3a1789c22c","Type":"ContainerDied","Data":"41ae63e6603a25dceceb67374965a2071fc110f034f6de18b1a0ff23786f2eb7"}
Sep 15 11:40:14.215833 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:14.215582    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7489fb4-7skb5" event={"ID":"82d0272a-1f6e-4051-8616-af3a1789c22c","Type":"ContainerDied","Data":"2b917799dc29c967e6b0812d6b3dee526086e5ddef617fb059ad8802f5816983"}
Sep 15 11:40:14.215833 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:14.215620    2571 scope.go:117] "RemoveContainer" containerID="41ae63e6603a25dceceb67374965a2071fc110f034f6de18b1a0ff23786f2eb7"
Sep 15 11:40:14.230331 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:14.230314    2571 scope.go:117] "RemoveContainer" containerID="41ae63e6603a25dceceb67374965a2071fc110f034f6de18b1a0ff23786f2eb7"
Sep 15 11:40:14.230623 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:40:14.230605    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41ae63e6603a25dceceb67374965a2071fc110f034f6de18b1a0ff23786f2eb7\": container with ID starting with 41ae63e6603a25dceceb67374965a2071fc110f034f6de18b1a0ff23786f2eb7 not found: ID does not exist" containerID="41ae63e6603a25dceceb67374965a2071fc110f034f6de18b1a0ff23786f2eb7"
Sep 15 11:40:14.230670 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:14.230632    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41ae63e6603a25dceceb67374965a2071fc110f034f6de18b1a0ff23786f2eb7"} err="failed to get container status \"41ae63e6603a25dceceb67374965a2071fc110f034f6de18b1a0ff23786f2eb7\": rpc error: code = NotFound desc = could not find container \"41ae63e6603a25dceceb67374965a2071fc110f034f6de18b1a0ff23786f2eb7\": container with ID starting with 41ae63e6603a25dceceb67374965a2071fc110f034f6de18b1a0ff23786f2eb7 not found: ID does not exist"
Sep 15 11:40:14.239739 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:14.239717    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7489fb4-7skb5"]
Sep 15 11:40:14.242628 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:14.242609    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d7489fb4-7skb5"]
Sep 15 11:40:16.212753 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:16.212719    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82d0272a-1f6e-4051-8616-af3a1789c22c" path="/var/lib/kubelet/pods/82d0272a-1f6e-4051-8616-af3a1789c22c/volumes"
Sep 15 11:40:25.870055 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:25.870017    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:37.473040 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:37.473003    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:37.564630 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:37.564598    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:40:45.464708 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:45.464669    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:45.479236 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:45.479203    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:40:46.363983 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:40:46.363953    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 11:41:04.367069 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:04.367030    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:05.137894 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:05.137848    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:07.778579 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:07.778548    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:07.881205 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:07.881174    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:09.360866 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.360827    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wjssq"]
Sep 15 11:41:09.361390 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.361372    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82d0272a-1f6e-4051-8616-af3a1789c22c" containerName="console"
Sep 15 11:41:09.361435 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.361394    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="82d0272a-1f6e-4051-8616-af3a1789c22c" containerName="console"
Sep 15 11:41:09.361493 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.361481    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="82d0272a-1f6e-4051-8616-af3a1789c22c" containerName="console"
Sep 15 11:41:09.365810 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.365794    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wjssq"
Sep 15 11:41:09.368667 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.368649    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 15 11:41:09.369009 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.368992    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 15 11:41:09.393669 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.393641    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wjssq"]
Sep 15 11:41:09.449657 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.449628    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:09.472659 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.472635    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9848591b-a9b3-46bf-9f34-2db8bbc93c69-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wjssq\" (UID: \"9848591b-a9b3-46bf-9f34-2db8bbc93c69\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wjssq"
Sep 15 11:41:09.472770 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.472690    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w98tp\" (UniqueName: \"kubernetes.io/projected/9848591b-a9b3-46bf-9f34-2db8bbc93c69-kube-api-access-w98tp\") pod \"cert-manager-webhook-6486ffd997-wjssq\" (UID: \"9848591b-a9b3-46bf-9f34-2db8bbc93c69\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wjssq"
Sep 15 11:41:09.542242 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.542209    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:09.574138 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.574108    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9848591b-a9b3-46bf-9f34-2db8bbc93c69-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wjssq\" (UID: \"9848591b-a9b3-46bf-9f34-2db8bbc93c69\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wjssq"
Sep 15 11:41:09.574281 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.574196    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w98tp\" (UniqueName: \"kubernetes.io/projected/9848591b-a9b3-46bf-9f34-2db8bbc93c69-kube-api-access-w98tp\") pod \"cert-manager-webhook-6486ffd997-wjssq\" (UID: \"9848591b-a9b3-46bf-9f34-2db8bbc93c69\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wjssq"
Sep 15 11:41:09.588260 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.588235    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w98tp\" (UniqueName: \"kubernetes.io/projected/9848591b-a9b3-46bf-9f34-2db8bbc93c69-kube-api-access-w98tp\") pod \"cert-manager-webhook-6486ffd997-wjssq\" (UID: \"9848591b-a9b3-46bf-9f34-2db8bbc93c69\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wjssq"
Sep 15 11:41:09.588542 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.588524    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9848591b-a9b3-46bf-9f34-2db8bbc93c69-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wjssq\" (UID: \"9848591b-a9b3-46bf-9f34-2db8bbc93c69\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wjssq"
Sep 15 11:41:09.691976 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.691897    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wjssq"
Sep 15 11:41:09.965433 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:09.965401    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wjssq"]
Sep 15 11:41:09.968620 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:41:09.968587    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9848591b_a9b3_46bf_9f34_2db8bbc93c69.slice/crio-2fd0540eef3b241a4d7e0f5dcf4fbc84af5e3ca36e1f52218af05a620c8d6911 WatchSource:0}: Error finding container 2fd0540eef3b241a4d7e0f5dcf4fbc84af5e3ca36e1f52218af05a620c8d6911: Status 404 returned error can't find the container with id 2fd0540eef3b241a4d7e0f5dcf4fbc84af5e3ca36e1f52218af05a620c8d6911
Sep 15 11:41:10.442062 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:10.441986    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wjssq" event={"ID":"9848591b-a9b3-46bf-9f34-2db8bbc93c69","Type":"ContainerStarted","Data":"2fd0540eef3b241a4d7e0f5dcf4fbc84af5e3ca36e1f52218af05a620c8d6911"}
Sep 15 11:41:11.559054 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:11.559024    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:11.771541 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:11.771506    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:13.458609 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:13.458578    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wjssq" event={"ID":"9848591b-a9b3-46bf-9f34-2db8bbc93c69","Type":"ContainerStarted","Data":"14d1ed8ce09906a19489aca7baf702171bff856b622d22bf196ca30e1e79f547"}
Sep 15 11:41:13.458989 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:13.458633    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wjssq"
Sep 15 11:41:13.479789 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:13.479736    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wjssq" podStartSLOduration=1.464385415 podStartE2EDuration="4.479720939s" totalImagesPullingTime="3.015335524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:13.478375074 +0000 UTC m=+235.729932134" watchObservedRunningTime="2026-09-15 11:41:13.479720939 +0000 UTC m=+235.731277995"
Sep 15 11:41:14.560527 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:14.560481    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:14.661865 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:14.661837    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:18.780846 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:18.780780    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:19.465468 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:19.465436    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wjssq"
Sep 15 11:41:21.107542 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:21.107505    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rqtnc"]
Sep 15 11:41:21.111448 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:21.111425    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rqtnc"
Sep 15 11:41:21.114318 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:21.114293    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rzdv4\""
Sep 15 11:41:21.121352 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:21.121328    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rqtnc"]
Sep 15 11:41:21.176916 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:21.176867    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8sdg\" (UniqueName: \"kubernetes.io/projected/e2274ff9-7c42-4209-af1e-1c62489088c3-kube-api-access-m8sdg\") pod \"cert-manager-55b4d954d5-rqtnc\" (UID: \"e2274ff9-7c42-4209-af1e-1c62489088c3\") " pod="cert-manager/cert-manager-55b4d954d5-rqtnc"
Sep 15 11:41:21.176916 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:21.176908    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2274ff9-7c42-4209-af1e-1c62489088c3-bound-sa-token\") pod \"cert-manager-55b4d954d5-rqtnc\" (UID: \"e2274ff9-7c42-4209-af1e-1c62489088c3\") " pod="cert-manager/cert-manager-55b4d954d5-rqtnc"
Sep 15 11:41:21.277443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:21.277406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2274ff9-7c42-4209-af1e-1c62489088c3-bound-sa-token\") pod \"cert-manager-55b4d954d5-rqtnc\" (UID: \"e2274ff9-7c42-4209-af1e-1c62489088c3\") " pod="cert-manager/cert-manager-55b4d954d5-rqtnc"
Sep 15 11:41:21.277606 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:21.277529    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8sdg\" (UniqueName: \"kubernetes.io/projected/e2274ff9-7c42-4209-af1e-1c62489088c3-kube-api-access-m8sdg\") pod \"cert-manager-55b4d954d5-rqtnc\" (UID: \"e2274ff9-7c42-4209-af1e-1c62489088c3\") " pod="cert-manager/cert-manager-55b4d954d5-rqtnc"
Sep 15 11:41:21.285466 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:21.285439    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2274ff9-7c42-4209-af1e-1c62489088c3-bound-sa-token\") pod \"cert-manager-55b4d954d5-rqtnc\" (UID: \"e2274ff9-7c42-4209-af1e-1c62489088c3\") " pod="cert-manager/cert-manager-55b4d954d5-rqtnc"
Sep 15 11:41:21.285581 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:21.285498    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8sdg\" (UniqueName: \"kubernetes.io/projected/e2274ff9-7c42-4209-af1e-1c62489088c3-kube-api-access-m8sdg\") pod \"cert-manager-55b4d954d5-rqtnc\" (UID: \"e2274ff9-7c42-4209-af1e-1c62489088c3\") " pod="cert-manager/cert-manager-55b4d954d5-rqtnc"
Sep 15 11:41:21.420379 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:21.420294    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rqtnc"
Sep 15 11:41:21.689730 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:21.689706    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rqtnc"]
Sep 15 11:41:21.692131 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:41:21.692100    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2274ff9_7c42_4209_af1e_1c62489088c3.slice/crio-dbeb8657a970b59f107b18dd1ab7eb411b07db7f5bccbeb68614727208b8a63e WatchSource:0}: Error finding container dbeb8657a970b59f107b18dd1ab7eb411b07db7f5bccbeb68614727208b8a63e: Status 404 returned error can't find the container with id dbeb8657a970b59f107b18dd1ab7eb411b07db7f5bccbeb68614727208b8a63e
Sep 15 11:41:22.497779 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:22.497737    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rqtnc" event={"ID":"e2274ff9-7c42-4209-af1e-1c62489088c3","Type":"ContainerStarted","Data":"9ee84cb7c65b52031e8ad1abb4400b9fbc6567f59b28bbc33173d2847a8d2fb6"}
Sep 15 11:41:22.497779 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:22.497785    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rqtnc" event={"ID":"e2274ff9-7c42-4209-af1e-1c62489088c3","Type":"ContainerStarted","Data":"dbeb8657a970b59f107b18dd1ab7eb411b07db7f5bccbeb68614727208b8a63e"}
Sep 15 11:41:22.515364 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:22.515309    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-rqtnc" podStartSLOduration=1.515292354 podStartE2EDuration="1.515292354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:22.514089843 +0000 UTC m=+244.765646902" watchObservedRunningTime="2026-09-15 11:41:22.515292354 +0000 UTC m=+244.766849410"
Sep 15 11:41:26.182455 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:26.182416    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:26.286893 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:26.286851    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:32.596779 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:32.596730    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:32.696875 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:32.696844    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:34.256823 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:34.256791    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:46.079079 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:46.078988    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:46.180410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:46.180365    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:46.287092 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:46.287055    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:46.386879 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:46.386779    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:46.903300 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:46.903265    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:47.182409 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.182321    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:47.336414 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.336379    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"]
Sep 15 11:41:47.338665 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.338648    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.343142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.343120    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 11:41:47.343142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.343135    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 11:41:47.343341 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.343224    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 11:41:47.343834 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.343819    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 11:41:47.344068 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.344050    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cpjxd\""
Sep 15 11:41:47.362281 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.362257    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"]
Sep 15 11:41:47.407212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.407177    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8add857a-def7-4587-bbb8-c0c83d7fde44-tmp\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.407376 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.407230    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8add857a-def7-4587-bbb8-c0c83d7fde44-webhook-cert\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.407376 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.407253    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd6qb\" (UniqueName: \"kubernetes.io/projected/8add857a-def7-4587-bbb8-c0c83d7fde44-kube-api-access-xd6qb\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.407455 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.407370    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8add857a-def7-4587-bbb8-c0c83d7fde44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.407455 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.407410    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8add857a-def7-4587-bbb8-c0c83d7fde44-manifests\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.445912 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.445876    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:47.508225 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.508190    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8add857a-def7-4587-bbb8-c0c83d7fde44-tmp\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.508572 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.508246    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8add857a-def7-4587-bbb8-c0c83d7fde44-webhook-cert\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.508572 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.508275    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd6qb\" (UniqueName: \"kubernetes.io/projected/8add857a-def7-4587-bbb8-c0c83d7fde44-kube-api-access-xd6qb\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.508572 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.508324    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8add857a-def7-4587-bbb8-c0c83d7fde44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.508572 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.508348    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8add857a-def7-4587-bbb8-c0c83d7fde44-manifests\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.508851 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.508716    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8add857a-def7-4587-bbb8-c0c83d7fde44-manifests\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.510485 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.510463    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8add857a-def7-4587-bbb8-c0c83d7fde44-tmp\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.510887 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.510867    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8add857a-def7-4587-bbb8-c0c83d7fde44-webhook-cert\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.510929 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.510867    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8add857a-def7-4587-bbb8-c0c83d7fde44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.522910 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.522879    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd6qb\" (UniqueName: \"kubernetes.io/projected/8add857a-def7-4587-bbb8-c0c83d7fde44-kube-api-access-xd6qb\") pod \"opendatahub-operator-controller-manager-74bdb8b799-cpm86\" (UID: \"8add857a-def7-4587-bbb8-c0c83d7fde44\") " pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.552714 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.552681    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:47.647585 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.647549    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:47.650594 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.650574    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:47.747685 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.747644    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:47.846748 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.846719    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:47.918570 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.918536    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:47.927423 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:47.927396    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"]
Sep 15 11:41:47.930862 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:41:47.930834    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8add857a_def7_4587_bbb8_c0c83d7fde44.slice/crio-c34288ace02f3e8b0984d252608b69e52d025a0ac96af60a3f381bfa5fc3e19e WatchSource:0}: Error finding container c34288ace02f3e8b0984d252608b69e52d025a0ac96af60a3f381bfa5fc3e19e: Status 404 returned error can't find the container with id c34288ace02f3e8b0984d252608b69e52d025a0ac96af60a3f381bfa5fc3e19e
Sep 15 11:41:48.613128 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:48.613082    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86" event={"ID":"8add857a-def7-4587-bbb8-c0c83d7fde44","Type":"ContainerStarted","Data":"c34288ace02f3e8b0984d252608b69e52d025a0ac96af60a3f381bfa5fc3e19e"}
Sep 15 11:41:50.541147 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:50.541110    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:50.661374 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:50.661336    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:51.629656 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:51.629622    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86" event={"ID":"8add857a-def7-4587-bbb8-c0c83d7fde44","Type":"ContainerStarted","Data":"6864a3bcf2a428e9dd92f2af233da6a79bed875274447539ff0a11227568103f"}
Sep 15 11:41:52.635969 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:52.635931    2571 generic.go:356] "Generic (PLEG): container finished" podID="8add857a-def7-4587-bbb8-c0c83d7fde44" containerID="6864a3bcf2a428e9dd92f2af233da6a79bed875274447539ff0a11227568103f" exitCode=0
Sep 15 11:41:52.636420 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:52.635990    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86" event={"ID":"8add857a-def7-4587-bbb8-c0c83d7fde44","Type":"ContainerDied","Data":"6864a3bcf2a428e9dd92f2af233da6a79bed875274447539ff0a11227568103f"}
Sep 15 11:41:53.642228 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:53.642188    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86" event={"ID":"8add857a-def7-4587-bbb8-c0c83d7fde44","Type":"ContainerStarted","Data":"6d06683786af0d66ff31024e2af7a56d12c68767d29b54f37760815705f3d3ed"}
Sep 15 11:41:53.642620 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:53.642361    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:41:53.666204 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:53.666139    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86" podStartSLOduration=2.230589732 podStartE2EDuration="6.666122142s" totalImagesPullingTime="3.407312438s" totalInitContainerRuntime="1.028219972s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:41:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:41:53.665279602 +0000 UTC m=+275.916836669" watchObservedRunningTime="2026-09-15 11:41:53.666122142 +0000 UTC m=+275.917679261"
Sep 15 11:41:56.169907 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:56.169868    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:41:57.414560 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:41:57.414525    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:04.648398 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:04.648367    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74bdb8b799-cpm86"
Sep 15 11:42:06.593190 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:06.593143    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:06.694074 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:06.694041    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:06.822027 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:06.821994    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:06.915666 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:06.915568    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:08.145720 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:08.145689    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:08.207292 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:08.207258    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:09.038767 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:09.038739    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:13.573717 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:13.573674    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:13.674211 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:13.674174    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:14.264532 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:14.264506    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:14.368297 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:14.368259    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:14.482993 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:14.482965    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:17.754438 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:17.754405    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:17.853663 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:17.853615    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:17.958941 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:17.958905    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:18.055720 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:18.055642    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:18.121307 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:18.121279    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 11:42:18.124467 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:18.124445    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 11:42:18.127273 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:18.127254    2571 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 11:42:18.278360 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:18.278297    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:19.092001 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:19.091962    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:21.769105 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:21.769075    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:21.872919 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:21.872885    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:24.977519 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:24.977477    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"]
Sep 15 11:42:24.980051 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:24.980028    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:24.982734 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:24.982688    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h2jx9\""
Sep 15 11:42:24.983081 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:24.983054    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 15 11:42:24.983494 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:24.983473    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 11:42:24.983616 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:24.983516    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 15 11:42:24.983616 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:24.983546    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 11:42:24.983616 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:24.983545    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 15 11:42:24.993882 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:24.993858    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"]
Sep 15 11:42:25.053086 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.053048    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/881ada2f-3925-4732-b350-1ed87f428c92-manager-config\") pod \"lws-controller-manager-8487688d7-pp82m\" (UID: \"881ada2f-3925-4732-b350-1ed87f428c92\") " pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:25.053275 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.053099    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/881ada2f-3925-4732-b350-1ed87f428c92-metrics-cert\") pod \"lws-controller-manager-8487688d7-pp82m\" (UID: \"881ada2f-3925-4732-b350-1ed87f428c92\") " pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:25.053275 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.053192    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/881ada2f-3925-4732-b350-1ed87f428c92-cert\") pod \"lws-controller-manager-8487688d7-pp82m\" (UID: \"881ada2f-3925-4732-b350-1ed87f428c92\") " pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:25.053275 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.053215    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6m4m\" (UniqueName: \"kubernetes.io/projected/881ada2f-3925-4732-b350-1ed87f428c92-kube-api-access-z6m4m\") pod \"lws-controller-manager-8487688d7-pp82m\" (UID: \"881ada2f-3925-4732-b350-1ed87f428c92\") " pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:25.154210 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.154174    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/881ada2f-3925-4732-b350-1ed87f428c92-cert\") pod \"lws-controller-manager-8487688d7-pp82m\" (UID: \"881ada2f-3925-4732-b350-1ed87f428c92\") " pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:25.154210 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.154215    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6m4m\" (UniqueName: \"kubernetes.io/projected/881ada2f-3925-4732-b350-1ed87f428c92-kube-api-access-z6m4m\") pod \"lws-controller-manager-8487688d7-pp82m\" (UID: \"881ada2f-3925-4732-b350-1ed87f428c92\") " pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:25.154430 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.154256    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/881ada2f-3925-4732-b350-1ed87f428c92-manager-config\") pod \"lws-controller-manager-8487688d7-pp82m\" (UID: \"881ada2f-3925-4732-b350-1ed87f428c92\") " pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:25.154430 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.154294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/881ada2f-3925-4732-b350-1ed87f428c92-metrics-cert\") pod \"lws-controller-manager-8487688d7-pp82m\" (UID: \"881ada2f-3925-4732-b350-1ed87f428c92\") " pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:25.154928 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.154903    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/881ada2f-3925-4732-b350-1ed87f428c92-manager-config\") pod \"lws-controller-manager-8487688d7-pp82m\" (UID: \"881ada2f-3925-4732-b350-1ed87f428c92\") " pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:25.156677 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.156657    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/881ada2f-3925-4732-b350-1ed87f428c92-cert\") pod \"lws-controller-manager-8487688d7-pp82m\" (UID: \"881ada2f-3925-4732-b350-1ed87f428c92\") " pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:25.156794 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.156705    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/881ada2f-3925-4732-b350-1ed87f428c92-metrics-cert\") pod \"lws-controller-manager-8487688d7-pp82m\" (UID: \"881ada2f-3925-4732-b350-1ed87f428c92\") " pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:25.174333 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.174308    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6m4m\" (UniqueName: \"kubernetes.io/projected/881ada2f-3925-4732-b350-1ed87f428c92-kube-api-access-z6m4m\") pod \"lws-controller-manager-8487688d7-pp82m\" (UID: \"881ada2f-3925-4732-b350-1ed87f428c92\") " pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:25.291753 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.291657    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:25.587430 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.587326    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"]
Sep 15 11:42:25.590065 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:42:25.590040    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod881ada2f_3925_4732_b350_1ed87f428c92.slice/crio-b8e316ceb96fac9d91c2d69a47ab09a54768b0f06fe62434c27cf068bda3a11b WatchSource:0}: Error finding container b8e316ceb96fac9d91c2d69a47ab09a54768b0f06fe62434c27cf068bda3a11b: Status 404 returned error can't find the container with id b8e316ceb96fac9d91c2d69a47ab09a54768b0f06fe62434c27cf068bda3a11b
Sep 15 11:42:25.591966 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.591949    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:42:25.793368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.793335    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m" event={"ID":"881ada2f-3925-4732-b350-1ed87f428c92","Type":"ContainerStarted","Data":"b8e316ceb96fac9d91c2d69a47ab09a54768b0f06fe62434c27cf068bda3a11b"}
Sep 15 11:42:25.896408 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.896320    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:25.976891 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:25.976860    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:26.835059 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.835029    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"]
Sep 15 11:42:26.838757 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.838736    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"
Sep 15 11:42:26.842366 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.842347    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 15 11:42:26.842469 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.842384    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6kt7x\""
Sep 15 11:42:26.853952 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.853900    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"]
Sep 15 11:42:26.855642 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.855618    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"]
Sep 15 11:42:26.858392 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.858375    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"
Sep 15 11:42:26.860976 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.860955    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4xxbv\""
Sep 15 11:42:26.861077 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.861001    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 15 11:42:26.875056 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.875026    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"]
Sep 15 11:42:26.977263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.971658    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46xc8\" (UniqueName: \"kubernetes.io/projected/33474fed-9ab0-4243-abba-3ae3d6681775-kube-api-access-46xc8\") pod \"kserve-controller-manager-d6f4b65b8-hkqwh\" (UID: \"33474fed-9ab0-4243-abba-3ae3d6681775\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"
Sep 15 11:42:26.977263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.971982    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33474fed-9ab0-4243-abba-3ae3d6681775-cert\") pod \"kserve-controller-manager-d6f4b65b8-hkqwh\" (UID: \"33474fed-9ab0-4243-abba-3ae3d6681775\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"
Sep 15 11:42:26.977263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.972052    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57b2d4c4-f890-40f3-bdfd-ed567f80feef-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8kc67\" (UID: \"57b2d4c4-f890-40f3-bdfd-ed567f80feef\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"
Sep 15 11:42:26.977263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:26.972110    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7tl7\" (UniqueName: \"kubernetes.io/projected/57b2d4c4-f890-40f3-bdfd-ed567f80feef-kube-api-access-p7tl7\") pod \"llmisvc-controller-manager-777c6bd7d5-8kc67\" (UID: \"57b2d4c4-f890-40f3-bdfd-ed567f80feef\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"
Sep 15 11:42:27.073566 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.073527    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33474fed-9ab0-4243-abba-3ae3d6681775-cert\") pod \"kserve-controller-manager-d6f4b65b8-hkqwh\" (UID: \"33474fed-9ab0-4243-abba-3ae3d6681775\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"
Sep 15 11:42:27.073566 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.073568    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57b2d4c4-f890-40f3-bdfd-ed567f80feef-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8kc67\" (UID: \"57b2d4c4-f890-40f3-bdfd-ed567f80feef\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"
Sep 15 11:42:27.073779 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.073589    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7tl7\" (UniqueName: \"kubernetes.io/projected/57b2d4c4-f890-40f3-bdfd-ed567f80feef-kube-api-access-p7tl7\") pod \"llmisvc-controller-manager-777c6bd7d5-8kc67\" (UID: \"57b2d4c4-f890-40f3-bdfd-ed567f80feef\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"
Sep 15 11:42:27.073779 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.073635    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46xc8\" (UniqueName: \"kubernetes.io/projected/33474fed-9ab0-4243-abba-3ae3d6681775-kube-api-access-46xc8\") pod \"kserve-controller-manager-d6f4b65b8-hkqwh\" (UID: \"33474fed-9ab0-4243-abba-3ae3d6681775\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"
Sep 15 11:42:27.073779 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:42:27.073716    2571 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 15 11:42:27.073891 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:42:27.073797    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b2d4c4-f890-40f3-bdfd-ed567f80feef-cert podName:57b2d4c4-f890-40f3-bdfd-ed567f80feef nodeName:}" failed. No retries permitted until 2026-09-15 11:42:27.573778808 +0000 UTC m=+309.825335844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/57b2d4c4-f890-40f3-bdfd-ed567f80feef-cert") pod "llmisvc-controller-manager-777c6bd7d5-8kc67" (UID: "57b2d4c4-f890-40f3-bdfd-ed567f80feef") : secret "llmisvc-webhook-server-cert" not found
Sep 15 11:42:27.073891 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:42:27.073718    2571 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 15 11:42:27.073891 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:42:27.073888    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33474fed-9ab0-4243-abba-3ae3d6681775-cert podName:33474fed-9ab0-4243-abba-3ae3d6681775 nodeName:}" failed. No retries permitted until 2026-09-15 11:42:27.57386783 +0000 UTC m=+309.825424878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/33474fed-9ab0-4243-abba-3ae3d6681775-cert") pod "kserve-controller-manager-d6f4b65b8-hkqwh" (UID: "33474fed-9ab0-4243-abba-3ae3d6681775") : secret "kserve-webhook-server-cert" not found
Sep 15 11:42:27.093401 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.093330    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46xc8\" (UniqueName: \"kubernetes.io/projected/33474fed-9ab0-4243-abba-3ae3d6681775-kube-api-access-46xc8\") pod \"kserve-controller-manager-d6f4b65b8-hkqwh\" (UID: \"33474fed-9ab0-4243-abba-3ae3d6681775\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"
Sep 15 11:42:27.098077 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.098053    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7tl7\" (UniqueName: \"kubernetes.io/projected/57b2d4c4-f890-40f3-bdfd-ed567f80feef-kube-api-access-p7tl7\") pod \"llmisvc-controller-manager-777c6bd7d5-8kc67\" (UID: \"57b2d4c4-f890-40f3-bdfd-ed567f80feef\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"
Sep 15 11:42:27.487560 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.487531    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:27.579205 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.579142    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33474fed-9ab0-4243-abba-3ae3d6681775-cert\") pod \"kserve-controller-manager-d6f4b65b8-hkqwh\" (UID: \"33474fed-9ab0-4243-abba-3ae3d6681775\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"
Sep 15 11:42:27.579205 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.579203    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57b2d4c4-f890-40f3-bdfd-ed567f80feef-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8kc67\" (UID: \"57b2d4c4-f890-40f3-bdfd-ed567f80feef\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"
Sep 15 11:42:27.581715 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.581690    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33474fed-9ab0-4243-abba-3ae3d6681775-cert\") pod \"kserve-controller-manager-d6f4b65b8-hkqwh\" (UID: \"33474fed-9ab0-4243-abba-3ae3d6681775\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"
Sep 15 11:42:27.581844 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.581690    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57b2d4c4-f890-40f3-bdfd-ed567f80feef-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8kc67\" (UID: \"57b2d4c4-f890-40f3-bdfd-ed567f80feef\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"
Sep 15 11:42:27.587481 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.587455    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:27.749832 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.749740    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"
Sep 15 11:42:27.768550 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:27.768464    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"
Sep 15 11:42:28.068424 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:28.068392    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"]
Sep 15 11:42:28.069266 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:42:28.069236    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33474fed_9ab0_4243_abba_3ae3d6681775.slice/crio-1f929e401c02faaabb9a9afe49822453d429c2ca70996e0aefcdc3e45b927bf9 WatchSource:0}: Error finding container 1f929e401c02faaabb9a9afe49822453d429c2ca70996e0aefcdc3e45b927bf9: Status 404 returned error can't find the container with id 1f929e401c02faaabb9a9afe49822453d429c2ca70996e0aefcdc3e45b927bf9
Sep 15 11:42:28.099658 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:28.099502    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"]
Sep 15 11:42:28.102260 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:42:28.102233    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod57b2d4c4_f890_40f3_bdfd_ed567f80feef.slice/crio-a777d679b7f1885d419bba820f301ea5fc2e9aa861ba55846cdad5ada6f893e9 WatchSource:0}: Error finding container a777d679b7f1885d419bba820f301ea5fc2e9aa861ba55846cdad5ada6f893e9: Status 404 returned error can't find the container with id a777d679b7f1885d419bba820f301ea5fc2e9aa861ba55846cdad5ada6f893e9
Sep 15 11:42:28.148338 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:28.148306    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:28.229226 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:28.229195    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:28.815565 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:28.815514    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67" event={"ID":"57b2d4c4-f890-40f3-bdfd-ed567f80feef","Type":"ContainerStarted","Data":"a777d679b7f1885d419bba820f301ea5fc2e9aa861ba55846cdad5ada6f893e9"}
Sep 15 11:42:28.817269 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:28.817234    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh" event={"ID":"33474fed-9ab0-4243-abba-3ae3d6681775","Type":"ContainerStarted","Data":"1f929e401c02faaabb9a9afe49822453d429c2ca70996e0aefcdc3e45b927bf9"}
Sep 15 11:42:31.843463 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:31.843029    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh" event={"ID":"33474fed-9ab0-4243-abba-3ae3d6681775","Type":"ContainerStarted","Data":"d62b544084ae142eca0fe5de4ddac0ddca1644f97ab693344b7aacdaeb4bac18"}
Sep 15 11:42:31.843463 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:31.843111    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"
Sep 15 11:42:31.845169 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:31.845130    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67" event={"ID":"57b2d4c4-f890-40f3-bdfd-ed567f80feef","Type":"ContainerStarted","Data":"b1a210827a4bb9ad22fcb004dc4fc9b29612ff2b4f42e472a343baa79377f532"}
Sep 15 11:42:31.845311 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:31.845212    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"
Sep 15 11:42:31.864010 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:31.863956    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh" podStartSLOduration=2.971460839 podStartE2EDuration="5.863933892s" totalImagesPullingTime="2.892473053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:31.861724144 +0000 UTC m=+314.113281225" watchObservedRunningTime="2026-09-15 11:42:31.863933892 +0000 UTC m=+314.115490950"
Sep 15 11:42:31.881223 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:31.881145    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67" podStartSLOduration=2.433703665 podStartE2EDuration="5.881124155s" totalImagesPullingTime="3.44742049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:31.878369822 +0000 UTC m=+314.129926880" watchObservedRunningTime="2026-09-15 11:42:31.881124155 +0000 UTC m=+314.132681212"
Sep 15 11:42:33.856779 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:33.856737    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m" event={"ID":"881ada2f-3925-4732-b350-1ed87f428c92","Type":"ContainerStarted","Data":"322fe6c9e08bbc7e3591df5c31fb654870204a8df9896122166474bbae2cab01"}
Sep 15 11:42:33.857305 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:33.856869    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:42:33.874932 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:33.874879    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m" podStartSLOduration=2.036342199 podStartE2EDuration="9.87486196s" totalImagesPullingTime="7.838519761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:42:33.873194725 +0000 UTC m=+316.124751826" watchObservedRunningTime="2026-09-15 11:42:33.87486196 +0000 UTC m=+316.126419086"
Sep 15 11:42:39.895982 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:39.895947    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:39.993845 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:39.993794    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:42:44.864304 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:42:44.864270    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8487688d7-pp82m"
Sep 15 11:43:02.853269 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:02.853238    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8kc67"
Sep 15 11:43:02.856254 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:02.856235    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hkqwh"
Sep 15 11:43:18.822213 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:18.822146    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:18.918382 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:18.918345    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:31.069958 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:31.069918    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:31.862106 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:31.862068    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:32.667093 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:32.667057    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:34.907840 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:34.907804    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:35.012841 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:35.012808    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:35.708867 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:35.708828    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"]
Sep 15 11:43:35.711383 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:35.711364    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:35.715678 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:35.715658    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mjhnk\""
Sep 15 11:43:35.715902 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:35.715881    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 11:43:35.715989 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:35.715903    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 11:43:35.727198 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:35.727148    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"]
Sep 15 11:43:35.810212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:35.810141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8eb0dc47-9996-4117-9122-0d6732bce7e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" (UID: \"8eb0dc47-9996-4117-9122-0d6732bce7e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:35.810399 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:35.810256    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsb4d\" (UniqueName: \"kubernetes.io/projected/8eb0dc47-9996-4117-9122-0d6732bce7e0-kube-api-access-tsb4d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" (UID: \"8eb0dc47-9996-4117-9122-0d6732bce7e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:35.911256 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:35.911210    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8eb0dc47-9996-4117-9122-0d6732bce7e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" (UID: \"8eb0dc47-9996-4117-9122-0d6732bce7e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:35.911621 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:35.911294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsb4d\" (UniqueName: \"kubernetes.io/projected/8eb0dc47-9996-4117-9122-0d6732bce7e0-kube-api-access-tsb4d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" (UID: \"8eb0dc47-9996-4117-9122-0d6732bce7e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:35.911621 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:35.911596    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8eb0dc47-9996-4117-9122-0d6732bce7e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" (UID: \"8eb0dc47-9996-4117-9122-0d6732bce7e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:35.926932 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:35.926907    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsb4d\" (UniqueName: \"kubernetes.io/projected/8eb0dc47-9996-4117-9122-0d6732bce7e0-kube-api-access-tsb4d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" (UID: \"8eb0dc47-9996-4117-9122-0d6732bce7e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:36.022128 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:36.022041    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:36.284741 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:36.284652    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:36.304470 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:36.304444    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"]
Sep 15 11:43:36.307587 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:43:36.307556    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb0dc47_9996_4117_9122_0d6732bce7e0.slice/crio-746c4678daa10674e5e4dbc3471eb89c6f6600cad9909ef109cd15826fd222dd WatchSource:0}: Error finding container 746c4678daa10674e5e4dbc3471eb89c6f6600cad9909ef109cd15826fd222dd: Status 404 returned error can't find the container with id 746c4678daa10674e5e4dbc3471eb89c6f6600cad9909ef109cd15826fd222dd
Sep 15 11:43:37.165694 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:37.165650    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n" event={"ID":"8eb0dc47-9996-4117-9122-0d6732bce7e0","Type":"ContainerStarted","Data":"746c4678daa10674e5e4dbc3471eb89c6f6600cad9909ef109cd15826fd222dd"}
Sep 15 11:43:37.624787 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:37.624736    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"]
Sep 15 11:43:37.627639 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:37.627602    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:37.630698 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:37.630634    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7pr2k\""
Sep 15 11:43:37.638035 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:37.637971    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"]
Sep 15 11:43:37.727733 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:37.727699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dgs7\" (UniqueName: \"kubernetes.io/projected/60d30759-5be6-44ee-ae8b-2a61caae4214-kube-api-access-9dgs7\") pod \"limitador-operator-controller-manager-74495c69f8-g5fvf\" (UID: \"60d30759-5be6-44ee-ae8b-2a61caae4214\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:37.828933 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:37.828883    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dgs7\" (UniqueName: \"kubernetes.io/projected/60d30759-5be6-44ee-ae8b-2a61caae4214-kube-api-access-9dgs7\") pod \"limitador-operator-controller-manager-74495c69f8-g5fvf\" (UID: \"60d30759-5be6-44ee-ae8b-2a61caae4214\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:37.841287 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:37.841213    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dgs7\" (UniqueName: \"kubernetes.io/projected/60d30759-5be6-44ee-ae8b-2a61caae4214-kube-api-access-9dgs7\") pod \"limitador-operator-controller-manager-74495c69f8-g5fvf\" (UID: \"60d30759-5be6-44ee-ae8b-2a61caae4214\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:37.943458 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:37.943417    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:38.166325 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:38.166290    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:38.268582 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:38.268474    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:38.790506 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:38.790481    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"]
Sep 15 11:43:38.793937 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:43:38.793905    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d30759_5be6_44ee_ae8b_2a61caae4214.slice/crio-37fa736fdde3c735cf6a0158a059790166ce0e9f538949283b61b3f1b05d2fdf WatchSource:0}: Error finding container 37fa736fdde3c735cf6a0158a059790166ce0e9f538949283b61b3f1b05d2fdf: Status 404 returned error can't find the container with id 37fa736fdde3c735cf6a0158a059790166ce0e9f538949283b61b3f1b05d2fdf
Sep 15 11:43:39.178500 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:39.178460    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf" event={"ID":"60d30759-5be6-44ee-ae8b-2a61caae4214","Type":"ContainerStarted","Data":"37fa736fdde3c735cf6a0158a059790166ce0e9f538949283b61b3f1b05d2fdf"}
Sep 15 11:43:40.057234 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:40.057193    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:40.308652 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:40.308554    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:40.471718 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:40.471672    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:40.572682 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:40.572594    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:41.191301 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.191269    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n" event={"ID":"8eb0dc47-9996-4117-9122-0d6732bce7e0","Type":"ContainerStarted","Data":"abe73fd639344d61326682f090f6679fdd162a35cd6fd75f7d980680555f7058"}
Sep 15 11:43:41.191498 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.191344    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:41.205843 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.205810    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78df58ddcd-xz5jl"]
Sep 15 11:43:41.209302 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.209279    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.218321 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.218266    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n" podStartSLOduration=2.338885738 podStartE2EDuration="6.218247327s" totalImagesPullingTime="3.879361589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:43:41.216031261 +0000 UTC m=+383.467588331" watchObservedRunningTime="2026-09-15 11:43:41.218247327 +0000 UTC m=+383.469804394"
Sep 15 11:43:41.223490 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.223463    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78df58ddcd-xz5jl"]
Sep 15 11:43:41.263365 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.263331    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bx2l\" (UniqueName: \"kubernetes.io/projected/98891bad-2a60-4b45-99cc-ebf2915a0589-kube-api-access-9bx2l\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.263560 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.263394    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98891bad-2a60-4b45-99cc-ebf2915a0589-console-serving-cert\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.263560 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.263430    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98891bad-2a60-4b45-99cc-ebf2915a0589-trusted-ca-bundle\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.263560 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.263537    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98891bad-2a60-4b45-99cc-ebf2915a0589-console-config\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.263736 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.263568    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98891bad-2a60-4b45-99cc-ebf2915a0589-console-oauth-config\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.263736 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.263583    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98891bad-2a60-4b45-99cc-ebf2915a0589-service-ca\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.263736 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.263603    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98891bad-2a60-4b45-99cc-ebf2915a0589-oauth-serving-cert\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.272264 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.272232    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:41.364413 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.364374    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98891bad-2a60-4b45-99cc-ebf2915a0589-console-config\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.364984 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.364441    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98891bad-2a60-4b45-99cc-ebf2915a0589-console-oauth-config\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.364984 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.364465    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98891bad-2a60-4b45-99cc-ebf2915a0589-service-ca\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.364984 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.364488    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98891bad-2a60-4b45-99cc-ebf2915a0589-oauth-serving-cert\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.364984 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.364534    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bx2l\" (UniqueName: \"kubernetes.io/projected/98891bad-2a60-4b45-99cc-ebf2915a0589-kube-api-access-9bx2l\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.364984 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.364590    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98891bad-2a60-4b45-99cc-ebf2915a0589-console-serving-cert\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.364984 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.364633    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98891bad-2a60-4b45-99cc-ebf2915a0589-trusted-ca-bundle\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.365415 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.365206    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98891bad-2a60-4b45-99cc-ebf2915a0589-console-config\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.365415 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.365296    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98891bad-2a60-4b45-99cc-ebf2915a0589-service-ca\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.365828 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.365802    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98891bad-2a60-4b45-99cc-ebf2915a0589-oauth-serving-cert\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.366147 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.366113    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98891bad-2a60-4b45-99cc-ebf2915a0589-trusted-ca-bundle\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.367643 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.367616    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98891bad-2a60-4b45-99cc-ebf2915a0589-console-oauth-config\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.368040 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.368018    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98891bad-2a60-4b45-99cc-ebf2915a0589-console-serving-cert\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.372294 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.372266    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:41.372975 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.372952    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bx2l\" (UniqueName: \"kubernetes.io/projected/98891bad-2a60-4b45-99cc-ebf2915a0589-kube-api-access-9bx2l\") pod \"console-78df58ddcd-xz5jl\" (UID: \"98891bad-2a60-4b45-99cc-ebf2915a0589\") " pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.521001 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.520961    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:41.708081 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.708044    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:41.805287 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:41.805259    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78df58ddcd-xz5jl"]
Sep 15 11:43:41.963375 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:43:41.963337    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98891bad_2a60_4b45_99cc_ebf2915a0589.slice/crio-fefcc36352c2629b106413718801f4a076f13f03658f4055575802049295e18f WatchSource:0}: Error finding container fefcc36352c2629b106413718801f4a076f13f03658f4055575802049295e18f: Status 404 returned error can't find the container with id fefcc36352c2629b106413718801f4a076f13f03658f4055575802049295e18f
Sep 15 11:43:42.197606 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:42.197563    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78df58ddcd-xz5jl" event={"ID":"98891bad-2a60-4b45-99cc-ebf2915a0589","Type":"ContainerStarted","Data":"53b61efe9f0ae7ead82fc058040fd46423041edb56d3f73021621191ea1ed53a"}
Sep 15 11:43:42.197794 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:42.197618    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78df58ddcd-xz5jl" event={"ID":"98891bad-2a60-4b45-99cc-ebf2915a0589","Type":"ContainerStarted","Data":"fefcc36352c2629b106413718801f4a076f13f03658f4055575802049295e18f"}
Sep 15 11:43:42.199347 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:42.199320    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf" event={"ID":"60d30759-5be6-44ee-ae8b-2a61caae4214","Type":"ContainerStarted","Data":"79f671a4ffb93b1bba9d39176e3db0405f9b2a1f96e6f36187383cb1bd1c8006"}
Sep 15 11:43:42.199469 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:42.199406    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:42.216275 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:42.216223    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78df58ddcd-xz5jl" podStartSLOduration=1.216203045 podStartE2EDuration="1.216203045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:43:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:43:42.21433367 +0000 UTC m=+384.465890729" watchObservedRunningTime="2026-09-15 11:43:42.216203045 +0000 UTC m=+384.467760102"
Sep 15 11:43:42.234085 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:42.234027    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf" podStartSLOduration=2.007899017 podStartE2EDuration="5.234004503s" totalImagesPullingTime="3.226105486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:43:42.233990235 +0000 UTC m=+384.485547330" watchObservedRunningTime="2026-09-15 11:43:42.234004503 +0000 UTC m=+384.485561562"
Sep 15 11:43:43.124039 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:43.124007    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:43.663399 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:43.663366    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:46.066326 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:46.066291    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:46.167781 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:46.167746    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:46.469581 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:46.469555    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:46.529056 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:46.528984    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:46.870640 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:46.870563    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:46.922714 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:46.922682    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:51.521219 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:51.521175    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:51.521714 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:51.521241    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:51.525942 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:51.525919    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:52.201718 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:52.201687    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:52.256639 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:52.256609    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78df58ddcd-xz5jl"
Sep 15 11:43:52.308865 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:52.308830    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-674bf65bdd-jrjnr"]
Sep 15 11:43:52.423001 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:52.422964    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:52.527473 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:52.527390    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:52.627331 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:52.627292    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:53.098101 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:53.098063    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:53.196530 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:53.196494    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:53.207251 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:53.207225    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:54.284062 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.284029    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"]
Sep 15 11:43:54.284517 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.284236    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n" podUID="8eb0dc47-9996-4117-9122-0d6732bce7e0" containerName="manager" containerID="cri-o://abe73fd639344d61326682f090f6679fdd162a35cd6fd75f7d980680555f7058" gracePeriod=2
Sep 15 11:43:54.299204 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.299172    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"]
Sep 15 11:43:54.306465 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:54.306422    2571 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8eb0dc47-9996-4117-9122-0d6732bce7e0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\": pods \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:54.309406 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.309381    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"]
Sep 15 11:43:54.309972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.309871    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb0dc47-9996-4117-9122-0d6732bce7e0" containerName="manager"
Sep 15 11:43:54.309972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.309895    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb0dc47-9996-4117-9122-0d6732bce7e0" containerName="manager"
Sep 15 11:43:54.310192 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.309977    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb0dc47-9996-4117-9122-0d6732bce7e0" containerName="manager"
Sep 15 11:43:54.314752 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.314732    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"]
Sep 15 11:43:54.314915 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.314891    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"
Sep 15 11:43:54.314915 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.314902    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf" podUID="60d30759-5be6-44ee-ae8b-2a61caae4214" containerName="manager" containerID="cri-o://79f671a4ffb93b1bba9d39176e3db0405f9b2a1f96e6f36187383cb1bd1c8006" gracePeriod=2
Sep 15 11:43:54.327426 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.327399    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"]
Sep 15 11:43:54.329565 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:54.329514    2571 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"60d30759-5be6-44ee-ae8b-2a61caae4214\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-g5fvf\": pods \"limitador-operator-controller-manager-74495c69f8-g5fvf\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:54.329853 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.329811    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"]
Sep 15 11:43:54.331507 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:54.331475    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="8eb0dc47-9996-4117-9122-0d6732bce7e0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:54.334699 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:54.334654    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-g5fvf\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="60d30759-5be6-44ee-ae8b-2a61caae4214" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:54.346897 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.346870    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fvrzw"]
Sep 15 11:43:54.347349 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.347333    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d30759-5be6-44ee-ae8b-2a61caae4214" containerName="manager"
Sep 15 11:43:54.347446 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.347353    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d30759-5be6-44ee-ae8b-2a61caae4214" containerName="manager"
Sep 15 11:43:54.347446 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.347432    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d30759-5be6-44ee-ae8b-2a61caae4214" containerName="manager"
Sep 15 11:43:54.350581 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.350563    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fvrzw"
Sep 15 11:43:54.360036 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.360007    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fvrzw"]
Sep 15 11:43:54.366029 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:54.365990    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="8eb0dc47-9996-4117-9122-0d6732bce7e0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:54.368136 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:54.368111    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-g5fvf\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="60d30759-5be6-44ee-ae8b-2a61caae4214" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:54.389496 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:54.389459    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="8eb0dc47-9996-4117-9122-0d6732bce7e0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:54.391913 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.391888    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd52db49-ac03-412b-9ba8-8ef3224eac1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-s497r\" (UID: \"bd52db49-ac03-412b-9ba8-8ef3224eac1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"
Sep 15 11:43:54.392039 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.391924    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kzks\" (UniqueName: \"kubernetes.io/projected/bd52db49-ac03-412b-9ba8-8ef3224eac1b-kube-api-access-8kzks\") pod \"kuadrant-operator-controller-manager-76f8f686bf-s497r\" (UID: \"bd52db49-ac03-412b-9ba8-8ef3224eac1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"
Sep 15 11:43:54.492866 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.492826    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5vv4\" (UniqueName: \"kubernetes.io/projected/90aa8415-82a0-4844-9b93-d66557389f65-kube-api-access-r5vv4\") pod \"limitador-operator-controller-manager-74495c69f8-fvrzw\" (UID: \"90aa8415-82a0-4844-9b93-d66557389f65\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fvrzw"
Sep 15 11:43:54.493005 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.492986    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd52db49-ac03-412b-9ba8-8ef3224eac1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-s497r\" (UID: \"bd52db49-ac03-412b-9ba8-8ef3224eac1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"
Sep 15 11:43:54.493051 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.493017    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kzks\" (UniqueName: \"kubernetes.io/projected/bd52db49-ac03-412b-9ba8-8ef3224eac1b-kube-api-access-8kzks\") pod \"kuadrant-operator-controller-manager-76f8f686bf-s497r\" (UID: \"bd52db49-ac03-412b-9ba8-8ef3224eac1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"
Sep 15 11:43:54.493446 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.493418    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd52db49-ac03-412b-9ba8-8ef3224eac1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-s497r\" (UID: \"bd52db49-ac03-412b-9ba8-8ef3224eac1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"
Sep 15 11:43:54.505019 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.504988    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kzks\" (UniqueName: \"kubernetes.io/projected/bd52db49-ac03-412b-9ba8-8ef3224eac1b-kube-api-access-8kzks\") pod \"kuadrant-operator-controller-manager-76f8f686bf-s497r\" (UID: \"bd52db49-ac03-412b-9ba8-8ef3224eac1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"
Sep 15 11:43:54.560463 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.560441    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:54.562881 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:54.562857    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="8eb0dc47-9996-4117-9122-0d6732bce7e0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:54.563105 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.563086    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:54.564838 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:54.564814    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-g5fvf\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="60d30759-5be6-44ee-ae8b-2a61caae4214" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:54.566575 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:54.566554    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-g5fvf\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="60d30759-5be6-44ee-ae8b-2a61caae4214" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:54.568286 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:54.568259    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="8eb0dc47-9996-4117-9122-0d6732bce7e0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:54.593731 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.593698    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5vv4\" (UniqueName: \"kubernetes.io/projected/90aa8415-82a0-4844-9b93-d66557389f65-kube-api-access-r5vv4\") pod \"limitador-operator-controller-manager-74495c69f8-fvrzw\" (UID: \"90aa8415-82a0-4844-9b93-d66557389f65\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fvrzw"
Sep 15 11:43:54.605684 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.605653    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5vv4\" (UniqueName: \"kubernetes.io/projected/90aa8415-82a0-4844-9b93-d66557389f65-kube-api-access-r5vv4\") pod \"limitador-operator-controller-manager-74495c69f8-fvrzw\" (UID: \"90aa8415-82a0-4844-9b93-d66557389f65\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fvrzw"
Sep 15 11:43:54.694989 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.694939    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8eb0dc47-9996-4117-9122-0d6732bce7e0-extensions-socket-volume\") pod \"8eb0dc47-9996-4117-9122-0d6732bce7e0\" (UID: \"8eb0dc47-9996-4117-9122-0d6732bce7e0\") "
Sep 15 11:43:54.695187 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.695090    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsb4d\" (UniqueName: \"kubernetes.io/projected/8eb0dc47-9996-4117-9122-0d6732bce7e0-kube-api-access-tsb4d\") pod \"8eb0dc47-9996-4117-9122-0d6732bce7e0\" (UID: \"8eb0dc47-9996-4117-9122-0d6732bce7e0\") "
Sep 15 11:43:54.695187 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.695122    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dgs7\" (UniqueName: \"kubernetes.io/projected/60d30759-5be6-44ee-ae8b-2a61caae4214-kube-api-access-9dgs7\") pod \"60d30759-5be6-44ee-ae8b-2a61caae4214\" (UID: \"60d30759-5be6-44ee-ae8b-2a61caae4214\") "
Sep 15 11:43:54.695539 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.695509    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eb0dc47-9996-4117-9122-0d6732bce7e0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8eb0dc47-9996-4117-9122-0d6732bce7e0" (UID: "8eb0dc47-9996-4117-9122-0d6732bce7e0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:43:54.697288 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.697261    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60d30759-5be6-44ee-ae8b-2a61caae4214-kube-api-access-9dgs7" (OuterVolumeSpecName: "kube-api-access-9dgs7") pod "60d30759-5be6-44ee-ae8b-2a61caae4214" (UID: "60d30759-5be6-44ee-ae8b-2a61caae4214"). InnerVolumeSpecName "kube-api-access-9dgs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:54.697396 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.697326    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eb0dc47-9996-4117-9122-0d6732bce7e0-kube-api-access-tsb4d" (OuterVolumeSpecName: "kube-api-access-tsb4d") pod "8eb0dc47-9996-4117-9122-0d6732bce7e0" (UID: "8eb0dc47-9996-4117-9122-0d6732bce7e0"). InnerVolumeSpecName "kube-api-access-tsb4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:43:54.723552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.723527    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"
Sep 15 11:43:54.730713 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.730692    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fvrzw"
Sep 15 11:43:54.796185 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.796060    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsb4d\" (UniqueName: \"kubernetes.io/projected/8eb0dc47-9996-4117-9122-0d6732bce7e0-kube-api-access-tsb4d\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:43:54.796185 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.796084    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dgs7\" (UniqueName: \"kubernetes.io/projected/60d30759-5be6-44ee-ae8b-2a61caae4214-kube-api-access-9dgs7\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:43:54.796185 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:54.796095    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8eb0dc47-9996-4117-9122-0d6732bce7e0-extensions-socket-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:43:55.002785 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.002757    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"]
Sep 15 11:43:55.004951 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:43:55.004921    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd52db49_ac03_412b_9ba8_8ef3224eac1b.slice/crio-45c3a768c942cb8ad1e5942c5e8b95435bf823e90ac0150318927e11b63576aa WatchSource:0}: Error finding container 45c3a768c942cb8ad1e5942c5e8b95435bf823e90ac0150318927e11b63576aa: Status 404 returned error can't find the container with id 45c3a768c942cb8ad1e5942c5e8b95435bf823e90ac0150318927e11b63576aa
Sep 15 11:43:55.015064 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.015040    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fvrzw"]
Sep 15 11:43:55.020356 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:43:55.020320    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90aa8415_82a0_4844_9b93_d66557389f65.slice/crio-5704fe9811c6f86248e7c5d59234fabf632d24161f1cfaf950d387df3931467b WatchSource:0}: Error finding container 5704fe9811c6f86248e7c5d59234fabf632d24161f1cfaf950d387df3931467b: Status 404 returned error can't find the container with id 5704fe9811c6f86248e7c5d59234fabf632d24161f1cfaf950d387df3931467b
Sep 15 11:43:55.269183 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.269125    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r" event={"ID":"bd52db49-ac03-412b-9ba8-8ef3224eac1b","Type":"ContainerStarted","Data":"507662e09e17543ca27dbfea852d7fbbac99531c93d98bdba3f4dfe838958c78"}
Sep 15 11:43:55.269350 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.269214    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"
Sep 15 11:43:55.269350 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.269238    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r" event={"ID":"bd52db49-ac03-412b-9ba8-8ef3224eac1b","Type":"ContainerStarted","Data":"45c3a768c942cb8ad1e5942c5e8b95435bf823e90ac0150318927e11b63576aa"}
Sep 15 11:43:55.270924 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.270897    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fvrzw" event={"ID":"90aa8415-82a0-4844-9b93-d66557389f65","Type":"ContainerStarted","Data":"b391871707523f3ba7e448820470596c79568088fa170016f37c156361e6af18"}
Sep 15 11:43:55.271034 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.270938    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fvrzw" event={"ID":"90aa8415-82a0-4844-9b93-d66557389f65","Type":"ContainerStarted","Data":"5704fe9811c6f86248e7c5d59234fabf632d24161f1cfaf950d387df3931467b"}
Sep 15 11:43:55.271034 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.270975    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fvrzw"
Sep 15 11:43:55.271292 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:55.271264    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="8eb0dc47-9996-4117-9122-0d6732bce7e0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:55.272306 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.272287    2571 generic.go:356] "Generic (PLEG): container finished" podID="8eb0dc47-9996-4117-9122-0d6732bce7e0" containerID="abe73fd639344d61326682f090f6679fdd162a35cd6fd75f7d980680555f7058" exitCode=0
Sep 15 11:43:55.272374 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.272344    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:55.272374 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.272365    2571 scope.go:117] "RemoveContainer" containerID="abe73fd639344d61326682f090f6679fdd162a35cd6fd75f7d980680555f7058"
Sep 15 11:43:55.273483 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:55.273383    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-g5fvf\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="60d30759-5be6-44ee-ae8b-2a61caae4214" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:55.273985 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.273961    2571 generic.go:356] "Generic (PLEG): container finished" podID="60d30759-5be6-44ee-ae8b-2a61caae4214" containerID="79f671a4ffb93b1bba9d39176e3db0405f9b2a1f96e6f36187383cb1bd1c8006" exitCode=0
Sep 15 11:43:55.274079 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.274019    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:55.282431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.282411    2571 scope.go:117] "RemoveContainer" containerID="abe73fd639344d61326682f090f6679fdd162a35cd6fd75f7d980680555f7058"
Sep 15 11:43:55.282728 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:55.282709    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abe73fd639344d61326682f090f6679fdd162a35cd6fd75f7d980680555f7058\": container with ID starting with abe73fd639344d61326682f090f6679fdd162a35cd6fd75f7d980680555f7058 not found: ID does not exist" containerID="abe73fd639344d61326682f090f6679fdd162a35cd6fd75f7d980680555f7058"
Sep 15 11:43:55.282808 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.282740    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abe73fd639344d61326682f090f6679fdd162a35cd6fd75f7d980680555f7058"} err="failed to get container status \"abe73fd639344d61326682f090f6679fdd162a35cd6fd75f7d980680555f7058\": rpc error: code = NotFound desc = could not find container \"abe73fd639344d61326682f090f6679fdd162a35cd6fd75f7d980680555f7058\": container with ID starting with abe73fd639344d61326682f090f6679fdd162a35cd6fd75f7d980680555f7058 not found: ID does not exist"
Sep 15 11:43:55.282808 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.282764    2571 scope.go:117] "RemoveContainer" containerID="79f671a4ffb93b1bba9d39176e3db0405f9b2a1f96e6f36187383cb1bd1c8006"
Sep 15 11:43:55.291007 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.290869    2571 scope.go:117] "RemoveContainer" containerID="79f671a4ffb93b1bba9d39176e3db0405f9b2a1f96e6f36187383cb1bd1c8006"
Sep 15 11:43:55.291338 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:55.291148    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79f671a4ffb93b1bba9d39176e3db0405f9b2a1f96e6f36187383cb1bd1c8006\": container with ID starting with 79f671a4ffb93b1bba9d39176e3db0405f9b2a1f96e6f36187383cb1bd1c8006 not found: ID does not exist" containerID="79f671a4ffb93b1bba9d39176e3db0405f9b2a1f96e6f36187383cb1bd1c8006"
Sep 15 11:43:55.291338 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.291195    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f671a4ffb93b1bba9d39176e3db0405f9b2a1f96e6f36187383cb1bd1c8006"} err="failed to get container status \"79f671a4ffb93b1bba9d39176e3db0405f9b2a1f96e6f36187383cb1bd1c8006\": rpc error: code = NotFound desc = could not find container \"79f671a4ffb93b1bba9d39176e3db0405f9b2a1f96e6f36187383cb1bd1c8006\": container with ID starting with 79f671a4ffb93b1bba9d39176e3db0405f9b2a1f96e6f36187383cb1bd1c8006 not found: ID does not exist"
Sep 15 11:43:55.297797 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:55.297731    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-g5fvf\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="60d30759-5be6-44ee-ae8b-2a61caae4214" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-g5fvf"
Sep 15 11:43:55.298619 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.298569    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r" podStartSLOduration=1.298552243 podStartE2EDuration="1.298552243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:43:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:43:55.295674298 +0000 UTC m=+397.547231380" watchObservedRunningTime="2026-09-15 11:43:55.298552243 +0000 UTC m=+397.550109300"
Sep 15 11:43:55.324083 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.324020    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fvrzw" podStartSLOduration=1.323994743 podStartE2EDuration="1.323994743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:43:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:43:55.322143367 +0000 UTC m=+397.573700427" watchObservedRunningTime="2026-09-15 11:43:55.323994743 +0000 UTC m=+397.575551801"
Sep 15 11:43:55.324268 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:43:55.324191    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-mpf4n\" is forbidden: User \"system:node:ip-10-0-141-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-110.ec2.internal' and this object" podUID="8eb0dc47-9996-4117-9122-0d6732bce7e0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mpf4n"
Sep 15 11:43:55.561630 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.561538    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:55.665850 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:55.665819    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:43:56.215410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:56.215373    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60d30759-5be6-44ee-ae8b-2a61caae4214" path="/var/lib/kubelet/pods/60d30759-5be6-44ee-ae8b-2a61caae4214/volumes"
Sep 15 11:43:56.215812 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:43:56.215796    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eb0dc47-9996-4117-9122-0d6732bce7e0" path="/var/lib/kubelet/pods/8eb0dc47-9996-4117-9122-0d6732bce7e0/volumes"
Sep 15 11:44:02.077623 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:02.077575    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:02.191602 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:02.191572    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:06.282971 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:06.282940    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fvrzw"
Sep 15 11:44:06.283571 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:06.283015    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"
Sep 15 11:44:07.087731 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:07.087692    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:07.186437 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:07.186402    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:07.476086 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:07.476055    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:07.577499 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:07.577466    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:07.882826 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:07.882746    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:07.942672 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:07.942638    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:09.768942 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:09.768904    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"]
Sep 15 11:44:09.769442 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:09.769149    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r" podUID="bd52db49-ac03-412b-9ba8-8ef3224eac1b" containerName="manager" containerID="cri-o://507662e09e17543ca27dbfea852d7fbbac99531c93d98bdba3f4dfe838958c78" gracePeriod=10
Sep 15 11:44:10.041337 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.041312    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"
Sep 15 11:44:10.132950 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.132920    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd52db49-ac03-412b-9ba8-8ef3224eac1b-extensions-socket-volume\") pod \"bd52db49-ac03-412b-9ba8-8ef3224eac1b\" (UID: \"bd52db49-ac03-412b-9ba8-8ef3224eac1b\") "
Sep 15 11:44:10.133196 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.132972    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kzks\" (UniqueName: \"kubernetes.io/projected/bd52db49-ac03-412b-9ba8-8ef3224eac1b-kube-api-access-8kzks\") pod \"bd52db49-ac03-412b-9ba8-8ef3224eac1b\" (UID: \"bd52db49-ac03-412b-9ba8-8ef3224eac1b\") "
Sep 15 11:44:10.133329 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.133305    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd52db49-ac03-412b-9ba8-8ef3224eac1b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bd52db49-ac03-412b-9ba8-8ef3224eac1b" (UID: "bd52db49-ac03-412b-9ba8-8ef3224eac1b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:44:10.135022 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.135002    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd52db49-ac03-412b-9ba8-8ef3224eac1b-kube-api-access-8kzks" (OuterVolumeSpecName: "kube-api-access-8kzks") pod "bd52db49-ac03-412b-9ba8-8ef3224eac1b" (UID: "bd52db49-ac03-412b-9ba8-8ef3224eac1b"). InnerVolumeSpecName "kube-api-access-8kzks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:44:10.234373 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.234347    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd52db49-ac03-412b-9ba8-8ef3224eac1b-extensions-socket-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:44:10.234373 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.234371    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kzks\" (UniqueName: \"kubernetes.io/projected/bd52db49-ac03-412b-9ba8-8ef3224eac1b-kube-api-access-8kzks\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:44:10.352355 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.352262    2571 generic.go:356] "Generic (PLEG): container finished" podID="bd52db49-ac03-412b-9ba8-8ef3224eac1b" containerID="507662e09e17543ca27dbfea852d7fbbac99531c93d98bdba3f4dfe838958c78" exitCode=0
Sep 15 11:44:10.352355 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.352310    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"
Sep 15 11:44:10.352355 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.352320    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r" event={"ID":"bd52db49-ac03-412b-9ba8-8ef3224eac1b","Type":"ContainerDied","Data":"507662e09e17543ca27dbfea852d7fbbac99531c93d98bdba3f4dfe838958c78"}
Sep 15 11:44:10.352580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.352375    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r" event={"ID":"bd52db49-ac03-412b-9ba8-8ef3224eac1b","Type":"ContainerDied","Data":"45c3a768c942cb8ad1e5942c5e8b95435bf823e90ac0150318927e11b63576aa"}
Sep 15 11:44:10.352580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.352406    2571 scope.go:117] "RemoveContainer" containerID="507662e09e17543ca27dbfea852d7fbbac99531c93d98bdba3f4dfe838958c78"
Sep 15 11:44:10.361334 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.361313    2571 scope.go:117] "RemoveContainer" containerID="507662e09e17543ca27dbfea852d7fbbac99531c93d98bdba3f4dfe838958c78"
Sep 15 11:44:10.361616 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:44:10.361598    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"507662e09e17543ca27dbfea852d7fbbac99531c93d98bdba3f4dfe838958c78\": container with ID starting with 507662e09e17543ca27dbfea852d7fbbac99531c93d98bdba3f4dfe838958c78 not found: ID does not exist" containerID="507662e09e17543ca27dbfea852d7fbbac99531c93d98bdba3f4dfe838958c78"
Sep 15 11:44:10.361682 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.361629    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507662e09e17543ca27dbfea852d7fbbac99531c93d98bdba3f4dfe838958c78"} err="failed to get container status \"507662e09e17543ca27dbfea852d7fbbac99531c93d98bdba3f4dfe838958c78\": rpc error: code = NotFound desc = could not find container \"507662e09e17543ca27dbfea852d7fbbac99531c93d98bdba3f4dfe838958c78\": container with ID starting with 507662e09e17543ca27dbfea852d7fbbac99531c93d98bdba3f4dfe838958c78 not found: ID does not exist"
Sep 15 11:44:10.383310 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.383281    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"]
Sep 15 11:44:10.408461 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:10.403830    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-s497r"]
Sep 15 11:44:12.214530 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:12.214495    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd52db49-ac03-412b-9ba8-8ef3224eac1b" path="/var/lib/kubelet/pods/bd52db49-ac03-412b-9ba8-8ef3224eac1b/volumes"
Sep 15 11:44:13.700945 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:13.700907    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:13.800797 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:13.800765    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:14.889551 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:14.889516    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:14.992199 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:14.992147    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:17.330608 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.330556    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-674bf65bdd-jrjnr" podUID="d6183a79-ba68-4c9d-a993-39ae1a4c8e02" containerName="console" containerID="cri-o://2dc5d8a71c8b57199a6632d508345b67539b4e7ee4cf255fc146aa25cc404b4e" gracePeriod=15
Sep 15 11:44:17.341384 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.341342    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:17.441919 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.441887    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:17.582562 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.582508    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:44:17.602929 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.602266    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-serving-cert\") pod \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") "
Sep 15 11:44:17.602929 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.602365    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvnsj\" (UniqueName: \"kubernetes.io/projected/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-kube-api-access-nvnsj\") pod \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") "
Sep 15 11:44:17.602929 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.602399    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-oauth-config\") pod \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") "
Sep 15 11:44:17.602929 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.602440    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-service-ca\") pod \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") "
Sep 15 11:44:17.602929 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.602497    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-trusted-ca-bundle\") pod \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") "
Sep 15 11:44:17.602929 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.602526    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-config\") pod \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") "
Sep 15 11:44:17.602929 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.602592    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-oauth-serving-cert\") pod \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\" (UID: \"d6183a79-ba68-4c9d-a993-39ae1a4c8e02\") "
Sep 15 11:44:17.603478 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.603035    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d6183a79-ba68-4c9d-a993-39ae1a4c8e02" (UID: "d6183a79-ba68-4c9d-a993-39ae1a4c8e02"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:44:17.603478 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.603224    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d6183a79-ba68-4c9d-a993-39ae1a4c8e02" (UID: "d6183a79-ba68-4c9d-a993-39ae1a4c8e02"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:44:17.603478 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.603238    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-service-ca" (OuterVolumeSpecName: "service-ca") pod "d6183a79-ba68-4c9d-a993-39ae1a4c8e02" (UID: "d6183a79-ba68-4c9d-a993-39ae1a4c8e02"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:44:17.603478 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.603318    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-config" (OuterVolumeSpecName: "console-config") pod "d6183a79-ba68-4c9d-a993-39ae1a4c8e02" (UID: "d6183a79-ba68-4c9d-a993-39ae1a4c8e02"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:44:17.605239 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.605181    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d6183a79-ba68-4c9d-a993-39ae1a4c8e02" (UID: "d6183a79-ba68-4c9d-a993-39ae1a4c8e02"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:44:17.605690 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.605671    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d6183a79-ba68-4c9d-a993-39ae1a4c8e02" (UID: "d6183a79-ba68-4c9d-a993-39ae1a4c8e02"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:44:17.605784 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.605692    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-kube-api-access-nvnsj" (OuterVolumeSpecName: "kube-api-access-nvnsj") pod "d6183a79-ba68-4c9d-a993-39ae1a4c8e02" (UID: "d6183a79-ba68-4c9d-a993-39ae1a4c8e02"). InnerVolumeSpecName "kube-api-access-nvnsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:44:17.703485 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.703446    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-oauth-serving-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:44:17.703485 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.703479    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-serving-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:44:17.703485 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.703488    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvnsj\" (UniqueName: \"kubernetes.io/projected/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-kube-api-access-nvnsj\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:44:17.703485 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.703499    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-oauth-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:44:17.703758 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.703509    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:44:17.703758 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.703519    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-trusted-ca-bundle\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:44:17.703758 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:17.703529    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6183a79-ba68-4c9d-a993-39ae1a4c8e02-console-config\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:44:18.398268 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:18.398235    2571 generic.go:356] "Generic (PLEG): container finished" podID="d6183a79-ba68-4c9d-a993-39ae1a4c8e02" containerID="2dc5d8a71c8b57199a6632d508345b67539b4e7ee4cf255fc146aa25cc404b4e" exitCode=0
Sep 15 11:44:18.398706 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:18.398284    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674bf65bdd-jrjnr"
Sep 15 11:44:18.398706 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:18.398320    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674bf65bdd-jrjnr" event={"ID":"d6183a79-ba68-4c9d-a993-39ae1a4c8e02","Type":"ContainerDied","Data":"2dc5d8a71c8b57199a6632d508345b67539b4e7ee4cf255fc146aa25cc404b4e"}
Sep 15 11:44:18.398706 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:18.398376    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674bf65bdd-jrjnr" event={"ID":"d6183a79-ba68-4c9d-a993-39ae1a4c8e02","Type":"ContainerDied","Data":"fde924b56129a95e26d9bc46943826a8779e1d847594ce8ac1f4ee931477197f"}
Sep 15 11:44:18.398706 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:18.398401    2571 scope.go:117] "RemoveContainer" containerID="2dc5d8a71c8b57199a6632d508345b67539b4e7ee4cf255fc146aa25cc404b4e"
Sep 15 11:44:18.407006 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:18.406990    2571 scope.go:117] "RemoveContainer" containerID="2dc5d8a71c8b57199a6632d508345b67539b4e7ee4cf255fc146aa25cc404b4e"
Sep 15 11:44:18.407353 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:44:18.407331    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dc5d8a71c8b57199a6632d508345b67539b4e7ee4cf255fc146aa25cc404b4e\": container with ID starting with 2dc5d8a71c8b57199a6632d508345b67539b4e7ee4cf255fc146aa25cc404b4e not found: ID does not exist" containerID="2dc5d8a71c8b57199a6632d508345b67539b4e7ee4cf255fc146aa25cc404b4e"
Sep 15 11:44:18.407409 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:18.407363    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc5d8a71c8b57199a6632d508345b67539b4e7ee4cf255fc146aa25cc404b4e"} err="failed to get container status \"2dc5d8a71c8b57199a6632d508345b67539b4e7ee4cf255fc146aa25cc404b4e\": rpc error: code = NotFound desc = could not find container \"2dc5d8a71c8b57199a6632d508345b67539b4e7ee4cf255fc146aa25cc404b4e\": container with ID starting with 2dc5d8a71c8b57199a6632d508345b67539b4e7ee4cf255fc146aa25cc404b4e not found: ID does not exist"
Sep 15 11:44:18.415772 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:18.415737    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-674bf65bdd-jrjnr"]
Sep 15 11:44:18.421892 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:18.421864    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-674bf65bdd-jrjnr"]
Sep 15 11:44:20.219222 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:20.219182    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6183a79-ba68-4c9d-a993-39ae1a4c8e02" path="/var/lib/kubelet/pods/d6183a79-ba68-4c9d-a993-39ae1a4c8e02/volumes"
Sep 15 11:44:23.892954 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:23.892916    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:24.033125 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:24.033074    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:26.072883 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.072845    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"]
Sep 15 11:44:26.073306 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.073292    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd52db49-ac03-412b-9ba8-8ef3224eac1b" containerName="manager"
Sep 15 11:44:26.073352 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.073307    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd52db49-ac03-412b-9ba8-8ef3224eac1b" containerName="manager"
Sep 15 11:44:26.073352 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.073325    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6183a79-ba68-4c9d-a993-39ae1a4c8e02" containerName="console"
Sep 15 11:44:26.073352 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.073331    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6183a79-ba68-4c9d-a993-39ae1a4c8e02" containerName="console"
Sep 15 11:44:26.073445 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.073384    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd52db49-ac03-412b-9ba8-8ef3224eac1b" containerName="manager"
Sep 15 11:44:26.073445 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.073397    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6183a79-ba68-4c9d-a993-39ae1a4c8e02" containerName="console"
Sep 15 11:44:26.078244 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.078221    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.080716 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.080685    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 11:44:26.081003 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.080982    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rrxwn\""
Sep 15 11:44:26.081116 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.081007    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 11:44:26.081116 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.081007    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 11:44:26.089423 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.089399    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"]
Sep 15 11:44:26.103751 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.103718    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:26.182209 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.182135    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.182478 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.182442    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d238557-cfcf-4620-9aed-9b5f1a59268e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.182621 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.182497    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7dmq\" (UniqueName: \"kubernetes.io/projected/5d238557-cfcf-4620-9aed-9b5f1a59268e-kube-api-access-k7dmq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.182621 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.182601    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.182731 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.182681    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.182781 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.182729    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.182781 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.182772    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d238557-cfcf-4620-9aed-9b5f1a59268e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.182862 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.182803    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.182862 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.182846    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d238557-cfcf-4620-9aed-9b5f1a59268e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.283979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.283945    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.284131 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.284000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.284131 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.284027    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.284131 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.284051    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d238557-cfcf-4620-9aed-9b5f1a59268e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.284334 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.284275    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.284390 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.284338    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d238557-cfcf-4620-9aed-9b5f1a59268e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.284448 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.284341    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.284448 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.284414    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.284448 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.284410    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.284600 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.284475    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.284600 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.284479    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d238557-cfcf-4620-9aed-9b5f1a59268e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.284600 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.284542    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7dmq\" (UniqueName: \"kubernetes.io/projected/5d238557-cfcf-4620-9aed-9b5f1a59268e-kube-api-access-k7dmq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.284600 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.284569    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.285054 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.285030    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d238557-cfcf-4620-9aed-9b5f1a59268e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.286396 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.286378    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d238557-cfcf-4620-9aed-9b5f1a59268e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.286656 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.286638    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d238557-cfcf-4620-9aed-9b5f1a59268e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.293025 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.292998    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d238557-cfcf-4620-9aed-9b5f1a59268e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.293416 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.293389    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7dmq\" (UniqueName: \"kubernetes.io/projected/5d238557-cfcf-4620-9aed-9b5f1a59268e-kube-api-access-k7dmq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-cg52h\" (UID: \"5d238557-cfcf-4620-9aed-9b5f1a59268e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.388680 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.388591    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:26.512860 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.512826    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:26.666296 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:26.666184    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"]
Sep 15 11:44:26.668882 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:44:26.668858    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d238557_cfcf_4620_9aed_9b5f1a59268e.slice/crio-8788878ab48955d23526552d72caaded310952c2932c64306dc81468a90bfeb1 WatchSource:0}: Error finding container 8788878ab48955d23526552d72caaded310952c2932c64306dc81468a90bfeb1: Status 404 returned error can't find the container with id 8788878ab48955d23526552d72caaded310952c2932c64306dc81468a90bfeb1
Sep 15 11:44:27.443816 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:27.443781    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h" event={"ID":"5d238557-cfcf-4620-9aed-9b5f1a59268e","Type":"ContainerStarted","Data":"8788878ab48955d23526552d72caaded310952c2932c64306dc81468a90bfeb1"}
Sep 15 11:44:29.875903 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:29.875867    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:44:29.876176 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:29.875943    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:44:29.876176 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:29.875970    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:44:30.460274 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:30.460234    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h" event={"ID":"5d238557-cfcf-4620-9aed-9b5f1a59268e","Type":"ContainerStarted","Data":"9e6d4ecfe54b95c413e2dc08fdfff4d9ccf2e8eaf09304c942dcedd37c9d3d1c"}
Sep 15 11:44:30.482130 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:30.482082    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h" podStartSLOduration=1.284102098 podStartE2EDuration="4.482065123s" totalImagesPullingTime="3.197963025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:30.480896373 +0000 UTC m=+432.732453442" watchObservedRunningTime="2026-09-15 11:44:30.482065123 +0000 UTC m=+432.733622181"
Sep 15 11:44:31.389047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.389016    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:31.393657 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.393634    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:31.465662 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.465634    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:31.466437 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.466417    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:44:31.515023 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.514993    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:31.521990 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.521963    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6kzgb"]
Sep 15 11:44:31.525590 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.525567    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-6kzgb"
Sep 15 11:44:31.527973 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.527952    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hhdjf\""
Sep 15 11:44:31.528092 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.527984    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 15 11:44:31.533919 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.533896    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6kzgb"]
Sep 15 11:44:31.615981 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.615952    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:31.622658 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.622628    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6kzgb"]
Sep 15 11:44:31.630884 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.630859    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d9bz\" (UniqueName: \"kubernetes.io/projected/02fdff22-073a-471c-bfde-29bda3940a0b-kube-api-access-7d9bz\") pod \"limitador-limitador-8588749977-6kzgb\" (UID: \"02fdff22-073a-471c-bfde-29bda3940a0b\") " pod="kuadrant-system/limitador-limitador-8588749977-6kzgb"
Sep 15 11:44:31.631010 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.630937    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/02fdff22-073a-471c-bfde-29bda3940a0b-config-file\") pod \"limitador-limitador-8588749977-6kzgb\" (UID: \"02fdff22-073a-471c-bfde-29bda3940a0b\") " pod="kuadrant-system/limitador-limitador-8588749977-6kzgb"
Sep 15 11:44:31.716978 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.716952    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:31.732250 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.732228    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d9bz\" (UniqueName: \"kubernetes.io/projected/02fdff22-073a-471c-bfde-29bda3940a0b-kube-api-access-7d9bz\") pod \"limitador-limitador-8588749977-6kzgb\" (UID: \"02fdff22-073a-471c-bfde-29bda3940a0b\") " pod="kuadrant-system/limitador-limitador-8588749977-6kzgb"
Sep 15 11:44:31.732427 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.732279    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/02fdff22-073a-471c-bfde-29bda3940a0b-config-file\") pod \"limitador-limitador-8588749977-6kzgb\" (UID: \"02fdff22-073a-471c-bfde-29bda3940a0b\") " pod="kuadrant-system/limitador-limitador-8588749977-6kzgb"
Sep 15 11:44:31.732973 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.732942    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/02fdff22-073a-471c-bfde-29bda3940a0b-config-file\") pod \"limitador-limitador-8588749977-6kzgb\" (UID: \"02fdff22-073a-471c-bfde-29bda3940a0b\") " pod="kuadrant-system/limitador-limitador-8588749977-6kzgb"
Sep 15 11:44:31.740490 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.740470    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d9bz\" (UniqueName: \"kubernetes.io/projected/02fdff22-073a-471c-bfde-29bda3940a0b-kube-api-access-7d9bz\") pod \"limitador-limitador-8588749977-6kzgb\" (UID: \"02fdff22-073a-471c-bfde-29bda3940a0b\") " pod="kuadrant-system/limitador-limitador-8588749977-6kzgb"
Sep 15 11:44:31.839087 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:31.839051    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-6kzgb"
Sep 15 11:44:32.108250 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:32.108190    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6kzgb"]
Sep 15 11:44:32.110480 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:44:32.110452    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02fdff22_073a_471c_bfde_29bda3940a0b.slice/crio-cb7f938fdfe4db4dc67d5e916e04e98014963cd863708398b243f12a65c79b3e WatchSource:0}: Error finding container cb7f938fdfe4db4dc67d5e916e04e98014963cd863708398b243f12a65c79b3e: Status 404 returned error can't find the container with id cb7f938fdfe4db4dc67d5e916e04e98014963cd863708398b243f12a65c79b3e
Sep 15 11:44:32.377229 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:32.377091    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:32.465825 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:32.465791    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:32.470797 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:32.470769    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-6kzgb" event={"ID":"02fdff22-073a-471c-bfde-29bda3940a0b","Type":"ContainerStarted","Data":"cb7f938fdfe4db4dc67d5e916e04e98014963cd863708398b243f12a65c79b3e"}
Sep 15 11:44:33.476940 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:33.476897    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-6kzgb" event={"ID":"02fdff22-073a-471c-bfde-29bda3940a0b","Type":"ContainerStarted","Data":"b1f0e31876d6cd2342f62df9473db9b36ef4af18d560e22645dea6830dce8dc6"}
Sep 15 11:44:33.477391 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:33.476969    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-6kzgb"
Sep 15 11:44:33.498398 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:33.498347    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-6kzgb" podStartSLOduration=1.334224137 podStartE2EDuration="2.498329748s" totalImagesPullingTime="1.164105611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:33.49689115 +0000 UTC m=+435.748448221" watchObservedRunningTime="2026-09-15 11:44:33.498329748 +0000 UTC m=+435.749886844"
Sep 15 11:44:36.598047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:36.598012    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:36.667557 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:36.667515    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:44.482906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:44.482818    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-6kzgb"
Sep 15 11:44:44.704799 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:44.704762    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:44.758784 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:44.758713    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:44.925482 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:44.925446    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6kzgb"]
Sep 15 11:44:44.925676 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:44.925655    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-6kzgb" podUID="02fdff22-073a-471c-bfde-29bda3940a0b" containerName="limitador" containerID="cri-o://b1f0e31876d6cd2342f62df9473db9b36ef4af18d560e22645dea6830dce8dc6" gracePeriod=30
Sep 15 11:44:45.471434 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.471406    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-6kzgb"
Sep 15 11:44:45.535218 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.535120    2571 generic.go:356] "Generic (PLEG): container finished" podID="02fdff22-073a-471c-bfde-29bda3940a0b" containerID="b1f0e31876d6cd2342f62df9473db9b36ef4af18d560e22645dea6830dce8dc6" exitCode=0
Sep 15 11:44:45.535218 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.535173    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-6kzgb"
Sep 15 11:44:45.535218 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.535183    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-6kzgb" event={"ID":"02fdff22-073a-471c-bfde-29bda3940a0b","Type":"ContainerDied","Data":"b1f0e31876d6cd2342f62df9473db9b36ef4af18d560e22645dea6830dce8dc6"}
Sep 15 11:44:45.535649 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.535239    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-6kzgb" event={"ID":"02fdff22-073a-471c-bfde-29bda3940a0b","Type":"ContainerDied","Data":"cb7f938fdfe4db4dc67d5e916e04e98014963cd863708398b243f12a65c79b3e"}
Sep 15 11:44:45.535649 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.535261    2571 scope.go:117] "RemoveContainer" containerID="b1f0e31876d6cd2342f62df9473db9b36ef4af18d560e22645dea6830dce8dc6"
Sep 15 11:44:45.544342 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.544321    2571 scope.go:117] "RemoveContainer" containerID="b1f0e31876d6cd2342f62df9473db9b36ef4af18d560e22645dea6830dce8dc6"
Sep 15 11:44:45.544677 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:44:45.544653    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1f0e31876d6cd2342f62df9473db9b36ef4af18d560e22645dea6830dce8dc6\": container with ID starting with b1f0e31876d6cd2342f62df9473db9b36ef4af18d560e22645dea6830dce8dc6 not found: ID does not exist" containerID="b1f0e31876d6cd2342f62df9473db9b36ef4af18d560e22645dea6830dce8dc6"
Sep 15 11:44:45.544772 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.544686    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1f0e31876d6cd2342f62df9473db9b36ef4af18d560e22645dea6830dce8dc6"} err="failed to get container status \"b1f0e31876d6cd2342f62df9473db9b36ef4af18d560e22645dea6830dce8dc6\": rpc error: code = NotFound desc = could not find container \"b1f0e31876d6cd2342f62df9473db9b36ef4af18d560e22645dea6830dce8dc6\": container with ID starting with b1f0e31876d6cd2342f62df9473db9b36ef4af18d560e22645dea6830dce8dc6 not found: ID does not exist"
Sep 15 11:44:45.562815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.562784    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d9bz\" (UniqueName: \"kubernetes.io/projected/02fdff22-073a-471c-bfde-29bda3940a0b-kube-api-access-7d9bz\") pod \"02fdff22-073a-471c-bfde-29bda3940a0b\" (UID: \"02fdff22-073a-471c-bfde-29bda3940a0b\") "
Sep 15 11:44:45.563019 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.562993    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/02fdff22-073a-471c-bfde-29bda3940a0b-config-file\") pod \"02fdff22-073a-471c-bfde-29bda3940a0b\" (UID: \"02fdff22-073a-471c-bfde-29bda3940a0b\") "
Sep 15 11:44:45.563320 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.563300    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02fdff22-073a-471c-bfde-29bda3940a0b-config-file" (OuterVolumeSpecName: "config-file") pod "02fdff22-073a-471c-bfde-29bda3940a0b" (UID: "02fdff22-073a-471c-bfde-29bda3940a0b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:44:45.564848 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.564829    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02fdff22-073a-471c-bfde-29bda3940a0b-kube-api-access-7d9bz" (OuterVolumeSpecName: "kube-api-access-7d9bz") pod "02fdff22-073a-471c-bfde-29bda3940a0b" (UID: "02fdff22-073a-471c-bfde-29bda3940a0b"). InnerVolumeSpecName "kube-api-access-7d9bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:44:45.664439 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.664386    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d9bz\" (UniqueName: \"kubernetes.io/projected/02fdff22-073a-471c-bfde-29bda3940a0b-kube-api-access-7d9bz\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:44:45.664439 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.664435    2571 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/02fdff22-073a-471c-bfde-29bda3940a0b-config-file\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:44:45.857556 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.857528    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6kzgb"]
Sep 15 11:44:45.861210 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:45.861185    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-6kzgb"]
Sep 15 11:44:46.213447 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:46.213413    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02fdff22-073a-471c-bfde-29bda3940a0b" path="/var/lib/kubelet/pods/02fdff22-073a-471c-bfde-29bda3940a0b/volumes"
Sep 15 11:44:47.682089 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:47.682056    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:47.849482 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:47.849453    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:48.090975 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.090944    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-62qcl"]
Sep 15 11:44:48.091375 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.091361    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02fdff22-073a-471c-bfde-29bda3940a0b" containerName="limitador"
Sep 15 11:44:48.091452 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.091377    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="02fdff22-073a-471c-bfde-29bda3940a0b" containerName="limitador"
Sep 15 11:44:48.091511 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.091458    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="02fdff22-073a-471c-bfde-29bda3940a0b" containerName="limitador"
Sep 15 11:44:48.095975 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.095956    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-62qcl"
Sep 15 11:44:48.098622 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.098598    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 11:44:48.099626 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.099547    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-48k4d\""
Sep 15 11:44:48.099626 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.099606    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 15 11:44:48.100545 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.100517    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 11:44:48.102413 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.102394    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-62qcl"]
Sep 15 11:44:48.119560 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.119538    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:44:48.285555 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.285523    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/280ce53e-9080-413c-9545-38e6d226ce76-data\") pod \"postgres-69fb4594cf-62qcl\" (UID: \"280ce53e-9080-413c-9545-38e6d226ce76\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-62qcl"
Sep 15 11:44:48.285722 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.285625    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc4cc\" (UniqueName: \"kubernetes.io/projected/280ce53e-9080-413c-9545-38e6d226ce76-kube-api-access-dc4cc\") pod \"postgres-69fb4594cf-62qcl\" (UID: \"280ce53e-9080-413c-9545-38e6d226ce76\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-62qcl"
Sep 15 11:44:48.386927 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.386839    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc4cc\" (UniqueName: \"kubernetes.io/projected/280ce53e-9080-413c-9545-38e6d226ce76-kube-api-access-dc4cc\") pod \"postgres-69fb4594cf-62qcl\" (UID: \"280ce53e-9080-413c-9545-38e6d226ce76\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-62qcl"
Sep 15 11:44:48.386927 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.386894    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/280ce53e-9080-413c-9545-38e6d226ce76-data\") pod \"postgres-69fb4594cf-62qcl\" (UID: \"280ce53e-9080-413c-9545-38e6d226ce76\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-62qcl"
Sep 15 11:44:48.387362 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.387341    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/280ce53e-9080-413c-9545-38e6d226ce76-data\") pod \"postgres-69fb4594cf-62qcl\" (UID: \"280ce53e-9080-413c-9545-38e6d226ce76\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-62qcl"
Sep 15 11:44:48.395305 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.395282    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc4cc\" (UniqueName: \"kubernetes.io/projected/280ce53e-9080-413c-9545-38e6d226ce76-kube-api-access-dc4cc\") pod \"postgres-69fb4594cf-62qcl\" (UID: \"280ce53e-9080-413c-9545-38e6d226ce76\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-62qcl"
Sep 15 11:44:48.407267 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.407245    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-62qcl"
Sep 15 11:44:48.676486 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:48.676464    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-62qcl"]
Sep 15 11:44:48.678497 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:44:48.678469    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280ce53e_9080_413c_9545_38e6d226ce76.slice/crio-2ef47057a64915352b4ad108c6d779220fe5fa1dcae1d6dddeeadc9457f175f8 WatchSource:0}: Error finding container 2ef47057a64915352b4ad108c6d779220fe5fa1dcae1d6dddeeadc9457f175f8: Status 404 returned error can't find the container with id 2ef47057a64915352b4ad108c6d779220fe5fa1dcae1d6dddeeadc9457f175f8
Sep 15 11:44:49.562426 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:49.562348    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-62qcl" event={"ID":"280ce53e-9080-413c-9545-38e6d226ce76","Type":"ContainerStarted","Data":"2ef47057a64915352b4ad108c6d779220fe5fa1dcae1d6dddeeadc9457f175f8"}
Sep 15 11:44:54.590679 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:54.590641    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-62qcl" event={"ID":"280ce53e-9080-413c-9545-38e6d226ce76","Type":"ContainerStarted","Data":"1a83478dd98d3916a60c3f216fabfe9060ba39c66675372c61159fdd7a76522f"}
Sep 15 11:44:54.591146 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:54.590711    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-62qcl"
Sep 15 11:44:54.608542 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:44:54.608491    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-62qcl" podStartSLOduration=1.707995097 podStartE2EDuration="6.608477472s" totalImagesPullingTime="4.900482375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:44:54.607053119 +0000 UTC m=+456.858610178" watchObservedRunningTime="2026-09-15 11:44:54.608477472 +0000 UTC m=+456.860034529"
Sep 15 11:45:00.627004 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:00.626970    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-62qcl"
Sep 15 11:45:00.929600 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:00.929517    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:01.152468 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:01.152433    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-rntf8"]
Sep 15 11:45:01.159523 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:01.159501    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rntf8"
Sep 15 11:45:01.162714 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:01.162689    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4289k\""
Sep 15 11:45:01.162714 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:01.162699    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-rntf8"]
Sep 15 11:45:01.203486 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:01.203456    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrp62\" (UniqueName: \"kubernetes.io/projected/d8314357-34ec-4689-8220-8266ced2b768-kube-api-access-zrp62\") pod \"authorino-557f876f69-rntf8\" (UID: \"d8314357-34ec-4689-8220-8266ced2b768\") " pod="kuadrant-system/authorino-557f876f69-rntf8"
Sep 15 11:45:01.305043 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:01.304997    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrp62\" (UniqueName: \"kubernetes.io/projected/d8314357-34ec-4689-8220-8266ced2b768-kube-api-access-zrp62\") pod \"authorino-557f876f69-rntf8\" (UID: \"d8314357-34ec-4689-8220-8266ced2b768\") " pod="kuadrant-system/authorino-557f876f69-rntf8"
Sep 15 11:45:01.316174 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:01.316121    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrp62\" (UniqueName: \"kubernetes.io/projected/d8314357-34ec-4689-8220-8266ced2b768-kube-api-access-zrp62\") pod \"authorino-557f876f69-rntf8\" (UID: \"d8314357-34ec-4689-8220-8266ced2b768\") " pod="kuadrant-system/authorino-557f876f69-rntf8"
Sep 15 11:45:01.419530 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:01.419492    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-rntf8"]
Sep 15 11:45:01.419778 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:01.419766    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rntf8"
Sep 15 11:45:01.714605 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:01.714582    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-rntf8"]
Sep 15 11:45:01.717488 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:45:01.717460    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8314357_34ec_4689_8220_8266ced2b768.slice/crio-8d23ab53b5055c8b5ef5d2af01d758daf13cbac6fd3d197aa3c55cd114e36cc0 WatchSource:0}: Error finding container 8d23ab53b5055c8b5ef5d2af01d758daf13cbac6fd3d197aa3c55cd114e36cc0: Status 404 returned error can't find the container with id 8d23ab53b5055c8b5ef5d2af01d758daf13cbac6fd3d197aa3c55cd114e36cc0
Sep 15 11:45:01.840481 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:01.840397    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:02.634954 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:02.634920    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-rntf8" event={"ID":"d8314357-34ec-4689-8220-8266ced2b768","Type":"ContainerStarted","Data":"8d23ab53b5055c8b5ef5d2af01d758daf13cbac6fd3d197aa3c55cd114e36cc0"}
Sep 15 11:45:05.651559 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:05.651526    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-rntf8" event={"ID":"d8314357-34ec-4689-8220-8266ced2b768","Type":"ContainerStarted","Data":"d2174e29042501d8860cdee72f6b52fbd9ed4ca2ebba1f223cbfef4038663c4c"}
Sep 15 11:45:05.652078 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:05.651595    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-rntf8" podUID="d8314357-34ec-4689-8220-8266ced2b768" containerName="authorino" containerID="cri-o://d2174e29042501d8860cdee72f6b52fbd9ed4ca2ebba1f223cbfef4038663c4c" gracePeriod=30
Sep 15 11:45:05.667567 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:05.667516    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-rntf8" podStartSLOduration=1.7535682129999999 podStartE2EDuration="4.667497276s" totalImagesPullingTime="2.913929063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:05.667342599 +0000 UTC m=+467.918899656" watchObservedRunningTime="2026-09-15 11:45:05.667497276 +0000 UTC m=+467.919054335"
Sep 15 11:45:05.902906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:05.902839    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rntf8"
Sep 15 11:45:05.950046 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:05.950007    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrp62\" (UniqueName: \"kubernetes.io/projected/d8314357-34ec-4689-8220-8266ced2b768-kube-api-access-zrp62\") pod \"d8314357-34ec-4689-8220-8266ced2b768\" (UID: \"d8314357-34ec-4689-8220-8266ced2b768\") "
Sep 15 11:45:05.952063 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:05.952040    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8314357-34ec-4689-8220-8266ced2b768-kube-api-access-zrp62" (OuterVolumeSpecName: "kube-api-access-zrp62") pod "d8314357-34ec-4689-8220-8266ced2b768" (UID: "d8314357-34ec-4689-8220-8266ced2b768"). InnerVolumeSpecName "kube-api-access-zrp62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:06.050935 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:06.050894    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrp62\" (UniqueName: \"kubernetes.io/projected/d8314357-34ec-4689-8220-8266ced2b768-kube-api-access-zrp62\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:45:06.658345 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:06.658253    2571 generic.go:356] "Generic (PLEG): container finished" podID="d8314357-34ec-4689-8220-8266ced2b768" containerID="d2174e29042501d8860cdee72f6b52fbd9ed4ca2ebba1f223cbfef4038663c4c" exitCode=0
Sep 15 11:45:06.658345 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:06.658295    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-rntf8"
Sep 15 11:45:06.658870 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:06.658345    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-rntf8" event={"ID":"d8314357-34ec-4689-8220-8266ced2b768","Type":"ContainerDied","Data":"d2174e29042501d8860cdee72f6b52fbd9ed4ca2ebba1f223cbfef4038663c4c"}
Sep 15 11:45:06.658870 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:06.658392    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-rntf8" event={"ID":"d8314357-34ec-4689-8220-8266ced2b768","Type":"ContainerDied","Data":"8d23ab53b5055c8b5ef5d2af01d758daf13cbac6fd3d197aa3c55cd114e36cc0"}
Sep 15 11:45:06.658870 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:06.658415    2571 scope.go:117] "RemoveContainer" containerID="d2174e29042501d8860cdee72f6b52fbd9ed4ca2ebba1f223cbfef4038663c4c"
Sep 15 11:45:06.672989 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:06.672969    2571 scope.go:117] "RemoveContainer" containerID="d2174e29042501d8860cdee72f6b52fbd9ed4ca2ebba1f223cbfef4038663c4c"
Sep 15 11:45:06.673334 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:45:06.673312    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2174e29042501d8860cdee72f6b52fbd9ed4ca2ebba1f223cbfef4038663c4c\": container with ID starting with d2174e29042501d8860cdee72f6b52fbd9ed4ca2ebba1f223cbfef4038663c4c not found: ID does not exist" containerID="d2174e29042501d8860cdee72f6b52fbd9ed4ca2ebba1f223cbfef4038663c4c"
Sep 15 11:45:06.673413 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:06.673341    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2174e29042501d8860cdee72f6b52fbd9ed4ca2ebba1f223cbfef4038663c4c"} err="failed to get container status \"d2174e29042501d8860cdee72f6b52fbd9ed4ca2ebba1f223cbfef4038663c4c\": rpc error: code = NotFound desc = could not find container \"d2174e29042501d8860cdee72f6b52fbd9ed4ca2ebba1f223cbfef4038663c4c\": container with ID starting with d2174e29042501d8860cdee72f6b52fbd9ed4ca2ebba1f223cbfef4038663c4c not found: ID does not exist"
Sep 15 11:45:06.683753 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:06.683716    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-rntf8"]
Sep 15 11:45:06.685348 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:06.685327    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-rntf8"]
Sep 15 11:45:08.213162 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:08.213112    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8314357-34ec-4689-8220-8266ced2b768" path="/var/lib/kubelet/pods/d8314357-34ec-4689-8220-8266ced2b768/volumes"
Sep 15 11:45:09.210732 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.210696    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:09.259171 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.259120    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-98f5d4d4f-gkzng"]
Sep 15 11:45:09.259569 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.259514    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8314357-34ec-4689-8220-8266ced2b768" containerName="authorino"
Sep 15 11:45:09.259569 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.259524    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8314357-34ec-4689-8220-8266ced2b768" containerName="authorino"
Sep 15 11:45:09.259655 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.259587    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8314357-34ec-4689-8220-8266ced2b768" containerName="authorino"
Sep 15 11:45:09.262212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.262195    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:09.266758 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.266736    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 11:45:09.266947 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.266933    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4gvps\""
Sep 15 11:45:09.267698 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.267682    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 11:45:09.267772 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.267686    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 11:45:09.288398 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.288366    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-98f5d4d4f-gkzng"]
Sep 15 11:45:09.361953 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.361918    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:09.377221 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.377194    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whr86\" (UniqueName: \"kubernetes.io/projected/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-kube-api-access-whr86\") pod \"maas-controller-98f5d4d4f-gkzng\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") " pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:09.377331 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.377235    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-metrics-certs\") pod \"maas-controller-98f5d4d4f-gkzng\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") " pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:09.377331 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.377280    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-webhook-cert\") pod \"maas-controller-98f5d4d4f-gkzng\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") " pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:09.478240 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.478133    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whr86\" (UniqueName: \"kubernetes.io/projected/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-kube-api-access-whr86\") pod \"maas-controller-98f5d4d4f-gkzng\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") " pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:09.478240 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.478208    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-metrics-certs\") pod \"maas-controller-98f5d4d4f-gkzng\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") " pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:09.478240 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.478240    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-webhook-cert\") pod \"maas-controller-98f5d4d4f-gkzng\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") " pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:09.478454 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:45:09.478348    2571 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 15 11:45:09.478454 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:45:09.478410    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-metrics-certs podName:fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0 nodeName:}" failed. No retries permitted until 2026-09-15 11:45:09.978391598 +0000 UTC m=+472.229948633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-metrics-certs") pod "maas-controller-98f5d4d4f-gkzng" (UID: "fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0") : secret "maas-controller-metrics-tls" not found
Sep 15 11:45:09.478454 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:45:09.478354    2571 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 15 11:45:09.478561 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:45:09.478497    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-webhook-cert podName:fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0 nodeName:}" failed. No retries permitted until 2026-09-15 11:45:09.9784795 +0000 UTC m=+472.230036549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-webhook-cert") pod "maas-controller-98f5d4d4f-gkzng" (UID: "fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0") : secret "maas-controller-webhook-cert" not found
Sep 15 11:45:09.489164 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.489130    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whr86\" (UniqueName: \"kubernetes.io/projected/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-kube-api-access-whr86\") pod \"maas-controller-98f5d4d4f-gkzng\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") " pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:09.508729 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.508702    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b6994fc67-nt5l5"]
Sep 15 11:45:09.511230 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.511213    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:09.521683 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.521659    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-nt5l5"]
Sep 15 11:45:09.578852 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.578821    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b76xg\" (UniqueName: \"kubernetes.io/projected/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-kube-api-access-b76xg\") pod \"maas-controller-6b6994fc67-nt5l5\" (UID: \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\") " pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:09.579027 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.578877    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-webhook-cert\") pod \"maas-controller-6b6994fc67-nt5l5\" (UID: \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\") " pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:09.579027 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.578901    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-metrics-certs\") pod \"maas-controller-6b6994fc67-nt5l5\" (UID: \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\") " pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:09.680089 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.680056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b76xg\" (UniqueName: \"kubernetes.io/projected/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-kube-api-access-b76xg\") pod \"maas-controller-6b6994fc67-nt5l5\" (UID: \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\") " pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:09.680272 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.680118    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-webhook-cert\") pod \"maas-controller-6b6994fc67-nt5l5\" (UID: \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\") " pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:09.680272 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.680188    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-metrics-certs\") pod \"maas-controller-6b6994fc67-nt5l5\" (UID: \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\") " pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:09.680348 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:45:09.680335    2571 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 15 11:45:09.680401 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:45:09.680391    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-metrics-certs podName:7e2ca0f3-ee57-46be-b2e5-2d83e73e9763 nodeName:}" failed. No retries permitted until 2026-09-15 11:45:10.18037787 +0000 UTC m=+472.431934905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-metrics-certs") pod "maas-controller-6b6994fc67-nt5l5" (UID: "7e2ca0f3-ee57-46be-b2e5-2d83e73e9763") : secret "maas-controller-metrics-tls" not found
Sep 15 11:45:09.682599 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.682582    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-webhook-cert\") pod \"maas-controller-6b6994fc67-nt5l5\" (UID: \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\") " pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:09.689449 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.689426    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b76xg\" (UniqueName: \"kubernetes.io/projected/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-kube-api-access-b76xg\") pod \"maas-controller-6b6994fc67-nt5l5\" (UID: \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\") " pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:09.719919 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.719892    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:09.828393 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.828304    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:09.983068 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.983023    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-metrics-certs\") pod \"maas-controller-98f5d4d4f-gkzng\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") " pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:09.983269 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.983137    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-webhook-cert\") pod \"maas-controller-98f5d4d4f-gkzng\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") " pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:09.983269 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:45:09.983199    2571 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 15 11:45:09.983269 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:45:09.983257    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-metrics-certs podName:fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0 nodeName:}" failed. No retries permitted until 2026-09-15 11:45:10.983241833 +0000 UTC m=+473.234798873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-metrics-certs") pod "maas-controller-98f5d4d4f-gkzng" (UID: "fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0") : secret "maas-controller-metrics-tls" not found
Sep 15 11:45:09.985567 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:09.985541    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-webhook-cert\") pod \"maas-controller-98f5d4d4f-gkzng\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") " pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:10.044072 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:10.044043    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:10.185171 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:10.185073    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-metrics-certs\") pod \"maas-controller-6b6994fc67-nt5l5\" (UID: \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\") " pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:10.187497 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:10.187470    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-metrics-certs\") pod \"maas-controller-6b6994fc67-nt5l5\" (UID: \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\") " pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:10.423006 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:10.422974    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:10.695387 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:10.695362    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-nt5l5"]
Sep 15 11:45:10.697286 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:45:10.697260    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e2ca0f3_ee57_46be_b2e5_2d83e73e9763.slice/crio-afc00a15bc77f83d197edf553b10c98a29760d84e691b0abb338deec1cc7c4cf WatchSource:0}: Error finding container afc00a15bc77f83d197edf553b10c98a29760d84e691b0abb338deec1cc7c4cf: Status 404 returned error can't find the container with id afc00a15bc77f83d197edf553b10c98a29760d84e691b0abb338deec1cc7c4cf
Sep 15 11:45:10.991530 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:10.991487    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-metrics-certs\") pod \"maas-controller-98f5d4d4f-gkzng\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") " pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:10.993941 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:10.993916    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-metrics-certs\") pod \"maas-controller-98f5d4d4f-gkzng\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") " pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:11.072058 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:11.072020    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:11.343010 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:11.342979    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-98f5d4d4f-gkzng"]
Sep 15 11:45:11.345488 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:45:11.345462    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5dd5e9_a5d2_49e9_82b0_a2d7a6e809e0.slice/crio-2c12f25d129287a604970dce8c17860a9f985fc2a47bab51b6f12266fab535f4 WatchSource:0}: Error finding container 2c12f25d129287a604970dce8c17860a9f985fc2a47bab51b6f12266fab535f4: Status 404 returned error can't find the container with id 2c12f25d129287a604970dce8c17860a9f985fc2a47bab51b6f12266fab535f4
Sep 15 11:45:11.692130 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:11.692030    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-nt5l5" event={"ID":"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763","Type":"ContainerStarted","Data":"afc00a15bc77f83d197edf553b10c98a29760d84e691b0abb338deec1cc7c4cf"}
Sep 15 11:45:11.693251 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:11.693227    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-98f5d4d4f-gkzng" event={"ID":"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0","Type":"ContainerStarted","Data":"2c12f25d129287a604970dce8c17860a9f985fc2a47bab51b6f12266fab535f4"}
Sep 15 11:45:14.345653 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:14.345620    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:14.446271 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:14.446234    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:14.711249 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:14.711215    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-nt5l5" event={"ID":"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763","Type":"ContainerStarted","Data":"9ddad4d8fcb5c7151d65bc928c8e372e3c94be3a5eace92679e60f4ed96cfae6"}
Sep 15 11:45:14.711461 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:14.711324    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:14.712837 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:14.712796    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-98f5d4d4f-gkzng" event={"ID":"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0","Type":"ContainerStarted","Data":"3b4637b896f2e11ca71c9bcab7853ca671bfe73b939ab96b943865aef07536bc"}
Sep 15 11:45:14.712962 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:14.712938    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:14.743757 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:14.743696    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b6994fc67-nt5l5" podStartSLOduration=2.581573429 podStartE2EDuration="5.743675458s" totalImagesPullingTime="3.162102029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:14.741546743 +0000 UTC m=+476.993103800" watchObservedRunningTime="2026-09-15 11:45:14.743675458 +0000 UTC m=+476.995232518"
Sep 15 11:45:14.771939 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:14.771886    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-98f5d4d4f-gkzng" podStartSLOduration=3.261370854 podStartE2EDuration="5.771868924s" totalImagesPullingTime="2.51049807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:14.770629774 +0000 UTC m=+477.022186831" watchObservedRunningTime="2026-09-15 11:45:14.771868924 +0000 UTC m=+477.023425980"
Sep 15 11:45:25.720598 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:25.720570    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:45:25.721065 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:25.720895    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:25.789260 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:25.789213    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-98f5d4d4f-gkzng"]
Sep 15 11:45:25.789495 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:25.789447    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-98f5d4d4f-gkzng" podUID="fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0" containerName="manager" containerID="cri-o://3b4637b896f2e11ca71c9bcab7853ca671bfe73b939ab96b943865aef07536bc" gracePeriod=30
Sep 15 11:45:26.034024 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.033998    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:26.140610 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.140579    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-webhook-cert\") pod \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") "
Sep 15 11:45:26.140776 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.140626    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-metrics-certs\") pod \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") "
Sep 15 11:45:26.140776 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.140720    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whr86\" (UniqueName: \"kubernetes.io/projected/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-kube-api-access-whr86\") pod \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\" (UID: \"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0\") "
Sep 15 11:45:26.142902 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.142872    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0" (UID: "fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:45:26.143008 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.142897    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0" (UID: "fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:45:26.143008 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.142923    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-kube-api-access-whr86" (OuterVolumeSpecName: "kube-api-access-whr86") pod "fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0" (UID: "fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0"). InnerVolumeSpecName "kube-api-access-whr86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:45:26.241663 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.241628    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whr86\" (UniqueName: \"kubernetes.io/projected/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-kube-api-access-whr86\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:45:26.241663 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.241653    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-webhook-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:45:26.241663 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.241663    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:45:26.778182 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.778137    2571 generic.go:356] "Generic (PLEG): container finished" podID="fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0" containerID="3b4637b896f2e11ca71c9bcab7853ca671bfe73b939ab96b943865aef07536bc" exitCode=0
Sep 15 11:45:26.778690 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.778203    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-98f5d4d4f-gkzng"
Sep 15 11:45:26.778690 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.778228    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-98f5d4d4f-gkzng" event={"ID":"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0","Type":"ContainerDied","Data":"3b4637b896f2e11ca71c9bcab7853ca671bfe73b939ab96b943865aef07536bc"}
Sep 15 11:45:26.778690 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.778278    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-98f5d4d4f-gkzng" event={"ID":"fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0","Type":"ContainerDied","Data":"2c12f25d129287a604970dce8c17860a9f985fc2a47bab51b6f12266fab535f4"}
Sep 15 11:45:26.778690 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.778300    2571 scope.go:117] "RemoveContainer" containerID="3b4637b896f2e11ca71c9bcab7853ca671bfe73b939ab96b943865aef07536bc"
Sep 15 11:45:26.786872 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.786858    2571 scope.go:117] "RemoveContainer" containerID="3b4637b896f2e11ca71c9bcab7853ca671bfe73b939ab96b943865aef07536bc"
Sep 15 11:45:26.787115 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:45:26.787097    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b4637b896f2e11ca71c9bcab7853ca671bfe73b939ab96b943865aef07536bc\": container with ID starting with 3b4637b896f2e11ca71c9bcab7853ca671bfe73b939ab96b943865aef07536bc not found: ID does not exist" containerID="3b4637b896f2e11ca71c9bcab7853ca671bfe73b939ab96b943865aef07536bc"
Sep 15 11:45:26.787175 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.787122    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b4637b896f2e11ca71c9bcab7853ca671bfe73b939ab96b943865aef07536bc"} err="failed to get container status \"3b4637b896f2e11ca71c9bcab7853ca671bfe73b939ab96b943865aef07536bc\": rpc error: code = NotFound desc = could not find container \"3b4637b896f2e11ca71c9bcab7853ca671bfe73b939ab96b943865aef07536bc\": container with ID starting with 3b4637b896f2e11ca71c9bcab7853ca671bfe73b939ab96b943865aef07536bc not found: ID does not exist"
Sep 15 11:45:26.796003 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.795983    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-98f5d4d4f-gkzng"]
Sep 15 11:45:26.799364 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:26.799339    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-98f5d4d4f-gkzng"]
Sep 15 11:45:28.214072 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:28.214032    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0" path="/var/lib/kubelet/pods/fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0/volumes"
Sep 15 11:45:39.914985 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:39.914947    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:40.017141 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:40.017082    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:45.530274 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:45.530233    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:45.628662 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:45.628623    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:47.089756 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.089719    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:47.197567 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.197530    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:47.230069 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.230033    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"]
Sep 15 11:45:47.230436 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.230424    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0" containerName="manager"
Sep 15 11:45:47.230486 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.230438    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0" containerName="manager"
Sep 15 11:45:47.230521 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.230514    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa5dd5e9-a5d2-49e9-82b0-a2d7a6e809e0" containerName="manager"
Sep 15 11:45:47.235939 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.235918    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.239989 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.239966    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 15 11:45:47.240290 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.240272    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9dhbv\""
Sep 15 11:45:47.240350 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.240303    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 11:45:47.254843 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.254817    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"]
Sep 15 11:45:47.339745 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.339715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4094408e-5d49-45eb-8ac2-3f6b48f352ba-openshift-service-ca\") pod \"maas-api-59f6566bbc-xv5pq\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.339745 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.339758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cp7z\" (UniqueName: \"kubernetes.io/projected/4094408e-5d49-45eb-8ac2-3f6b48f352ba-kube-api-access-7cp7z\") pod \"maas-api-59f6566bbc-xv5pq\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.340012 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.339780    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4094408e-5d49-45eb-8ac2-3f6b48f352ba-metrics-certs\") pod \"maas-api-59f6566bbc-xv5pq\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.340012 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.339891    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4094408e-5d49-45eb-8ac2-3f6b48f352ba-maas-api-tls\") pod \"maas-api-59f6566bbc-xv5pq\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.344501 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.344475    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:47.441047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.441016    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4094408e-5d49-45eb-8ac2-3f6b48f352ba-maas-api-tls\") pod \"maas-api-59f6566bbc-xv5pq\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.441282 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.441114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4094408e-5d49-45eb-8ac2-3f6b48f352ba-openshift-service-ca\") pod \"maas-api-59f6566bbc-xv5pq\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.441282 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.441174    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cp7z\" (UniqueName: \"kubernetes.io/projected/4094408e-5d49-45eb-8ac2-3f6b48f352ba-kube-api-access-7cp7z\") pod \"maas-api-59f6566bbc-xv5pq\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.441282 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.441202    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4094408e-5d49-45eb-8ac2-3f6b48f352ba-metrics-certs\") pod \"maas-api-59f6566bbc-xv5pq\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.441822 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.441795    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4094408e-5d49-45eb-8ac2-3f6b48f352ba-openshift-service-ca\") pod \"maas-api-59f6566bbc-xv5pq\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.443650 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.443589    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4094408e-5d49-45eb-8ac2-3f6b48f352ba-metrics-certs\") pod \"maas-api-59f6566bbc-xv5pq\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.443796 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.443776    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4094408e-5d49-45eb-8ac2-3f6b48f352ba-maas-api-tls\") pod \"maas-api-59f6566bbc-xv5pq\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.445000 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.444971    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:47.449221 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.449196    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cp7z\" (UniqueName: \"kubernetes.io/projected/4094408e-5d49-45eb-8ac2-3f6b48f352ba-kube-api-access-7cp7z\") pod \"maas-api-59f6566bbc-xv5pq\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.546756 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.546717    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:47.656149 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.656122    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:47.755713 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.755685    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:47.797302 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.797267    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"]
Sep 15 11:45:47.800548 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.800527    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"]
Sep 15 11:45:47.800675 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.800637    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"
Sep 15 11:45:47.804122 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.803685    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"
Sep 15 11:45:47.804122 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.803728    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-px597\""
Sep 15 11:45:47.804122 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.803919    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 15 11:45:47.815193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.815149    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"]
Sep 15 11:45:47.818438 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.818403    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"]
Sep 15 11:45:47.829815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.829789    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"]
Sep 15 11:45:47.833524 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:45:47.833494    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4094408e_5d49_45eb_8ac2_3f6b48f352ba.slice/crio-1895ff5f8f3440f6db9231b6b4c019161be46551c6e4385ccfef7de5d2c43ba6 WatchSource:0}: Error finding container 1895ff5f8f3440f6db9231b6b4c019161be46551c6e4385ccfef7de5d2c43ba6: Status 404 returned error can't find the container with id 1895ff5f8f3440f6db9231b6b4c019161be46551c6e4385ccfef7de5d2c43ba6
Sep 15 11:45:47.845611 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.845584    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17e54754-7c38-400e-a632-8f90c2854f84-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kbl4z\" (UID: \"17e54754-7c38-400e-a632-8f90c2854f84\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"
Sep 15 11:45:47.845721 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.845702    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2mhw\" (UniqueName: \"kubernetes.io/projected/0b788be6-bbb0-44fc-8893-4902e07d4bf2-kube-api-access-g2mhw\") pod \"payload-processing-5b54b7fbb7-2jrlc\" (UID: \"0b788be6-bbb0-44fc-8893-4902e07d4bf2\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"
Sep 15 11:45:47.845775 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.845750    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b788be6-bbb0-44fc-8893-4902e07d4bf2-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2jrlc\" (UID: \"0b788be6-bbb0-44fc-8893-4902e07d4bf2\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"
Sep 15 11:45:47.845825 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.845814    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxzr7\" (UniqueName: \"kubernetes.io/projected/17e54754-7c38-400e-a632-8f90c2854f84-kube-api-access-cxzr7\") pod \"payload-pre-processing-59fbc47bf8-kbl4z\" (UID: \"17e54754-7c38-400e-a632-8f90c2854f84\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"
Sep 15 11:45:47.884546 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.884476    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq" event={"ID":"4094408e-5d49-45eb-8ac2-3f6b48f352ba","Type":"ContainerStarted","Data":"1895ff5f8f3440f6db9231b6b4c019161be46551c6e4385ccfef7de5d2c43ba6"}
Sep 15 11:45:47.947193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.947142    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17e54754-7c38-400e-a632-8f90c2854f84-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kbl4z\" (UID: \"17e54754-7c38-400e-a632-8f90c2854f84\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"
Sep 15 11:45:47.947369 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.947231    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2mhw\" (UniqueName: \"kubernetes.io/projected/0b788be6-bbb0-44fc-8893-4902e07d4bf2-kube-api-access-g2mhw\") pod \"payload-processing-5b54b7fbb7-2jrlc\" (UID: \"0b788be6-bbb0-44fc-8893-4902e07d4bf2\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"
Sep 15 11:45:47.947369 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.947267    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b788be6-bbb0-44fc-8893-4902e07d4bf2-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2jrlc\" (UID: \"0b788be6-bbb0-44fc-8893-4902e07d4bf2\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"
Sep 15 11:45:47.947369 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.947309    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxzr7\" (UniqueName: \"kubernetes.io/projected/17e54754-7c38-400e-a632-8f90c2854f84-kube-api-access-cxzr7\") pod \"payload-pre-processing-59fbc47bf8-kbl4z\" (UID: \"17e54754-7c38-400e-a632-8f90c2854f84\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"
Sep 15 11:45:47.947850 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.947822    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17e54754-7c38-400e-a632-8f90c2854f84-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kbl4z\" (UID: \"17e54754-7c38-400e-a632-8f90c2854f84\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"
Sep 15 11:45:47.947986 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.947965    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b788be6-bbb0-44fc-8893-4902e07d4bf2-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2jrlc\" (UID: \"0b788be6-bbb0-44fc-8893-4902e07d4bf2\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"
Sep 15 11:45:47.960235 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.960211    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxzr7\" (UniqueName: \"kubernetes.io/projected/17e54754-7c38-400e-a632-8f90c2854f84-kube-api-access-cxzr7\") pod \"payload-pre-processing-59fbc47bf8-kbl4z\" (UID: \"17e54754-7c38-400e-a632-8f90c2854f84\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"
Sep 15 11:45:47.960333 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:47.960240    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2mhw\" (UniqueName: \"kubernetes.io/projected/0b788be6-bbb0-44fc-8893-4902e07d4bf2-kube-api-access-g2mhw\") pod \"payload-processing-5b54b7fbb7-2jrlc\" (UID: \"0b788be6-bbb0-44fc-8893-4902e07d4bf2\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"
Sep 15 11:45:48.119306 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:48.119276    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"
Sep 15 11:45:48.127192 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:48.127168    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"
Sep 15 11:45:48.403757 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:48.403715    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"]
Sep 15 11:45:48.405129 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:45:48.405103    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b788be6_bbb0_44fc_8893_4902e07d4bf2.slice/crio-515e09d3e1924453d829fec725977ac97ef623bd7cfc636fe440d01b0a9a3125 WatchSource:0}: Error finding container 515e09d3e1924453d829fec725977ac97ef623bd7cfc636fe440d01b0a9a3125: Status 404 returned error can't find the container with id 515e09d3e1924453d829fec725977ac97ef623bd7cfc636fe440d01b0a9a3125
Sep 15 11:45:48.406004 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:48.405985    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"]
Sep 15 11:45:48.407579 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:45:48.407560    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e54754_7c38_400e_a632_8f90c2854f84.slice/crio-dadfd9c397167ba853f51399c434b129a08df5cff399518c9fa3dcfa9e97d51f WatchSource:0}: Error finding container dadfd9c397167ba853f51399c434b129a08df5cff399518c9fa3dcfa9e97d51f: Status 404 returned error can't find the container with id dadfd9c397167ba853f51399c434b129a08df5cff399518c9fa3dcfa9e97d51f
Sep 15 11:45:48.891290 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:48.891252    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z" event={"ID":"17e54754-7c38-400e-a632-8f90c2854f84","Type":"ContainerStarted","Data":"dadfd9c397167ba853f51399c434b129a08df5cff399518c9fa3dcfa9e97d51f"}
Sep 15 11:45:48.892809 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:48.892774    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc" event={"ID":"0b788be6-bbb0-44fc-8893-4902e07d4bf2","Type":"ContainerStarted","Data":"515e09d3e1924453d829fec725977ac97ef623bd7cfc636fe440d01b0a9a3125"}
Sep 15 11:45:50.908028 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:50.907992    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc" event={"ID":"0b788be6-bbb0-44fc-8893-4902e07d4bf2","Type":"ContainerStarted","Data":"f97e15db24cd4f5fca731b7d82f799bb194a3138f0e0d8bddc6a2b77c0cfd69e"}
Sep 15 11:45:50.908507 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:50.908214    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"
Sep 15 11:45:50.910190 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:50.910144    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq" event={"ID":"4094408e-5d49-45eb-8ac2-3f6b48f352ba","Type":"ContainerStarted","Data":"c7f56edefeff8fe65448d41dc4efb5f0377c272f696a0e47530fcebfe9cc2f26"}
Sep 15 11:45:50.910348 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:50.910329    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:50.911760 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:50.911736    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z" event={"ID":"17e54754-7c38-400e-a632-8f90c2854f84","Type":"ContainerStarted","Data":"fcfb5262c029322667a177319b0d7d8da46a9045b567cea9a8cd35111d0479c3"}
Sep 15 11:45:50.911872 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:50.911858    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"
Sep 15 11:45:50.927515 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:50.927451    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc" podStartSLOduration=1.9347229609999999 podStartE2EDuration="3.927432689s" totalImagesPullingTime="1.992709728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:50.925023672 +0000 UTC m=+513.176580729" watchObservedRunningTime="2026-09-15 11:45:50.927432689 +0000 UTC m=+513.178989747"
Sep 15 11:45:50.946183 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:50.944272    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z" podStartSLOduration=1.950679734 podStartE2EDuration="3.944252903s" totalImagesPullingTime="1.993573169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:50.942603965 +0000 UTC m=+513.194161023" watchObservedRunningTime="2026-09-15 11:45:50.944252903 +0000 UTC m=+513.195809964"
Sep 15 11:45:50.963218 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:50.963164    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq" podStartSLOduration=1.397762267 podStartE2EDuration="3.96313154s" totalImagesPullingTime="2.565369273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:45:50.960681984 +0000 UTC m=+513.212239040" watchObservedRunningTime="2026-09-15 11:45:50.96313154 +0000 UTC m=+513.214688601"
Sep 15 11:45:56.925509 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:56.925431    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 11:45:56.948942 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:56.948905    2571 generic.go:356] "Generic (PLEG): container finished" podID="5d238557-cfcf-4620-9aed-9b5f1a59268e" containerID="9e6d4ecfe54b95c413e2dc08fdfff4d9ccf2e8eaf09304c942dcedd37c9d3d1c" exitCode=0
Sep 15 11:45:56.949116 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:56.948976    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h" event={"ID":"5d238557-cfcf-4620-9aed-9b5f1a59268e","Type":"ContainerDied","Data":"9e6d4ecfe54b95c413e2dc08fdfff4d9ccf2e8eaf09304c942dcedd37c9d3d1c"}
Sep 15 11:45:56.949579 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:56.949550    2571 scope.go:117] "RemoveContainer" containerID="9e6d4ecfe54b95c413e2dc08fdfff4d9ccf2e8eaf09304c942dcedd37c9d3d1c"
Sep 15 11:45:56.950831 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:56.950800    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:45:56.950919 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:56.950878    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:45:56.950958 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:56.950918    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:45:57.956954 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:57.956918    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h" event={"ID":"5d238557-cfcf-4620-9aed-9b5f1a59268e","Type":"ContainerStarted","Data":"3a922eb2b5440647389952b8d21557bc0b7fd4b3c9500394d90b5926ed8ccfe6"}
Sep 15 11:45:57.992019 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:57.991993    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:58.066360 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:58.066308    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:45:58.389204 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:58.389087    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:45:58.390208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:58.390175    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cg52h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 15 11:45:58.390362 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:58.390239    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h" podUID="5d238557-cfcf-4620-9aed-9b5f1a59268e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 15 11:45:59.389558 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:59.389521    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cg52h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 15 11:45:59.389957 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:45:59.389574    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h" podUID="5d238557-cfcf-4620-9aed-9b5f1a59268e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 15 11:46:00.389734 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:00.389695    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cg52h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 15 11:46:00.390238 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:00.389761    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h" podUID="5d238557-cfcf-4620-9aed-9b5f1a59268e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 15 11:46:01.389764 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:01.389725    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cg52h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 15 11:46:01.390114 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:01.389777    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h" podUID="5d238557-cfcf-4620-9aed-9b5f1a59268e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 15 11:46:01.466279 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:01.466240    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:46:01.740962 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:01.740731    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:01.924933 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:01.924890    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"
Sep 15 11:46:01.925320 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:01.925297    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"
Sep 15 11:46:02.389713 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:02.389672    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-cg52h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 15 11:46:02.389908 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:02.389728    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h" podUID="5d238557-cfcf-4620-9aed-9b5f1a59268e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 15 11:46:03.393061 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:03.393033    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:46:03.394236 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:03.394210    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cg52h"
Sep 15 11:46:06.965500 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:06.965464    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"]
Sep 15 11:46:06.968213 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:06.968191    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:06.971765 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:06.971737    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 15 11:46:06.971765 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:06.971753    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 11:46:06.971765 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:06.971745    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sl78g\""
Sep 15 11:46:06.972010 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:06.971805    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 11:46:06.980318 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:06.980293    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"]
Sep 15 11:46:06.995357 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:06.995321    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:07.032335 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.032298    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wcgc\" (UniqueName: \"kubernetes.io/projected/0e382c61-b524-448a-a814-2e9632fd6690-kube-api-access-7wcgc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.032500 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.032343    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e382c61-b524-448a-a814-2e9632fd6690-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.032500 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.032422    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e382c61-b524-448a-a814-2e9632fd6690-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.032500 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.032441    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e382c61-b524-448a-a814-2e9632fd6690-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.032500 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.032484    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e382c61-b524-448a-a814-2e9632fd6690-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.032639 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.032514    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e382c61-b524-448a-a814-2e9632fd6690-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.133348 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.133314    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e382c61-b524-448a-a814-2e9632fd6690-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.133348 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.133355    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e382c61-b524-448a-a814-2e9632fd6690-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.133597 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.133400    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e382c61-b524-448a-a814-2e9632fd6690-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.133597 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.133431    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e382c61-b524-448a-a814-2e9632fd6690-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.133707 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.133647    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wcgc\" (UniqueName: \"kubernetes.io/projected/0e382c61-b524-448a-a814-2e9632fd6690-kube-api-access-7wcgc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.133707 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.133692    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e382c61-b524-448a-a814-2e9632fd6690-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.133840 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.133814    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e382c61-b524-448a-a814-2e9632fd6690-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.134193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.134129    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e382c61-b524-448a-a814-2e9632fd6690-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.134408 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.134213    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e382c61-b524-448a-a814-2e9632fd6690-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.135858 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.135838    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e382c61-b524-448a-a814-2e9632fd6690-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.136025 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.136007    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e382c61-b524-448a-a814-2e9632fd6690-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.142343 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.142323    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wcgc\" (UniqueName: \"kubernetes.io/projected/0e382c61-b524-448a-a814-2e9632fd6690-kube-api-access-7wcgc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vms9p\" (UID: \"0e382c61-b524-448a-a814-2e9632fd6690\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.282791 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.282681    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:07.554742 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:07.554716    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"]
Sep 15 11:46:07.557044 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:46:07.557016    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e382c61_b524_448a_a814_2e9632fd6690.slice/crio-d531adbd7e1cea1abfde4bfdf9195e2d1aef8e1667d44ec3b823cf1b0807146f WatchSource:0}: Error finding container d531adbd7e1cea1abfde4bfdf9195e2d1aef8e1667d44ec3b823cf1b0807146f: Status 404 returned error can't find the container with id d531adbd7e1cea1abfde4bfdf9195e2d1aef8e1667d44ec3b823cf1b0807146f
Sep 15 11:46:08.010926 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:08.010884    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p" event={"ID":"0e382c61-b524-448a-a814-2e9632fd6690","Type":"ContainerStarted","Data":"d531adbd7e1cea1abfde4bfdf9195e2d1aef8e1667d44ec3b823cf1b0807146f"}
Sep 15 11:46:09.017847 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:09.017806    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p" event={"ID":"0e382c61-b524-448a-a814-2e9632fd6690","Type":"ContainerStarted","Data":"08b4d95a1d93d5b99c2f7a8e3d58b28188d60feb1ec99ccddf7e87b64a6bc1e7"}
Sep 15 11:46:09.040575 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:09.040523    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p" podStartSLOduration=2.025256775 podStartE2EDuration="3.040509107s" totalImagesPullingTime="1.015252332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:46:09.039203349 +0000 UTC m=+531.290760408" watchObservedRunningTime="2026-09-15 11:46:09.040509107 +0000 UTC m=+531.292066164"
Sep 15 11:46:11.962218 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:11.962101    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:13.169573 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:13.169525    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:17.283547 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:17.283497    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:17.284002 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:17.283568    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:17.296924 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:17.296901    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:18.074898 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:18.074869    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vms9p"
Sep 15 11:46:21.570108 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:21.570064    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:33.854642 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:33.854605    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:35.598721 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:35.598687    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:43.501663 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:43.501633    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:46:52.389881 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:46:52.389843    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:09.705486 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:47:09.705454    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:47:18.159606 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:47:18.159574    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 11:47:18.159606 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:47:18.159606    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 11:48:12.353795 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:12.353745    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:12.407846 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:12.407811    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:28.548765 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:28.548715    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d84ccdd4d-dl2dt"]
Sep 15 11:48:28.552668 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:28.552639    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d84ccdd4d-dl2dt"
Sep 15 11:48:28.556364 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:28.556339    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 15 11:48:28.556519 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:28.556339    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4289k\""
Sep 15 11:48:28.561357 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:28.561327    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d84ccdd4d-dl2dt"]
Sep 15 11:48:28.626812 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:28.626768    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77b5f4a4-432c-4f95-93e6-bc94948f0cea-tls-cert\") pod \"authorino-5d84ccdd4d-dl2dt\" (UID: \"77b5f4a4-432c-4f95-93e6-bc94948f0cea\") " pod="kuadrant-system/authorino-5d84ccdd4d-dl2dt"
Sep 15 11:48:28.626986 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:28.626848    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc5t4\" (UniqueName: \"kubernetes.io/projected/77b5f4a4-432c-4f95-93e6-bc94948f0cea-kube-api-access-dc5t4\") pod \"authorino-5d84ccdd4d-dl2dt\" (UID: \"77b5f4a4-432c-4f95-93e6-bc94948f0cea\") " pod="kuadrant-system/authorino-5d84ccdd4d-dl2dt"
Sep 15 11:48:28.727369 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:28.727323    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc5t4\" (UniqueName: \"kubernetes.io/projected/77b5f4a4-432c-4f95-93e6-bc94948f0cea-kube-api-access-dc5t4\") pod \"authorino-5d84ccdd4d-dl2dt\" (UID: \"77b5f4a4-432c-4f95-93e6-bc94948f0cea\") " pod="kuadrant-system/authorino-5d84ccdd4d-dl2dt"
Sep 15 11:48:28.727544 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:28.727444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77b5f4a4-432c-4f95-93e6-bc94948f0cea-tls-cert\") pod \"authorino-5d84ccdd4d-dl2dt\" (UID: \"77b5f4a4-432c-4f95-93e6-bc94948f0cea\") " pod="kuadrant-system/authorino-5d84ccdd4d-dl2dt"
Sep 15 11:48:28.729961 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:28.729936    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77b5f4a4-432c-4f95-93e6-bc94948f0cea-tls-cert\") pod \"authorino-5d84ccdd4d-dl2dt\" (UID: \"77b5f4a4-432c-4f95-93e6-bc94948f0cea\") " pod="kuadrant-system/authorino-5d84ccdd4d-dl2dt"
Sep 15 11:48:28.736301 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:28.736277    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc5t4\" (UniqueName: \"kubernetes.io/projected/77b5f4a4-432c-4f95-93e6-bc94948f0cea-kube-api-access-dc5t4\") pod \"authorino-5d84ccdd4d-dl2dt\" (UID: \"77b5f4a4-432c-4f95-93e6-bc94948f0cea\") " pod="kuadrant-system/authorino-5d84ccdd4d-dl2dt"
Sep 15 11:48:28.863632 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:28.863540    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d84ccdd4d-dl2dt"
Sep 15 11:48:29.135149 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:29.135117    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d84ccdd4d-dl2dt"]
Sep 15 11:48:29.137629 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:48:29.137585    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77b5f4a4_432c_4f95_93e6_bc94948f0cea.slice/crio-70046b58b4fc588136c465ae9c54109c28fc9291e69122b70df031d691ae43a3 WatchSource:0}: Error finding container 70046b58b4fc588136c465ae9c54109c28fc9291e69122b70df031d691ae43a3: Status 404 returned error can't find the container with id 70046b58b4fc588136c465ae9c54109c28fc9291e69122b70df031d691ae43a3
Sep 15 11:48:29.139388 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:29.139370    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:48:29.743841 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:29.743805    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d84ccdd4d-dl2dt" event={"ID":"77b5f4a4-432c-4f95-93e6-bc94948f0cea","Type":"ContainerStarted","Data":"64ded764b0970e0f24a7210847e8719370845220a7773cfa790bce1b41c3ddbe"}
Sep 15 11:48:29.744304 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:29.743851    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d84ccdd4d-dl2dt" event={"ID":"77b5f4a4-432c-4f95-93e6-bc94948f0cea","Type":"ContainerStarted","Data":"70046b58b4fc588136c465ae9c54109c28fc9291e69122b70df031d691ae43a3"}
Sep 15 11:48:29.761994 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:29.761943    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d84ccdd4d-dl2dt" podStartSLOduration=1.306061096 podStartE2EDuration="1.761928509s" totalImagesPullingTime="455.867413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:48:29.758968335 +0000 UTC m=+672.010525392" watchObservedRunningTime="2026-09-15 11:48:29.761928509 +0000 UTC m=+672.013485565"
Sep 15 11:48:30.606483 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:30.606451    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:30.670597 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:30.670553    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"]
Sep 15 11:48:30.670798 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:30.670755    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc" podUID="0b788be6-bbb0-44fc-8893-4902e07d4bf2" containerName="payload-processing" containerID="cri-o://f97e15db24cd4f5fca731b7d82f799bb194a3138f0e0d8bddc6a2b77c0cfd69e" gracePeriod=30
Sep 15 11:48:30.676921 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:30.676886    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"]
Sep 15 11:48:30.677398 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:30.677096    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z" podUID="17e54754-7c38-400e-a632-8f90c2854f84" containerName="payload-pre-processing" containerID="cri-o://fcfb5262c029322667a177319b0d7d8da46a9045b567cea9a8cd35111d0479c3" gracePeriod=30
Sep 15 11:48:30.761907 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:30.761873    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:30.863647 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:30.863614    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:30.954162 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:30.954133    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"
Sep 15 11:48:30.986047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:30.986001    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"
Sep 15 11:48:31.050193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.050131    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b788be6-bbb0-44fc-8893-4902e07d4bf2-plugins-config-volume\") pod \"0b788be6-bbb0-44fc-8893-4902e07d4bf2\" (UID: \"0b788be6-bbb0-44fc-8893-4902e07d4bf2\") "
Sep 15 11:48:31.050393 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.050240    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2mhw\" (UniqueName: \"kubernetes.io/projected/0b788be6-bbb0-44fc-8893-4902e07d4bf2-kube-api-access-g2mhw\") pod \"0b788be6-bbb0-44fc-8893-4902e07d4bf2\" (UID: \"0b788be6-bbb0-44fc-8893-4902e07d4bf2\") "
Sep 15 11:48:31.050393 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.050283    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17e54754-7c38-400e-a632-8f90c2854f84-plugins-config-volume\") pod \"17e54754-7c38-400e-a632-8f90c2854f84\" (UID: \"17e54754-7c38-400e-a632-8f90c2854f84\") "
Sep 15 11:48:31.050393 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.050300    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxzr7\" (UniqueName: \"kubernetes.io/projected/17e54754-7c38-400e-a632-8f90c2854f84-kube-api-access-cxzr7\") pod \"17e54754-7c38-400e-a632-8f90c2854f84\" (UID: \"17e54754-7c38-400e-a632-8f90c2854f84\") "
Sep 15 11:48:31.050951 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.050922    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b788be6-bbb0-44fc-8893-4902e07d4bf2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0b788be6-bbb0-44fc-8893-4902e07d4bf2" (UID: "0b788be6-bbb0-44fc-8893-4902e07d4bf2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:48:31.051092 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.050921    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17e54754-7c38-400e-a632-8f90c2854f84-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "17e54754-7c38-400e-a632-8f90c2854f84" (UID: "17e54754-7c38-400e-a632-8f90c2854f84"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:48:31.052756 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.052730    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17e54754-7c38-400e-a632-8f90c2854f84-kube-api-access-cxzr7" (OuterVolumeSpecName: "kube-api-access-cxzr7") pod "17e54754-7c38-400e-a632-8f90c2854f84" (UID: "17e54754-7c38-400e-a632-8f90c2854f84"). InnerVolumeSpecName "kube-api-access-cxzr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:48:31.052756 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.052743    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b788be6-bbb0-44fc-8893-4902e07d4bf2-kube-api-access-g2mhw" (OuterVolumeSpecName: "kube-api-access-g2mhw") pod "0b788be6-bbb0-44fc-8893-4902e07d4bf2" (UID: "0b788be6-bbb0-44fc-8893-4902e07d4bf2"). InnerVolumeSpecName "kube-api-access-g2mhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:48:31.151611 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.151532    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b788be6-bbb0-44fc-8893-4902e07d4bf2-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:48:31.151611 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.151559    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2mhw\" (UniqueName: \"kubernetes.io/projected/0b788be6-bbb0-44fc-8893-4902e07d4bf2-kube-api-access-g2mhw\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:48:31.151611 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.151571    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17e54754-7c38-400e-a632-8f90c2854f84-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:48:31.151611 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.151580    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxzr7\" (UniqueName: \"kubernetes.io/projected/17e54754-7c38-400e-a632-8f90c2854f84-kube-api-access-cxzr7\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:48:31.297677 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.297640    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-nt5l5"]
Sep 15 11:48:31.297885 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.297859    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b6994fc67-nt5l5" podUID="7e2ca0f3-ee57-46be-b2e5-2d83e73e9763" containerName="manager" containerID="cri-o://9ddad4d8fcb5c7151d65bc928c8e372e3c94be3a5eace92679e60f4ed96cfae6" gracePeriod=30
Sep 15 11:48:31.566356 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.566331    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:48:31.656822 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.656787    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-metrics-certs\") pod \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\" (UID: \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\") "
Sep 15 11:48:31.657013 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.656922    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-webhook-cert\") pod \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\" (UID: \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\") "
Sep 15 11:48:31.657013 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.656990    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b76xg\" (UniqueName: \"kubernetes.io/projected/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-kube-api-access-b76xg\") pod \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\" (UID: \"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763\") "
Sep 15 11:48:31.659279 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.659231    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-kube-api-access-b76xg" (OuterVolumeSpecName: "kube-api-access-b76xg") pod "7e2ca0f3-ee57-46be-b2e5-2d83e73e9763" (UID: "7e2ca0f3-ee57-46be-b2e5-2d83e73e9763"). InnerVolumeSpecName "kube-api-access-b76xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:48:31.659536 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.659512    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7e2ca0f3-ee57-46be-b2e5-2d83e73e9763" (UID: "7e2ca0f3-ee57-46be-b2e5-2d83e73e9763"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:48:31.659605 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.659532    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7e2ca0f3-ee57-46be-b2e5-2d83e73e9763" (UID: "7e2ca0f3-ee57-46be-b2e5-2d83e73e9763"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:48:31.758332 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.758300    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b76xg\" (UniqueName: \"kubernetes.io/projected/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-kube-api-access-b76xg\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:48:31.758332 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.758327    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:48:31.758332 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.758336    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763-webhook-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:48:31.760268 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.760245    2571 generic.go:356] "Generic (PLEG): container finished" podID="0b788be6-bbb0-44fc-8893-4902e07d4bf2" containerID="f97e15db24cd4f5fca731b7d82f799bb194a3138f0e0d8bddc6a2b77c0cfd69e" exitCode=0
Sep 15 11:48:31.760394 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.760288    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"
Sep 15 11:48:31.760394 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.760332    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc" event={"ID":"0b788be6-bbb0-44fc-8893-4902e07d4bf2","Type":"ContainerDied","Data":"f97e15db24cd4f5fca731b7d82f799bb194a3138f0e0d8bddc6a2b77c0cfd69e"}
Sep 15 11:48:31.760394 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.760386    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2jrlc" event={"ID":"0b788be6-bbb0-44fc-8893-4902e07d4bf2","Type":"ContainerDied","Data":"515e09d3e1924453d829fec725977ac97ef623bd7cfc636fe440d01b0a9a3125"}
Sep 15 11:48:31.760547 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.760414    2571 scope.go:117] "RemoveContainer" containerID="f97e15db24cd4f5fca731b7d82f799bb194a3138f0e0d8bddc6a2b77c0cfd69e"
Sep 15 11:48:31.764211 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.761913    2571 generic.go:356] "Generic (PLEG): container finished" podID="17e54754-7c38-400e-a632-8f90c2854f84" containerID="fcfb5262c029322667a177319b0d7d8da46a9045b567cea9a8cd35111d0479c3" exitCode=0
Sep 15 11:48:31.764211 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.761983    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"
Sep 15 11:48:31.764211 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.762014    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z" event={"ID":"17e54754-7c38-400e-a632-8f90c2854f84","Type":"ContainerDied","Data":"fcfb5262c029322667a177319b0d7d8da46a9045b567cea9a8cd35111d0479c3"}
Sep 15 11:48:31.764211 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.762088    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z" event={"ID":"17e54754-7c38-400e-a632-8f90c2854f84","Type":"ContainerDied","Data":"dadfd9c397167ba853f51399c434b129a08df5cff399518c9fa3dcfa9e97d51f"}
Sep 15 11:48:31.764785 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.764261    2571 generic.go:356] "Generic (PLEG): container finished" podID="7e2ca0f3-ee57-46be-b2e5-2d83e73e9763" containerID="9ddad4d8fcb5c7151d65bc928c8e372e3c94be3a5eace92679e60f4ed96cfae6" exitCode=0
Sep 15 11:48:31.764785 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.764298    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-nt5l5" event={"ID":"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763","Type":"ContainerDied","Data":"9ddad4d8fcb5c7151d65bc928c8e372e3c94be3a5eace92679e60f4ed96cfae6"}
Sep 15 11:48:31.764785 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.764336    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-nt5l5" event={"ID":"7e2ca0f3-ee57-46be-b2e5-2d83e73e9763","Type":"ContainerDied","Data":"afc00a15bc77f83d197edf553b10c98a29760d84e691b0abb338deec1cc7c4cf"}
Sep 15 11:48:31.764785 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.764384    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-nt5l5"
Sep 15 11:48:31.776281 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.776261    2571 scope.go:117] "RemoveContainer" containerID="f97e15db24cd4f5fca731b7d82f799bb194a3138f0e0d8bddc6a2b77c0cfd69e"
Sep 15 11:48:31.776648 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:48:31.776626    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f97e15db24cd4f5fca731b7d82f799bb194a3138f0e0d8bddc6a2b77c0cfd69e\": container with ID starting with f97e15db24cd4f5fca731b7d82f799bb194a3138f0e0d8bddc6a2b77c0cfd69e not found: ID does not exist" containerID="f97e15db24cd4f5fca731b7d82f799bb194a3138f0e0d8bddc6a2b77c0cfd69e"
Sep 15 11:48:31.776732 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.776657    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f97e15db24cd4f5fca731b7d82f799bb194a3138f0e0d8bddc6a2b77c0cfd69e"} err="failed to get container status \"f97e15db24cd4f5fca731b7d82f799bb194a3138f0e0d8bddc6a2b77c0cfd69e\": rpc error: code = NotFound desc = could not find container \"f97e15db24cd4f5fca731b7d82f799bb194a3138f0e0d8bddc6a2b77c0cfd69e\": container with ID starting with f97e15db24cd4f5fca731b7d82f799bb194a3138f0e0d8bddc6a2b77c0cfd69e not found: ID does not exist"
Sep 15 11:48:31.776732 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.776673    2571 scope.go:117] "RemoveContainer" containerID="fcfb5262c029322667a177319b0d7d8da46a9045b567cea9a8cd35111d0479c3"
Sep 15 11:48:31.785679 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.785655    2571 scope.go:117] "RemoveContainer" containerID="fcfb5262c029322667a177319b0d7d8da46a9045b567cea9a8cd35111d0479c3"
Sep 15 11:48:31.786018 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:48:31.785995    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcfb5262c029322667a177319b0d7d8da46a9045b567cea9a8cd35111d0479c3\": container with ID starting with fcfb5262c029322667a177319b0d7d8da46a9045b567cea9a8cd35111d0479c3 not found: ID does not exist" containerID="fcfb5262c029322667a177319b0d7d8da46a9045b567cea9a8cd35111d0479c3"
Sep 15 11:48:31.786096 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.786032    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcfb5262c029322667a177319b0d7d8da46a9045b567cea9a8cd35111d0479c3"} err="failed to get container status \"fcfb5262c029322667a177319b0d7d8da46a9045b567cea9a8cd35111d0479c3\": rpc error: code = NotFound desc = could not find container \"fcfb5262c029322667a177319b0d7d8da46a9045b567cea9a8cd35111d0479c3\": container with ID starting with fcfb5262c029322667a177319b0d7d8da46a9045b567cea9a8cd35111d0479c3 not found: ID does not exist"
Sep 15 11:48:31.786096 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.786061    2571 scope.go:117] "RemoveContainer" containerID="9ddad4d8fcb5c7151d65bc928c8e372e3c94be3a5eace92679e60f4ed96cfae6"
Sep 15 11:48:31.794023 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.793990    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"]
Sep 15 11:48:31.795320 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.795301    2571 scope.go:117] "RemoveContainer" containerID="9ddad4d8fcb5c7151d65bc928c8e372e3c94be3a5eace92679e60f4ed96cfae6"
Sep 15 11:48:31.795661 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:48:31.795642    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ddad4d8fcb5c7151d65bc928c8e372e3c94be3a5eace92679e60f4ed96cfae6\": container with ID starting with 9ddad4d8fcb5c7151d65bc928c8e372e3c94be3a5eace92679e60f4ed96cfae6 not found: ID does not exist" containerID="9ddad4d8fcb5c7151d65bc928c8e372e3c94be3a5eace92679e60f4ed96cfae6"
Sep 15 11:48:31.795713 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.795669    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ddad4d8fcb5c7151d65bc928c8e372e3c94be3a5eace92679e60f4ed96cfae6"} err="failed to get container status \"9ddad4d8fcb5c7151d65bc928c8e372e3c94be3a5eace92679e60f4ed96cfae6\": rpc error: code = NotFound desc = could not find container \"9ddad4d8fcb5c7151d65bc928c8e372e3c94be3a5eace92679e60f4ed96cfae6\": container with ID starting with 9ddad4d8fcb5c7151d65bc928c8e372e3c94be3a5eace92679e60f4ed96cfae6 not found: ID does not exist"
Sep 15 11:48:31.800423 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.800395    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2jrlc"]
Sep 15 11:48:31.811032 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.810997    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-nt5l5"]
Sep 15 11:48:31.817052 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.817023    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-nt5l5"]
Sep 15 11:48:31.826969 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.826934    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"]
Sep 15 11:48:31.830922 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:31.830889    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kbl4z"]
Sep 15 11:48:32.221689 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:32.221649    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b788be6-bbb0-44fc-8893-4902e07d4bf2" path="/var/lib/kubelet/pods/0b788be6-bbb0-44fc-8893-4902e07d4bf2/volumes"
Sep 15 11:48:32.222174 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:32.222143    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17e54754-7c38-400e-a632-8f90c2854f84" path="/var/lib/kubelet/pods/17e54754-7c38-400e-a632-8f90c2854f84/volumes"
Sep 15 11:48:32.222620 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:32.222606    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e2ca0f3-ee57-46be-b2e5-2d83e73e9763" path="/var/lib/kubelet/pods/7e2ca0f3-ee57-46be-b2e5-2d83e73e9763/volumes"
Sep 15 11:48:34.275838 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.275808    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b6994fc67-nnxk7"]
Sep 15 11:48:34.276263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.276249    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b788be6-bbb0-44fc-8893-4902e07d4bf2" containerName="payload-processing"
Sep 15 11:48:34.276327 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.276266    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b788be6-bbb0-44fc-8893-4902e07d4bf2" containerName="payload-processing"
Sep 15 11:48:34.276327 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.276296    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e2ca0f3-ee57-46be-b2e5-2d83e73e9763" containerName="manager"
Sep 15 11:48:34.276327 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.276301    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e2ca0f3-ee57-46be-b2e5-2d83e73e9763" containerName="manager"
Sep 15 11:48:34.276327 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.276310    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e54754-7c38-400e-a632-8f90c2854f84" containerName="payload-pre-processing"
Sep 15 11:48:34.276327 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.276315    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e54754-7c38-400e-a632-8f90c2854f84" containerName="payload-pre-processing"
Sep 15 11:48:34.276499 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.276372    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e2ca0f3-ee57-46be-b2e5-2d83e73e9763" containerName="manager"
Sep 15 11:48:34.276499 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.276381    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="17e54754-7c38-400e-a632-8f90c2854f84" containerName="payload-pre-processing"
Sep 15 11:48:34.276499 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.276391    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b788be6-bbb0-44fc-8893-4902e07d4bf2" containerName="payload-processing"
Sep 15 11:48:34.280962 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.280946    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 11:48:34.284672 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.284512    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 11:48:34.284672 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.284529    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 11:48:34.284672 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.284565    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4gvps\""
Sep 15 11:48:34.284672 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.284567    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 11:48:34.290232 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.290208    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-nnxk7"]
Sep 15 11:48:34.385518 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.385478    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d56b85be-ecf8-404c-b484-232e772f6f57-webhook-cert\") pod \"maas-controller-6b6994fc67-nnxk7\" (UID: \"d56b85be-ecf8-404c-b484-232e772f6f57\") " pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 11:48:34.385687 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.385532    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b85be-ecf8-404c-b484-232e772f6f57-metrics-certs\") pod \"maas-controller-6b6994fc67-nnxk7\" (UID: \"d56b85be-ecf8-404c-b484-232e772f6f57\") " pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 11:48:34.385687 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.385608    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hccs\" (UniqueName: \"kubernetes.io/projected/d56b85be-ecf8-404c-b484-232e772f6f57-kube-api-access-4hccs\") pod \"maas-controller-6b6994fc67-nnxk7\" (UID: \"d56b85be-ecf8-404c-b484-232e772f6f57\") " pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 11:48:34.486455 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.486423    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d56b85be-ecf8-404c-b484-232e772f6f57-webhook-cert\") pod \"maas-controller-6b6994fc67-nnxk7\" (UID: \"d56b85be-ecf8-404c-b484-232e772f6f57\") " pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 11:48:34.486652 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.486467    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b85be-ecf8-404c-b484-232e772f6f57-metrics-certs\") pod \"maas-controller-6b6994fc67-nnxk7\" (UID: \"d56b85be-ecf8-404c-b484-232e772f6f57\") " pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 11:48:34.486652 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.486497    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hccs\" (UniqueName: \"kubernetes.io/projected/d56b85be-ecf8-404c-b484-232e772f6f57-kube-api-access-4hccs\") pod \"maas-controller-6b6994fc67-nnxk7\" (UID: \"d56b85be-ecf8-404c-b484-232e772f6f57\") " pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 11:48:34.488846 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.488817    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b85be-ecf8-404c-b484-232e772f6f57-metrics-certs\") pod \"maas-controller-6b6994fc67-nnxk7\" (UID: \"d56b85be-ecf8-404c-b484-232e772f6f57\") " pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 11:48:34.488967 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.488913    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d56b85be-ecf8-404c-b484-232e772f6f57-webhook-cert\") pod \"maas-controller-6b6994fc67-nnxk7\" (UID: \"d56b85be-ecf8-404c-b484-232e772f6f57\") " pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 11:48:34.494273 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.494254    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hccs\" (UniqueName: \"kubernetes.io/projected/d56b85be-ecf8-404c-b484-232e772f6f57-kube-api-access-4hccs\") pod \"maas-controller-6b6994fc67-nnxk7\" (UID: \"d56b85be-ecf8-404c-b484-232e772f6f57\") " pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 11:48:34.592404 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.592322    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 11:48:34.866624 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:34.866601    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-nnxk7"]
Sep 15 11:48:34.869327 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:48:34.869295    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56b85be_ecf8_404c_b484_232e772f6f57.slice/crio-d472cc5bc72cbe5c9017ee9894d9ccab8918abb1afbf2083a4d2d5eb38e985f4 WatchSource:0}: Error finding container d472cc5bc72cbe5c9017ee9894d9ccab8918abb1afbf2083a4d2d5eb38e985f4: Status 404 returned error can't find the container with id d472cc5bc72cbe5c9017ee9894d9ccab8918abb1afbf2083a4d2d5eb38e985f4
Sep 15 11:48:35.788823 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:35.788785    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-nnxk7" event={"ID":"d56b85be-ecf8-404c-b484-232e772f6f57","Type":"ContainerStarted","Data":"5f3d8b72507cda7d9716b2cf7aa143fefb17abd20d2b807fb07f8e7eaa3f3ce0"}
Sep 15 11:48:35.789273 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:35.788850    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 11:48:35.789273 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:35.788876    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-nnxk7" event={"ID":"d56b85be-ecf8-404c-b484-232e772f6f57","Type":"ContainerStarted","Data":"d472cc5bc72cbe5c9017ee9894d9ccab8918abb1afbf2083a4d2d5eb38e985f4"}
Sep 15 11:48:35.808803 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:35.808742    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b6994fc67-nnxk7" podStartSLOduration=1.456774389 podStartE2EDuration="1.80872475s" totalImagesPullingTime="351.950361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:48:35.806852098 +0000 UTC m=+678.058409154" watchObservedRunningTime="2026-09-15 11:48:35.80872475 +0000 UTC m=+678.060281807"
Sep 15 11:48:46.796387 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:46.796354    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 11:48:47.782876 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:47.782834    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"]
Sep 15 11:48:47.786596 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:47.786568    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"
Sep 15 11:48:47.789135 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:47.789102    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Sep 15 11:48:47.789341 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:47.789114    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-gvqxs\""
Sep 15 11:48:47.794105 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:47.794073    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"]
Sep 15 11:48:47.908295 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:47.908254    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvrqn\" (UniqueName: \"kubernetes.io/projected/ccf75bc5-794b-4b0d-b41e-b856f0fdc36a-kube-api-access-hvrqn\") pod \"ai-gateway-controller-6c7bcf555-f2fp9\" (UID: \"ccf75bc5-794b-4b0d-b41e-b856f0fdc36a\") " pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"
Sep 15 11:48:48.009181 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:48.009123    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvrqn\" (UniqueName: \"kubernetes.io/projected/ccf75bc5-794b-4b0d-b41e-b856f0fdc36a-kube-api-access-hvrqn\") pod \"ai-gateway-controller-6c7bcf555-f2fp9\" (UID: \"ccf75bc5-794b-4b0d-b41e-b856f0fdc36a\") " pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"
Sep 15 11:48:48.017842 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:48.017815    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvrqn\" (UniqueName: \"kubernetes.io/projected/ccf75bc5-794b-4b0d-b41e-b856f0fdc36a-kube-api-access-hvrqn\") pod \"ai-gateway-controller-6c7bcf555-f2fp9\" (UID: \"ccf75bc5-794b-4b0d-b41e-b856f0fdc36a\") " pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"
Sep 15 11:48:48.100497 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:48.100410    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"
Sep 15 11:48:48.370629 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:48.370604    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"]
Sep 15 11:48:48.372912 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:48:48.372886    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf75bc5_794b_4b0d_b41e_b856f0fdc36a.slice/crio-8dc2eeac067902dac5e6189e442da57fe7bc79c98a18315bf2eeecb4eae1ec5e WatchSource:0}: Error finding container 8dc2eeac067902dac5e6189e442da57fe7bc79c98a18315bf2eeecb4eae1ec5e: Status 404 returned error can't find the container with id 8dc2eeac067902dac5e6189e442da57fe7bc79c98a18315bf2eeecb4eae1ec5e
Sep 15 11:48:48.855418 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:48.855386    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9" event={"ID":"ccf75bc5-794b-4b0d-b41e-b856f0fdc36a","Type":"ContainerStarted","Data":"8dc2eeac067902dac5e6189e442da57fe7bc79c98a18315bf2eeecb4eae1ec5e"}
Sep 15 11:48:50.872191 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:50.872132    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9" event={"ID":"ccf75bc5-794b-4b0d-b41e-b856f0fdc36a","Type":"ContainerStarted","Data":"fe4315d9dc8390cdc97a1e3ae3bb4dff45406643d4bd82dfe2de21810fe8cc40"}
Sep 15 11:48:50.872559 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:50.872215    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"
Sep 15 11:48:50.889906 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:50.889862    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9" podStartSLOduration=1.572347859 podStartE2EDuration="3.889847773s" totalImagesPullingTime="2.317499914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:48:50.888540827 +0000 UTC m=+693.140097883" watchObservedRunningTime="2026-09-15 11:48:50.889847773 +0000 UTC m=+693.141404830"
Sep 15 11:48:51.147188 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.147114    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:51.188309 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.188274    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-558d9b8847-2nr6n"]
Sep 15 11:48:51.192302 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.192280    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-558d9b8847-2nr6n"
Sep 15 11:48:51.194734 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.194709    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 15 11:48:51.202318 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.202290    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-558d9b8847-2nr6n"]
Sep 15 11:48:51.204420 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.204395    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-74969cc5f8-jjnsc"]
Sep 15 11:48:51.208024 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.208004    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-74969cc5f8-jjnsc"
Sep 15 11:48:51.210322 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.210305    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9b9h8\""
Sep 15 11:48:51.220541 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.220514    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-74969cc5f8-jjnsc"]
Sep 15 11:48:51.221670 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.221644    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:48:51.348093 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.348060    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe167c50-85f2-42e8-b925-c2c76acbc19e-plugins-config-volume\") pod \"payload-pre-processing-558d9b8847-2nr6n\" (UID: \"fe167c50-85f2-42e8-b925-c2c76acbc19e\") " pod="openshift-ingress/payload-pre-processing-558d9b8847-2nr6n"
Sep 15 11:48:51.348093 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.348097    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba184fb9-5c6e-4777-98de-9b779cb5ac0c-plugins-config-volume\") pod \"payload-processing-74969cc5f8-jjnsc\" (UID: \"ba184fb9-5c6e-4777-98de-9b779cb5ac0c\") " pod="openshift-ingress/payload-processing-74969cc5f8-jjnsc"
Sep 15 11:48:51.348341 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.348265    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpxzr\" (UniqueName: \"kubernetes.io/projected/ba184fb9-5c6e-4777-98de-9b779cb5ac0c-kube-api-access-qpxzr\") pod \"payload-processing-74969cc5f8-jjnsc\" (UID: \"ba184fb9-5c6e-4777-98de-9b779cb5ac0c\") " pod="openshift-ingress/payload-processing-74969cc5f8-jjnsc"
Sep 15 11:48:51.348404 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.348354    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vxl9\" (UniqueName: \"kubernetes.io/projected/fe167c50-85f2-42e8-b925-c2c76acbc19e-kube-api-access-4vxl9\") pod \"payload-pre-processing-558d9b8847-2nr6n\" (UID: \"fe167c50-85f2-42e8-b925-c2c76acbc19e\") " pod="openshift-ingress/payload-pre-processing-558d9b8847-2nr6n"
Sep 15 11:48:51.449559 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.449516    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe167c50-85f2-42e8-b925-c2c76acbc19e-plugins-config-volume\") pod \"payload-pre-processing-558d9b8847-2nr6n\" (UID: \"fe167c50-85f2-42e8-b925-c2c76acbc19e\") " pod="openshift-ingress/payload-pre-processing-558d9b8847-2nr6n"
Sep 15 11:48:51.449759 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.449567    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba184fb9-5c6e-4777-98de-9b779cb5ac0c-plugins-config-volume\") pod \"payload-processing-74969cc5f8-jjnsc\" (UID: \"ba184fb9-5c6e-4777-98de-9b779cb5ac0c\") " pod="openshift-ingress/payload-processing-74969cc5f8-jjnsc"
Sep 15 11:48:51.449759 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.449683    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpxzr\" (UniqueName: \"kubernetes.io/projected/ba184fb9-5c6e-4777-98de-9b779cb5ac0c-kube-api-access-qpxzr\") pod \"payload-processing-74969cc5f8-jjnsc\" (UID: \"ba184fb9-5c6e-4777-98de-9b779cb5ac0c\") " pod="openshift-ingress/payload-processing-74969cc5f8-jjnsc"
Sep 15 11:48:51.449759 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.449728    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vxl9\" (UniqueName: \"kubernetes.io/projected/fe167c50-85f2-42e8-b925-c2c76acbc19e-kube-api-access-4vxl9\") pod \"payload-pre-processing-558d9b8847-2nr6n\" (UID: \"fe167c50-85f2-42e8-b925-c2c76acbc19e\") " pod="openshift-ingress/payload-pre-processing-558d9b8847-2nr6n"
Sep 15 11:48:51.450546 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.450525    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba184fb9-5c6e-4777-98de-9b779cb5ac0c-plugins-config-volume\") pod \"payload-processing-74969cc5f8-jjnsc\" (UID: \"ba184fb9-5c6e-4777-98de-9b779cb5ac0c\") " pod="openshift-ingress/payload-processing-74969cc5f8-jjnsc"
Sep 15 11:48:51.450546 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.450540    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe167c50-85f2-42e8-b925-c2c76acbc19e-plugins-config-volume\") pod \"payload-pre-processing-558d9b8847-2nr6n\" (UID: \"fe167c50-85f2-42e8-b925-c2c76acbc19e\") " pod="openshift-ingress/payload-pre-processing-558d9b8847-2nr6n"
Sep 15 11:48:51.458394 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.458364    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vxl9\" (UniqueName: \"kubernetes.io/projected/fe167c50-85f2-42e8-b925-c2c76acbc19e-kube-api-access-4vxl9\") pod \"payload-pre-processing-558d9b8847-2nr6n\" (UID: \"fe167c50-85f2-42e8-b925-c2c76acbc19e\") " pod="openshift-ingress/payload-pre-processing-558d9b8847-2nr6n"
Sep 15 11:48:51.458394 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.458377    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpxzr\" (UniqueName: \"kubernetes.io/projected/ba184fb9-5c6e-4777-98de-9b779cb5ac0c-kube-api-access-qpxzr\") pod \"payload-processing-74969cc5f8-jjnsc\" (UID: \"ba184fb9-5c6e-4777-98de-9b779cb5ac0c\") " pod="openshift-ingress/payload-processing-74969cc5f8-jjnsc"
Sep 15 11:48:51.503324 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.503289    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-558d9b8847-2nr6n"
Sep 15 11:48:51.518841 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.518820    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-74969cc5f8-jjnsc"
Sep 15 11:48:51.778869 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.778832    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-558d9b8847-2nr6n"]
Sep 15 11:48:51.780879 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:48:51.780850    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe167c50_85f2_42e8_b925_c2c76acbc19e.slice/crio-f650d2881dfb77431f92cd7a7a1156eaeaad48bc94314faf756353e5faea3025 WatchSource:0}: Error finding container f650d2881dfb77431f92cd7a7a1156eaeaad48bc94314faf756353e5faea3025: Status 404 returned error can't find the container with id f650d2881dfb77431f92cd7a7a1156eaeaad48bc94314faf756353e5faea3025
Sep 15 11:48:51.799505 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.799486    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-74969cc5f8-jjnsc"]
Sep 15 11:48:51.801334 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:48:51.801313    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba184fb9_5c6e_4777_98de_9b779cb5ac0c.slice/crio-3cccd18d3d3330477685a84d27ef6ef6d3fac1056138ea1185738784fbf20c69 WatchSource:0}: Error finding container 3cccd18d3d3330477685a84d27ef6ef6d3fac1056138ea1185738784fbf20c69: Status 404 returned error can't find the container with id 3cccd18d3d3330477685a84d27ef6ef6d3fac1056138ea1185738784fbf20c69
Sep 15 11:48:51.878619 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.878585    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-74969cc5f8-jjnsc" event={"ID":"ba184fb9-5c6e-4777-98de-9b779cb5ac0c","Type":"ContainerStarted","Data":"3cccd18d3d3330477685a84d27ef6ef6d3fac1056138ea1185738784fbf20c69"}
Sep 15 11:48:51.879795 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:51.879770    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-558d9b8847-2nr6n" event={"ID":"fe167c50-85f2-42e8-b925-c2c76acbc19e","Type":"ContainerStarted","Data":"f650d2881dfb77431f92cd7a7a1156eaeaad48bc94314faf756353e5faea3025"}
Sep 15 11:48:54.900378 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:54.900338    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-74969cc5f8-jjnsc" event={"ID":"ba184fb9-5c6e-4777-98de-9b779cb5ac0c","Type":"ContainerStarted","Data":"2a74e7afcce987194bf592530415e8f251bf5f6b94515d906e5d9a62f3d8a35b"}
Sep 15 11:48:54.900856 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:54.900437    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-74969cc5f8-jjnsc"
Sep 15 11:48:54.902107 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:54.902085    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-558d9b8847-2nr6n" event={"ID":"fe167c50-85f2-42e8-b925-c2c76acbc19e","Type":"ContainerStarted","Data":"dbcbeecf5d0a323561ea07e08d5ecbb17dce0d313413b7b5eceda368816f7e50"}
Sep 15 11:48:54.902223 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:54.902132    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-558d9b8847-2nr6n"
Sep 15 11:48:54.917446 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:54.917392    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-74969cc5f8-jjnsc" podStartSLOduration=1.635103548 podStartE2EDuration="3.917372778s" totalImagesPullingTime="2.28226923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:48:54.91695597 +0000 UTC m=+697.168513030" watchObservedRunningTime="2026-09-15 11:48:54.917372778 +0000 UTC m=+697.168929839"
Sep 15 11:48:54.940544 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:48:54.940487    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-558d9b8847-2nr6n" podStartSLOduration=1.633260618 podStartE2EDuration="3.940469492s" totalImagesPullingTime="2.307208874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:48:54.938295687 +0000 UTC m=+697.189852745" watchObservedRunningTime="2026-09-15 11:48:54.940469492 +0000 UTC m=+697.192026549"
Sep 15 11:49:01.882768 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:01.882736    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"
Sep 15 11:49:02.334409 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:02.334370    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-6786f98586-cfjf7"]
Sep 15 11:49:02.339319 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:02.339295    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6786f98586-cfjf7"
Sep 15 11:49:02.346608 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:02.346578    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6786f98586-cfjf7"]
Sep 15 11:49:02.462873 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:02.462830    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr8h6\" (UniqueName: \"kubernetes.io/projected/17859261-4122-4cf7-b3a0-e7f6a5419839-kube-api-access-xr8h6\") pod \"ai-gateway-controller-6786f98586-cfjf7\" (UID: \"17859261-4122-4cf7-b3a0-e7f6a5419839\") " pod="opendatahub/ai-gateway-controller-6786f98586-cfjf7"
Sep 15 11:49:02.563482 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:02.563439    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8h6\" (UniqueName: \"kubernetes.io/projected/17859261-4122-4cf7-b3a0-e7f6a5419839-kube-api-access-xr8h6\") pod \"ai-gateway-controller-6786f98586-cfjf7\" (UID: \"17859261-4122-4cf7-b3a0-e7f6a5419839\") " pod="opendatahub/ai-gateway-controller-6786f98586-cfjf7"
Sep 15 11:49:02.571574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:02.571546    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr8h6\" (UniqueName: \"kubernetes.io/projected/17859261-4122-4cf7-b3a0-e7f6a5419839-kube-api-access-xr8h6\") pod \"ai-gateway-controller-6786f98586-cfjf7\" (UID: \"17859261-4122-4cf7-b3a0-e7f6a5419839\") " pod="opendatahub/ai-gateway-controller-6786f98586-cfjf7"
Sep 15 11:49:02.651555 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:02.651448    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6786f98586-cfjf7"
Sep 15 11:49:02.924452 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:02.924418    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6786f98586-cfjf7"]
Sep 15 11:49:02.925941 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:49:02.925912    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17859261_4122_4cf7_b3a0_e7f6a5419839.slice/crio-7194785c0dc5550a608c28c8caaee9758263216bccd8b720c96ec9dea55e2d92 WatchSource:0}: Error finding container 7194785c0dc5550a608c28c8caaee9758263216bccd8b720c96ec9dea55e2d92: Status 404 returned error can't find the container with id 7194785c0dc5550a608c28c8caaee9758263216bccd8b720c96ec9dea55e2d92
Sep 15 11:49:02.946772 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:02.946728    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6786f98586-cfjf7" event={"ID":"17859261-4122-4cf7-b3a0-e7f6a5419839","Type":"ContainerStarted","Data":"7194785c0dc5550a608c28c8caaee9758263216bccd8b720c96ec9dea55e2d92"}
Sep 15 11:49:03.954291 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:03.954256    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6786f98586-cfjf7" event={"ID":"17859261-4122-4cf7-b3a0-e7f6a5419839","Type":"ContainerStarted","Data":"6b742fddbfd4d1cebc6a14f969b3cfa65461507bf5566aee89bf216770abeb12"}
Sep 15 11:49:03.954637 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:03.954379    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-6786f98586-cfjf7"
Sep 15 11:49:03.969616 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:03.969568    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-6786f98586-cfjf7" podStartSLOduration=1.310967476 podStartE2EDuration="1.969552889s" totalImagesPullingTime="658.585413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:49:03.968955975 +0000 UTC m=+706.220513047" watchObservedRunningTime="2026-09-15 11:49:03.969552889 +0000 UTC m=+706.221109946"
Sep 15 11:49:05.912088 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:05.912057    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-558d9b8847-2nr6n"
Sep 15 11:49:05.912974 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:05.912951    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-74969cc5f8-jjnsc"
Sep 15 11:49:14.963004 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:14.962974    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-6786f98586-cfjf7"
Sep 15 11:49:15.004418 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:15.004391    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"]
Sep 15 11:49:15.004746 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:15.004711    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9" podUID="ccf75bc5-794b-4b0d-b41e-b856f0fdc36a" containerName="manager" containerID="cri-o://fe4315d9dc8390cdc97a1e3ae3bb4dff45406643d4bd82dfe2de21810fe8cc40" gracePeriod=30
Sep 15 11:49:15.255093 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:15.255067    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"
Sep 15 11:49:15.287359 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:15.287331    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvrqn\" (UniqueName: \"kubernetes.io/projected/ccf75bc5-794b-4b0d-b41e-b856f0fdc36a-kube-api-access-hvrqn\") pod \"ccf75bc5-794b-4b0d-b41e-b856f0fdc36a\" (UID: \"ccf75bc5-794b-4b0d-b41e-b856f0fdc36a\") "
Sep 15 11:49:15.289557 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:15.289521    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccf75bc5-794b-4b0d-b41e-b856f0fdc36a-kube-api-access-hvrqn" (OuterVolumeSpecName: "kube-api-access-hvrqn") pod "ccf75bc5-794b-4b0d-b41e-b856f0fdc36a" (UID: "ccf75bc5-794b-4b0d-b41e-b856f0fdc36a"). InnerVolumeSpecName "kube-api-access-hvrqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:49:15.388633 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:15.388597    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvrqn\" (UniqueName: \"kubernetes.io/projected/ccf75bc5-794b-4b0d-b41e-b856f0fdc36a-kube-api-access-hvrqn\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:49:16.021095 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:16.021058    2571 generic.go:356] "Generic (PLEG): container finished" podID="ccf75bc5-794b-4b0d-b41e-b856f0fdc36a" containerID="fe4315d9dc8390cdc97a1e3ae3bb4dff45406643d4bd82dfe2de21810fe8cc40" exitCode=0
Sep 15 11:49:16.021517 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:16.021106    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"
Sep 15 11:49:16.021517 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:16.021140    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9" event={"ID":"ccf75bc5-794b-4b0d-b41e-b856f0fdc36a","Type":"ContainerDied","Data":"fe4315d9dc8390cdc97a1e3ae3bb4dff45406643d4bd82dfe2de21810fe8cc40"}
Sep 15 11:49:16.021517 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:16.021217    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6c7bcf555-f2fp9" event={"ID":"ccf75bc5-794b-4b0d-b41e-b856f0fdc36a","Type":"ContainerDied","Data":"8dc2eeac067902dac5e6189e442da57fe7bc79c98a18315bf2eeecb4eae1ec5e"}
Sep 15 11:49:16.021517 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:16.021239    2571 scope.go:117] "RemoveContainer" containerID="fe4315d9dc8390cdc97a1e3ae3bb4dff45406643d4bd82dfe2de21810fe8cc40"
Sep 15 11:49:16.030137 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:16.030113    2571 scope.go:117] "RemoveContainer" containerID="fe4315d9dc8390cdc97a1e3ae3bb4dff45406643d4bd82dfe2de21810fe8cc40"
Sep 15 11:49:16.030415 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:49:16.030395    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe4315d9dc8390cdc97a1e3ae3bb4dff45406643d4bd82dfe2de21810fe8cc40\": container with ID starting with fe4315d9dc8390cdc97a1e3ae3bb4dff45406643d4bd82dfe2de21810fe8cc40 not found: ID does not exist" containerID="fe4315d9dc8390cdc97a1e3ae3bb4dff45406643d4bd82dfe2de21810fe8cc40"
Sep 15 11:49:16.030476 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:16.030424    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe4315d9dc8390cdc97a1e3ae3bb4dff45406643d4bd82dfe2de21810fe8cc40"} err="failed to get container status \"fe4315d9dc8390cdc97a1e3ae3bb4dff45406643d4bd82dfe2de21810fe8cc40\": rpc error: code = NotFound desc = could not find container \"fe4315d9dc8390cdc97a1e3ae3bb4dff45406643d4bd82dfe2de21810fe8cc40\": container with ID starting with fe4315d9dc8390cdc97a1e3ae3bb4dff45406643d4bd82dfe2de21810fe8cc40 not found: ID does not exist"
Sep 15 11:49:16.041995 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:16.041969    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"]
Sep 15 11:49:16.045667 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:16.045647    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-6c7bcf555-f2fp9"]
Sep 15 11:49:16.214508 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:16.214470    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccf75bc5-794b-4b0d-b41e-b856f0fdc36a" path="/var/lib/kubelet/pods/ccf75bc5-794b-4b0d-b41e-b856f0fdc36a/volumes"
Sep 15 11:49:19.354291 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:19.354254    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:20.573305 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:20.573272    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:23.851373 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:23.851337    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:23.953310 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:23.953278    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:27.743839 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:27.743781    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:27.843011 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:27.842981    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:49:46.769434 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:49:46.769392    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:06.459833 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.459799    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:06.831796 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.831717    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"]
Sep 15 11:50:06.832166 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.832143    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccf75bc5-794b-4b0d-b41e-b856f0fdc36a" containerName="manager"
Sep 15 11:50:06.832220 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.832170    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccf75bc5-794b-4b0d-b41e-b856f0fdc36a" containerName="manager"
Sep 15 11:50:06.832265 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.832255    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccf75bc5-794b-4b0d-b41e-b856f0fdc36a" containerName="manager"
Sep 15 11:50:06.835605 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.835587    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:06.838265 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.838238    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-155ffe-openshift-default-dockercfg-tjznd\""
Sep 15 11:50:06.849637 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.849613    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"]
Sep 15 11:50:06.857333 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.857303    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:06.996693 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.996649    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de74fa49-ba93-46c1-9267-f75eccec220b-istio-token\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:06.996693 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.996695    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-credential-socket\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:06.996972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.996729    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-workload-socket\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:06.996972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.996753    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5c7b\" (UniqueName: \"kubernetes.io/projected/de74fa49-ba93-46c1-9267-f75eccec220b-kube-api-access-n5c7b\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:06.996972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.996813    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-istio-data\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:06.996972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.996858    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-workload-certs\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:06.996972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.996937    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-istio-envoy\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:06.996972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.996970    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de74fa49-ba93-46c1-9267-f75eccec220b-istiod-ca-cert\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:06.997213 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:06.997008    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de74fa49-ba93-46c1-9267-f75eccec220b-istio-podinfo\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.097772 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.097683    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de74fa49-ba93-46c1-9267-f75eccec220b-istio-token\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.097772 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.097721    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-credential-socket\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.097772 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.097745    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-workload-socket\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.097772 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.097765    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5c7b\" (UniqueName: \"kubernetes.io/projected/de74fa49-ba93-46c1-9267-f75eccec220b-kube-api-access-n5c7b\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.098120 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.097802    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-istio-data\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.098120 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.097826    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-workload-certs\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.098120 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.097871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-istio-envoy\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.098120 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.097889    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de74fa49-ba93-46c1-9267-f75eccec220b-istiod-ca-cert\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.098120 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.097923    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de74fa49-ba93-46c1-9267-f75eccec220b-istio-podinfo\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.098505 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.098255    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-credential-socket\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.098505 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.098286    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-workload-socket\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.098505 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.098346    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-workload-certs\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.098661 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.098638    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-istio-data\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.098720 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.098699    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de74fa49-ba93-46c1-9267-f75eccec220b-istiod-ca-cert\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.100355 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.100328    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-istio-envoy\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.100579 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.100563    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de74fa49-ba93-46c1-9267-f75eccec220b-istio-podinfo\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.106765 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.106739    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de74fa49-ba93-46c1-9267-f75eccec220b-istio-token\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.106864 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.106848    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5c7b\" (UniqueName: \"kubernetes.io/projected/de74fa49-ba93-46c1-9267-f75eccec220b-kube-api-access-n5c7b\") pod \"e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") " pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.146981 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.146947    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:07.272750 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.272721    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:07.423988 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.423960    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"]
Sep 15 11:50:07.425345 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:50:07.425319    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde74fa49_ba93_46c1_9267_f75eccec220b.slice/crio-927b5bc8be4ddc21b325d1973a416f8f97f80039de00fd40e84fab3d654da9c9 WatchSource:0}: Error finding container 927b5bc8be4ddc21b325d1973a416f8f97f80039de00fd40e84fab3d654da9c9: Status 404 returned error can't find the container with id 927b5bc8be4ddc21b325d1973a416f8f97f80039de00fd40e84fab3d654da9c9
Sep 15 11:50:07.427493 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.427460    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:50:07.427593 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.427522    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:50:07.427593 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:07.427552    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:50:08.294623 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:08.294582    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" event={"ID":"de74fa49-ba93-46c1-9267-f75eccec220b","Type":"ContainerStarted","Data":"1184322e52e186a6c2f02258878329658e696b4045cabd5a209e4f719b259aad"}
Sep 15 11:50:08.295083 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:08.294638    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" event={"ID":"de74fa49-ba93-46c1-9267-f75eccec220b","Type":"ContainerStarted","Data":"927b5bc8be4ddc21b325d1973a416f8f97f80039de00fd40e84fab3d654da9c9"}
Sep 15 11:50:08.315635 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:08.315569    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" podStartSLOduration=2.315553244 podStartE2EDuration="2.315553244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:08.313525213 +0000 UTC m=+770.565082269" watchObservedRunningTime="2026-09-15 11:50:08.315553244 +0000 UTC m=+770.567110301"
Sep 15 11:50:08.489602 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:08.489565    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:08.692435 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:08.692360    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:09.147992 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:09.147961    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:09.152987 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:09.152960    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:09.242657 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:09.242623    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:09.301195 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:09.301147    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:09.301963 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:09.301942    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:10.752573 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:10.752533    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:10.846211 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:10.846178    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:11.863968 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:11.863910    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"]
Sep 15 11:50:11.869115 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:11.869087    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:11.871380 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:11.871360    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-155ffe-serving-cert\""
Sep 15 11:50:11.875938 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:11.875915    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"]
Sep 15 11:50:11.937541 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:11.937509    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:12.039436 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.039399    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:12.048583 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.048559    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb6wc\" (UniqueName: \"kubernetes.io/projected/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-kube-api-access-nb6wc\") pod \"maas-api-e2e-inf-a-155ffe-856855b5df-srxrp\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.048682 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.048606    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-metrics-certs\") pod \"maas-api-e2e-inf-a-155ffe-856855b5df-srxrp\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.048725 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.048698    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-maas-api-tls\") pod \"maas-api-e2e-inf-a-155ffe-856855b5df-srxrp\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.048808 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.048790    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-155ffe-856855b5df-srxrp\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.150389 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.150314    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-155ffe-856855b5df-srxrp\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.150389 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.150366    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb6wc\" (UniqueName: \"kubernetes.io/projected/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-kube-api-access-nb6wc\") pod \"maas-api-e2e-inf-a-155ffe-856855b5df-srxrp\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.150550 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.150397    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-metrics-certs\") pod \"maas-api-e2e-inf-a-155ffe-856855b5df-srxrp\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.150550 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.150441    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-maas-api-tls\") pod \"maas-api-e2e-inf-a-155ffe-856855b5df-srxrp\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.150622 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:50:12.150552    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-serving-cert: secret "maas-api-e2e-inf-a-155ffe-serving-cert" not found
Sep 15 11:50:12.150656 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:50:12.150627    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-maas-api-tls podName:d1a827e1-3177-4ac3-a07f-fbaed48d6a9e nodeName:}" failed. No retries permitted until 2026-09-15 11:50:12.650606679 +0000 UTC m=+774.902163717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-maas-api-tls") pod "maas-api-e2e-inf-a-155ffe-856855b5df-srxrp" (UID: "d1a827e1-3177-4ac3-a07f-fbaed48d6a9e") : secret "maas-api-e2e-inf-a-155ffe-serving-cert" not found
Sep 15 11:50:12.151020 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.151001    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-155ffe-856855b5df-srxrp\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.152890 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.152861    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-metrics-certs\") pod \"maas-api-e2e-inf-a-155ffe-856855b5df-srxrp\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.158407 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.158387    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb6wc\" (UniqueName: \"kubernetes.io/projected/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-kube-api-access-nb6wc\") pod \"maas-api-e2e-inf-a-155ffe-856855b5df-srxrp\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.340745 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.340715    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:12.468301 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.468268    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:12.578227 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.578199    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:12.625444 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.625410    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"]
Sep 15 11:50:12.630206 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.630184    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"
Sep 15 11:50:12.633272 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.633256    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-155ffe-dockercfg-78n52\""
Sep 15 11:50:12.633546 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.633529    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-155ffe\""
Sep 15 11:50:12.643627 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.643606    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"]
Sep 15 11:50:12.655215 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.655193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-maas-api-tls\") pod \"maas-api-e2e-inf-a-155ffe-856855b5df-srxrp\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.657183 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.657141    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"]
Sep 15 11:50:12.657575 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.657557    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-maas-api-tls\") pod \"maas-api-e2e-inf-a-155ffe-856855b5df-srxrp\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.662664 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.662647    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"
Sep 15 11:50:12.676326 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.676297    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"]
Sep 15 11:50:12.756410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.756330    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d814eab-685c-4bd9-aefd-c5efeff1a5e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf\" (UID: \"2d814eab-685c-4bd9-aefd-c5efeff1a5e6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"
Sep 15 11:50:12.756410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.756385    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5576h\" (UniqueName: \"kubernetes.io/projected/2d814eab-685c-4bd9-aefd-c5efeff1a5e6-kube-api-access-5576h\") pod \"payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf\" (UID: \"2d814eab-685c-4bd9-aefd-c5efeff1a5e6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"
Sep 15 11:50:12.785278 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.785253    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:12.857512 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.857477    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc017203-aeca-4090-af25-657ae66ab10e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf\" (UID: \"cc017203-aeca-4090-af25-657ae66ab10e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"
Sep 15 11:50:12.857649 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.857536    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d814eab-685c-4bd9-aefd-c5efeff1a5e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf\" (UID: \"2d814eab-685c-4bd9-aefd-c5efeff1a5e6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"
Sep 15 11:50:12.857649 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.857605    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5576h\" (UniqueName: \"kubernetes.io/projected/2d814eab-685c-4bd9-aefd-c5efeff1a5e6-kube-api-access-5576h\") pod \"payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf\" (UID: \"2d814eab-685c-4bd9-aefd-c5efeff1a5e6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"
Sep 15 11:50:12.857720 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.857655    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxbnx\" (UniqueName: \"kubernetes.io/projected/cc017203-aeca-4090-af25-657ae66ab10e-kube-api-access-jxbnx\") pod \"payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf\" (UID: \"cc017203-aeca-4090-af25-657ae66ab10e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"
Sep 15 11:50:12.858405 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.858381    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d814eab-685c-4bd9-aefd-c5efeff1a5e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf\" (UID: \"2d814eab-685c-4bd9-aefd-c5efeff1a5e6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"
Sep 15 11:50:12.865224 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.865128    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5576h\" (UniqueName: \"kubernetes.io/projected/2d814eab-685c-4bd9-aefd-c5efeff1a5e6-kube-api-access-5576h\") pod \"payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf\" (UID: \"2d814eab-685c-4bd9-aefd-c5efeff1a5e6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"
Sep 15 11:50:12.941530 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.941479    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"
Sep 15 11:50:12.958609 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.958577    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxbnx\" (UniqueName: \"kubernetes.io/projected/cc017203-aeca-4090-af25-657ae66ab10e-kube-api-access-jxbnx\") pod \"payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf\" (UID: \"cc017203-aeca-4090-af25-657ae66ab10e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"
Sep 15 11:50:12.958714 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.958689    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc017203-aeca-4090-af25-657ae66ab10e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf\" (UID: \"cc017203-aeca-4090-af25-657ae66ab10e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"
Sep 15 11:50:12.959417 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.959395    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc017203-aeca-4090-af25-657ae66ab10e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf\" (UID: \"cc017203-aeca-4090-af25-657ae66ab10e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"
Sep 15 11:50:12.967791 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.967760    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxbnx\" (UniqueName: \"kubernetes.io/projected/cc017203-aeca-4090-af25-657ae66ab10e-kube-api-access-jxbnx\") pod \"payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf\" (UID: \"cc017203-aeca-4090-af25-657ae66ab10e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"
Sep 15 11:50:12.981438 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:12.981404    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"
Sep 15 11:50:13.060644 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:13.060611    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"]
Sep 15 11:50:13.064730 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:50:13.064695    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a827e1_3177_4ac3_a07f_fbaed48d6a9e.slice/crio-a5f71f6aba5a9841aa0003e7601ef493cac5368e815f32c3b7971cf7c06d3fd5 WatchSource:0}: Error finding container a5f71f6aba5a9841aa0003e7601ef493cac5368e815f32c3b7971cf7c06d3fd5: Status 404 returned error can't find the container with id a5f71f6aba5a9841aa0003e7601ef493cac5368e815f32c3b7971cf7c06d3fd5
Sep 15 11:50:13.215583 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:13.215556    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"]
Sep 15 11:50:13.217819 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:50:13.217789    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d814eab_685c_4bd9_aefd_c5efeff1a5e6.slice/crio-98f9b7f0e7fadec1de837326570161406ef8a734625890a5c6edb5c116e40530 WatchSource:0}: Error finding container 98f9b7f0e7fadec1de837326570161406ef8a734625890a5c6edb5c116e40530: Status 404 returned error can't find the container with id 98f9b7f0e7fadec1de837326570161406ef8a734625890a5c6edb5c116e40530
Sep 15 11:50:13.267478 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:13.267454    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"]
Sep 15 11:50:13.269224 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:50:13.269179    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc017203_aeca_4090_af25_657ae66ab10e.slice/crio-7d3e8190b2f204a03f7769ce3278b7d5375eebe60c4d8a7b8f809fb0fede91f6 WatchSource:0}: Error finding container 7d3e8190b2f204a03f7769ce3278b7d5375eebe60c4d8a7b8f809fb0fede91f6: Status 404 returned error can't find the container with id 7d3e8190b2f204a03f7769ce3278b7d5375eebe60c4d8a7b8f809fb0fede91f6
Sep 15 11:50:13.326556 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:13.326489    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf" event={"ID":"2d814eab-685c-4bd9-aefd-c5efeff1a5e6","Type":"ContainerStarted","Data":"27f485b3d97e431847d59d9155a025ee8c6f92988d0ef4024adf4fd6fbc0f2d5"}
Sep 15 11:50:13.326713 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:13.326557    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf" event={"ID":"2d814eab-685c-4bd9-aefd-c5efeff1a5e6","Type":"ContainerStarted","Data":"98f9b7f0e7fadec1de837326570161406ef8a734625890a5c6edb5c116e40530"}
Sep 15 11:50:13.326713 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:13.326636    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"
Sep 15 11:50:13.328100 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:13.328078    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp" event={"ID":"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e","Type":"ContainerStarted","Data":"a5f71f6aba5a9841aa0003e7601ef493cac5368e815f32c3b7971cf7c06d3fd5"}
Sep 15 11:50:13.329303 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:13.329193    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf" event={"ID":"cc017203-aeca-4090-af25-657ae66ab10e","Type":"ContainerStarted","Data":"7d3e8190b2f204a03f7769ce3278b7d5375eebe60c4d8a7b8f809fb0fede91f6"}
Sep 15 11:50:13.345282 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:13.345242    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf" podStartSLOduration=1.345227404 podStartE2EDuration="1.345227404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:13.343267413 +0000 UTC m=+775.594824471" watchObservedRunningTime="2026-09-15 11:50:13.345227404 +0000 UTC m=+775.596784460"
Sep 15 11:50:14.340208 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:14.340148    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf" event={"ID":"cc017203-aeca-4090-af25-657ae66ab10e","Type":"ContainerStarted","Data":"04c670f8fc6a011f7e8de425b3cf80aea3402f0a2a133ea448d0dc62c8c47701"}
Sep 15 11:50:14.340679 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:14.340242    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"
Sep 15 11:50:14.342011 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:14.341982    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp" event={"ID":"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e","Type":"ContainerStarted","Data":"85dd3ae6daa22bcdfb7927587ec92429f974474bfeda06f40dd0d68596edafe8"}
Sep 15 11:50:14.342128 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:14.342034    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:14.357245 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:14.357200    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf" podStartSLOduration=2.357184434 podStartE2EDuration="2.357184434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:14.35630412 +0000 UTC m=+776.607861181" watchObservedRunningTime="2026-09-15 11:50:14.357184434 +0000 UTC m=+776.608741485"
Sep 15 11:50:14.373294 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:14.373253    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp" podStartSLOduration=2.957837104 podStartE2EDuration="3.373238371s" totalImagesPullingTime="415.401267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:14.372689659 +0000 UTC m=+776.624246716" watchObservedRunningTime="2026-09-15 11:50:14.373238371 +0000 UTC m=+776.624795428"
Sep 15 11:50:15.862733 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:15.862693    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:15.954589 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:15.954554    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:16.144103 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:16.143996    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:16.467398 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:16.467365    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:16.696498 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:16.696463    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:18.485734 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:18.485689    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:19.031941 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:19.031901    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:19.133820 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:19.133787    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:19.233068 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:19.233035    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:20.260356 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.260137    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:20.261702 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.261369    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"]
Sep 15 11:50:20.265690 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.265669    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"]
Sep 15 11:50:20.265804 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.265768    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:20.268418 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.268397    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ee96ca62-serving-cert\""
Sep 15 11:50:20.347661 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.347625    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-maas-api-tls\") pod \"maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:20.347836 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.347717    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-metrics-certs\") pod \"maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:20.347896 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.347872    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85q4f\" (UniqueName: \"kubernetes.io/projected/c888ff3f-2a97-4953-a5d3-68234cad4578-kube-api-access-85q4f\") pod \"maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:20.347949 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.347935    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c888ff3f-2a97-4953-a5d3-68234cad4578-openshift-service-ca\") pod \"maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:20.352191 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.352147    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:20.354565 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.354547    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:50:20.448856 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.448824    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-maas-api-tls\") pod \"maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:20.449009 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.448867    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-metrics-certs\") pod \"maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:20.449009 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.448935    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85q4f\" (UniqueName: \"kubernetes.io/projected/c888ff3f-2a97-4953-a5d3-68234cad4578-kube-api-access-85q4f\") pod \"maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:20.449009 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.448986    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c888ff3f-2a97-4953-a5d3-68234cad4578-openshift-service-ca\") pod \"maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:20.449323 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:50:20.449290    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-serving-cert: secret "maas-api-e2e-ait-ee96ca62-serving-cert" not found
Sep 15 11:50:20.449577 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:50:20.449562    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-maas-api-tls podName:c888ff3f-2a97-4953-a5d3-68234cad4578 nodeName:}" failed. No retries permitted until 2026-09-15 11:50:20.949539267 +0000 UTC m=+783.201096303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-maas-api-tls") pod "maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9" (UID: "c888ff3f-2a97-4953-a5d3-68234cad4578") : secret "maas-api-e2e-ait-ee96ca62-serving-cert" not found
Sep 15 11:50:20.449958 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.449938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c888ff3f-2a97-4953-a5d3-68234cad4578-openshift-service-ca\") pod \"maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:20.452090 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.452055    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-metrics-certs\") pod \"maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:20.457734 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.457713    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85q4f\" (UniqueName: \"kubernetes.io/projected/c888ff3f-2a97-4953-a5d3-68234cad4578-kube-api-access-85q4f\") pod \"maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:20.568126 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.567990    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:20.748021 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.747987    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:20.850511 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.850432    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:20.953583 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.953549    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-maas-api-tls\") pod \"maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:20.955961 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:20.955936    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-maas-api-tls\") pod \"maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:21.176684 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:21.176594    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:21.482113 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:21.482084    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"]
Sep 15 11:50:21.484074 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:50:21.484043    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc888ff3f_2a97_4953_a5d3_68234cad4578.slice/crio-5a095a5385f92ce3692d7648dcd154fbcd83dde3890b9e1bb75fd1f74a922762 WatchSource:0}: Error finding container 5a095a5385f92ce3692d7648dcd154fbcd83dde3890b9e1bb75fd1f74a922762: Status 404 returned error can't find the container with id 5a095a5385f92ce3692d7648dcd154fbcd83dde3890b9e1bb75fd1f74a922762
Sep 15 11:50:22.409070 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:22.409028    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9" event={"ID":"c888ff3f-2a97-4953-a5d3-68234cad4578","Type":"ContainerStarted","Data":"d34d8e97964ebb12e8b277f75764561c63a3295a7517be80c866eb8d5c54722f"}
Sep 15 11:50:22.409381 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:22.409097    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9" event={"ID":"c888ff3f-2a97-4953-a5d3-68234cad4578","Type":"ContainerStarted","Data":"5a095a5385f92ce3692d7648dcd154fbcd83dde3890b9e1bb75fd1f74a922762"}
Sep 15 11:50:22.409381 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:22.409178    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:22.426443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:22.426349    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9" podStartSLOduration=2.103285133 podStartE2EDuration="2.426330448s" totalImagesPullingTime="323.045315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:22.425906238 +0000 UTC m=+784.677463307" watchObservedRunningTime="2026-09-15 11:50:22.426330448 +0000 UTC m=+784.677887507"
Sep 15 11:50:23.953341 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:23.953303    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:24.053753 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:24.053717    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:24.262570 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:24.262471    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:24.344134 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:24.344101    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"
Sep 15 11:50:24.754688 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:24.754619    2571 patch_prober.go:28] interesting pod/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:44718->10.134.0.52:15021: read: connection reset by peer" start-of-body=
Sep 15 11:50:24.754860 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:24.754688    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:44718->10.134.0.52:15021: read: connection reset by peer"
Sep 15 11:50:25.350983 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:25.350953    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"
Sep 15 11:50:25.437209 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:25.437173    2571 generic.go:356] "Generic (PLEG): container finished" podID="de74fa49-ba93-46c1-9267-f75eccec220b" containerID="1184322e52e186a6c2f02258878329658e696b4045cabd5a209e4f719b259aad" exitCode=0
Sep 15 11:50:25.437400 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:25.437259    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" event={"ID":"de74fa49-ba93-46c1-9267-f75eccec220b","Type":"ContainerDied","Data":"1184322e52e186a6c2f02258878329658e696b4045cabd5a209e4f719b259aad"}
Sep 15 11:50:25.437789 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:25.437768    2571 scope.go:117] "RemoveContainer" containerID="1184322e52e186a6c2f02258878329658e696b4045cabd5a209e4f719b259aad"
Sep 15 11:50:25.438885 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:25.438858    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:50:25.438967 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:25.438918    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:50:25.438967 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:25.438946    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:50:26.446624 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:26.446587    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" event={"ID":"de74fa49-ba93-46c1-9267-f75eccec220b","Type":"ContainerStarted","Data":"6d292c5567d20f66d1ee2a75222d3dc8c88c5af2a4c245622bc62fa9dab12034"}
Sep 15 11:50:27.147635 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:27.147594    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:27.147840 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:27.147806    2571 patch_prober.go:28] interesting pod/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:50:27.147917 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:27.147882    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 15 11:50:28.147833 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:28.147796    2571 patch_prober.go:28] interesting pod/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:50:28.148241 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:28.147852    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 15 11:50:28.425068 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:28.424986    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:29.147533 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:29.147498    2571 patch_prober.go:28] interesting pod/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:50:29.147706 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:29.147554    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 15 11:50:30.148003 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:30.147970    2571 patch_prober.go:28] interesting pod/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:50:30.148428 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:30.148028    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 15 11:50:30.443640 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:30.443612    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:30.612378 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:30.612342    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:30.719685 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:30.719571    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:30.812722 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:30.812670    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:31.141549 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:31.141434    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:31.148133 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:31.148104    2571 patch_prober.go:28] interesting pod/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 15 11:50:31.148483 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:31.148184    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 15 11:50:32.151778 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:32.151748    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:32.152270 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:32.152183    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:32.152959 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:32.152938    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:50:33.001006 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:33.000971    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:34.306184 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:34.306135    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:35.011926 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:35.011885    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:35.762195 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:35.762131    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:36.219258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:36.219225    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:36.546204 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:36.546106    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:36.674488 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:36.674451    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:37.065649 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:37.065598    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:37.278842 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:37.278808    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:37.619264 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:37.619226    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:38.339488 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:38.339455    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:38.545700 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:38.545651    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:38.745029 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:38.744999    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:39.291431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:39.291394    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:39.842484 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:39.842451    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:40.001382 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:40.001350    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:40.092466 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:40.092431    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:40.818181 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:40.818084    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:41.591374 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:41.591344    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:41.691736 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:41.691704    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:41.821516 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:41.821486    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:42.153539 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.153510    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:42.225757 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.225724    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:42.268409 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.268368    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"]
Sep 15 11:50:42.271495 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.271479    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"
Sep 15 11:50:42.274044 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.274023    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-1b147a-dockercfg-9dw82\""
Sep 15 11:50:42.274185 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.274075    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-1b147a\""
Sep 15 11:50:42.283141 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.283117    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"]
Sep 15 11:50:42.288731 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.288707    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"]
Sep 15 11:50:42.291119 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.291104    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"
Sep 15 11:50:42.302545 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.302525    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"]
Sep 15 11:50:42.378045 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.378011    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c3b9d7b-c822-4195-a180-1060cf837f29-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt\" (UID: \"6c3b9d7b-c822-4195-a180-1060cf837f29\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"
Sep 15 11:50:42.378240 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.378051    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r9jp\" (UniqueName: \"kubernetes.io/projected/4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a-kube-api-access-9r9jp\") pod \"payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht\" (UID: \"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"
Sep 15 11:50:42.378240 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.378195    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qnxt\" (UniqueName: \"kubernetes.io/projected/6c3b9d7b-c822-4195-a180-1060cf837f29-kube-api-access-7qnxt\") pod \"payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt\" (UID: \"6c3b9d7b-c822-4195-a180-1060cf837f29\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"
Sep 15 11:50:42.378333 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.378307    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht\" (UID: \"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"
Sep 15 11:50:42.479934 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.479890    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qnxt\" (UniqueName: \"kubernetes.io/projected/6c3b9d7b-c822-4195-a180-1060cf837f29-kube-api-access-7qnxt\") pod \"payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt\" (UID: \"6c3b9d7b-c822-4195-a180-1060cf837f29\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"
Sep 15 11:50:42.480143 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.479991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht\" (UID: \"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"
Sep 15 11:50:42.480143 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.480112    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c3b9d7b-c822-4195-a180-1060cf837f29-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt\" (UID: \"6c3b9d7b-c822-4195-a180-1060cf837f29\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"
Sep 15 11:50:42.480143 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.480139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r9jp\" (UniqueName: \"kubernetes.io/projected/4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a-kube-api-access-9r9jp\") pod \"payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht\" (UID: \"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"
Sep 15 11:50:42.480871 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.480847    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht\" (UID: \"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"
Sep 15 11:50:42.480965 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.480910    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c3b9d7b-c822-4195-a180-1060cf837f29-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt\" (UID: \"6c3b9d7b-c822-4195-a180-1060cf837f29\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"
Sep 15 11:50:42.496935 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.496905    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r9jp\" (UniqueName: \"kubernetes.io/projected/4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a-kube-api-access-9r9jp\") pod \"payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht\" (UID: \"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"
Sep 15 11:50:42.496935 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.496931    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qnxt\" (UniqueName: \"kubernetes.io/projected/6c3b9d7b-c822-4195-a180-1060cf837f29-kube-api-access-7qnxt\") pod \"payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt\" (UID: \"6c3b9d7b-c822-4195-a180-1060cf837f29\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"
Sep 15 11:50:42.582460 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.582425    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"
Sep 15 11:50:42.602649 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.602621    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"
Sep 15 11:50:42.606861 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.606830    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:42.861610 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.861584    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"]
Sep 15 11:50:42.864083 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:50:42.864053    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3b9d7b_c822_4195_a180_1060cf837f29.slice/crio-4d03fd0c9bb0105308fab8a1d4b2bd112060ac4e25e09781c77726d2326f36d7 WatchSource:0}: Error finding container 4d03fd0c9bb0105308fab8a1d4b2bd112060ac4e25e09781c77726d2326f36d7: Status 404 returned error can't find the container with id 4d03fd0c9bb0105308fab8a1d4b2bd112060ac4e25e09781c77726d2326f36d7
Sep 15 11:50:42.896897 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:42.896870    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"]
Sep 15 11:50:42.898545 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:50:42.898519    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7d0f1e_b5a1_4bba_b93a_9f7251abfa6a.slice/crio-8da4460d3b9979ce91d46b849d2725aab93b8f95c50415034a731e512716406f WatchSource:0}: Error finding container 8da4460d3b9979ce91d46b849d2725aab93b8f95c50415034a731e512716406f: Status 404 returned error can't find the container with id 8da4460d3b9979ce91d46b849d2725aab93b8f95c50415034a731e512716406f
Sep 15 11:50:43.299749 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:43.299720    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:43.549905 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:43.549810    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt" event={"ID":"6c3b9d7b-c822-4195-a180-1060cf837f29","Type":"ContainerStarted","Data":"3140d24b806b0c59c0a6f049320a12d795e070d20e4bdf9c29b08bfacfa0b517"}
Sep 15 11:50:43.549905 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:43.549879    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"
Sep 15 11:50:43.550122 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:43.549918    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt" event={"ID":"6c3b9d7b-c822-4195-a180-1060cf837f29","Type":"ContainerStarted","Data":"4d03fd0c9bb0105308fab8a1d4b2bd112060ac4e25e09781c77726d2326f36d7"}
Sep 15 11:50:43.551408 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:43.551386    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht" event={"ID":"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a","Type":"ContainerStarted","Data":"ff1f572d59cca8720b5ee2d312448a0e574283d38b4fda0b02ff1f6d34e2159b"}
Sep 15 11:50:43.551519 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:43.551426    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht" event={"ID":"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a","Type":"ContainerStarted","Data":"8da4460d3b9979ce91d46b849d2725aab93b8f95c50415034a731e512716406f"}
Sep 15 11:50:43.551519 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:43.551445    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"
Sep 15 11:50:43.565361 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:43.565311    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt" podStartSLOduration=1.565291999 podStartE2EDuration="1.565291999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:43.565211875 +0000 UTC m=+805.816768937" watchObservedRunningTime="2026-09-15 11:50:43.565291999 +0000 UTC m=+805.816849056"
Sep 15 11:50:43.583324 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:43.583276    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht" podStartSLOduration=1.583262679 podStartE2EDuration="1.583262679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:43.58047681 +0000 UTC m=+805.832033859" watchObservedRunningTime="2026-09-15 11:50:43.583262679 +0000 UTC m=+805.834819736"
Sep 15 11:50:43.931443 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:43.931366    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:44.703430 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:44.703399    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:50.293741 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:50.293705    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:50.824266 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:50.824231    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"]
Sep 15 11:50:50.824580 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:50.824551    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9" podUID="c888ff3f-2a97-4953-a5d3-68234cad4578" containerName="maas-api" containerID="cri-o://d34d8e97964ebb12e8b277f75764561c63a3295a7517be80c866eb8d5c54722f" gracePeriod=30
Sep 15 11:50:50.853594 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:50.853563    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:50.923108 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:50.923053    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:50.983672 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:50.983642    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:51.052858 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.052823    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:51.085384 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.085329    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:51.217418 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.217381    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:51.269131 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.269099    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c888ff3f-2a97-4953-a5d3-68234cad4578-openshift-service-ca\") pod \"c888ff3f-2a97-4953-a5d3-68234cad4578\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") "
Sep 15 11:50:51.269308 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.269165    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85q4f\" (UniqueName: \"kubernetes.io/projected/c888ff3f-2a97-4953-a5d3-68234cad4578-kube-api-access-85q4f\") pod \"c888ff3f-2a97-4953-a5d3-68234cad4578\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") "
Sep 15 11:50:51.269308 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.269211    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-metrics-certs\") pod \"c888ff3f-2a97-4953-a5d3-68234cad4578\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") "
Sep 15 11:50:51.269308 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.269245    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-maas-api-tls\") pod \"c888ff3f-2a97-4953-a5d3-68234cad4578\" (UID: \"c888ff3f-2a97-4953-a5d3-68234cad4578\") "
Sep 15 11:50:51.269529 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.269503    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c888ff3f-2a97-4953-a5d3-68234cad4578-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c888ff3f-2a97-4953-a5d3-68234cad4578" (UID: "c888ff3f-2a97-4953-a5d3-68234cad4578"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:50:51.269686 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.269668    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c888ff3f-2a97-4953-a5d3-68234cad4578-openshift-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:50:51.271397 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.271366    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c888ff3f-2a97-4953-a5d3-68234cad4578" (UID: "c888ff3f-2a97-4953-a5d3-68234cad4578"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:50:51.271491 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.271396    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c888ff3f-2a97-4953-a5d3-68234cad4578" (UID: "c888ff3f-2a97-4953-a5d3-68234cad4578"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:50:51.271491 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.271437    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c888ff3f-2a97-4953-a5d3-68234cad4578-kube-api-access-85q4f" (OuterVolumeSpecName: "kube-api-access-85q4f") pod "c888ff3f-2a97-4953-a5d3-68234cad4578" (UID: "c888ff3f-2a97-4953-a5d3-68234cad4578"). InnerVolumeSpecName "kube-api-access-85q4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:50:51.371227 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.371084    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85q4f\" (UniqueName: \"kubernetes.io/projected/c888ff3f-2a97-4953-a5d3-68234cad4578-kube-api-access-85q4f\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:50:51.371227 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.371108    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:50:51.371227 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.371118    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c888ff3f-2a97-4953-a5d3-68234cad4578-maas-api-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:50:51.536634 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.536598    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:51.596940 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.596908    2571 generic.go:356] "Generic (PLEG): container finished" podID="c888ff3f-2a97-4953-a5d3-68234cad4578" containerID="d34d8e97964ebb12e8b277f75764561c63a3295a7517be80c866eb8d5c54722f" exitCode=0
Sep 15 11:50:51.597142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.596952    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"
Sep 15 11:50:51.597142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.596974    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9" event={"ID":"c888ff3f-2a97-4953-a5d3-68234cad4578","Type":"ContainerDied","Data":"d34d8e97964ebb12e8b277f75764561c63a3295a7517be80c866eb8d5c54722f"}
Sep 15 11:50:51.597142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.597013    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9" event={"ID":"c888ff3f-2a97-4953-a5d3-68234cad4578","Type":"ContainerDied","Data":"5a095a5385f92ce3692d7648dcd154fbcd83dde3890b9e1bb75fd1f74a922762"}
Sep 15 11:50:51.597142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.597036    2571 scope.go:117] "RemoveContainer" containerID="d34d8e97964ebb12e8b277f75764561c63a3295a7517be80c866eb8d5c54722f"
Sep 15 11:50:51.608000 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.607976    2571 scope.go:117] "RemoveContainer" containerID="d34d8e97964ebb12e8b277f75764561c63a3295a7517be80c866eb8d5c54722f"
Sep 15 11:50:51.608348 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:50:51.608320    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d34d8e97964ebb12e8b277f75764561c63a3295a7517be80c866eb8d5c54722f\": container with ID starting with d34d8e97964ebb12e8b277f75764561c63a3295a7517be80c866eb8d5c54722f not found: ID does not exist" containerID="d34d8e97964ebb12e8b277f75764561c63a3295a7517be80c866eb8d5c54722f"
Sep 15 11:50:51.608451 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.608360    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d34d8e97964ebb12e8b277f75764561c63a3295a7517be80c866eb8d5c54722f"} err="failed to get container status \"d34d8e97964ebb12e8b277f75764561c63a3295a7517be80c866eb8d5c54722f\": rpc error: code = NotFound desc = could not find container \"d34d8e97964ebb12e8b277f75764561c63a3295a7517be80c866eb8d5c54722f\": container with ID starting with d34d8e97964ebb12e8b277f75764561c63a3295a7517be80c866eb8d5c54722f not found: ID does not exist"
Sep 15 11:50:51.619679 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.619658    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"]
Sep 15 11:50:51.623380 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.623327    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ee96ca62-5656d9b9c-rx8m9"]
Sep 15 11:50:51.858421 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.858381    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:51.932410 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:51.932336    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:52.108537 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:52.108504    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:52.215833 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:52.215798    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c888ff3f-2a97-4953-a5d3-68234cad4578" path="/var/lib/kubelet/pods/c888ff3f-2a97-4953-a5d3-68234cad4578/volumes"
Sep 15 11:50:52.304059 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:52.304020    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:52.527765 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:52.527683    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:52.971209 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:52.971175    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:53.479331 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:53.479296    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:53.693290 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:53.693254    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:54.346765 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:54.346737    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:54.558444 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:54.558405    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"
Sep 15 11:50:54.558646 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:54.558632    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"
Sep 15 11:50:54.879049 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:54.879014    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:54.979488 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:54.979445    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:55.395756 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:55.395708    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:55.624715 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:55.624682    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:55.868722 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:55.868679    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:56.588073 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:56.588039    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:57.289864 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:57.289833    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:57.390094 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:57.390064    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:57.988010 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:57.987976    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"]
Sep 15 11:50:57.988672 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:57.988651    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c888ff3f-2a97-4953-a5d3-68234cad4578" containerName="maas-api"
Sep 15 11:50:57.988777 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:57.988684    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c888ff3f-2a97-4953-a5d3-68234cad4578" containerName="maas-api"
Sep 15 11:50:57.988866 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:57.988852    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c888ff3f-2a97-4953-a5d3-68234cad4578" containerName="maas-api"
Sep 15 11:50:57.993412 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:57.993390    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"
Sep 15 11:50:57.996076 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:57.996055    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-c353d682\""
Sep 15 11:50:57.996207 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:57.996190    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-c353d682-dockercfg-qwgnb\""
Sep 15 11:50:58.002136 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:58.002117    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"]
Sep 15 11:50:58.040583 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:58.040554    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfxb7\" (UniqueName: \"kubernetes.io/projected/d7464deb-27d5-4134-ada8-b359f390209d-kube-api-access-wfxb7\") pod \"payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69\" (UID: \"d7464deb-27d5-4134-ada8-b359f390209d\") " pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"
Sep 15 11:50:58.040724 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:58.040621    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7464deb-27d5-4134-ada8-b359f390209d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69\" (UID: \"d7464deb-27d5-4134-ada8-b359f390209d\") " pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"
Sep 15 11:50:58.081471 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:58.081444    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:58.141974 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:58.141942    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfxb7\" (UniqueName: \"kubernetes.io/projected/d7464deb-27d5-4134-ada8-b359f390209d-kube-api-access-wfxb7\") pod \"payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69\" (UID: \"d7464deb-27d5-4134-ada8-b359f390209d\") " pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"
Sep 15 11:50:58.142183 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:58.142100    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7464deb-27d5-4134-ada8-b359f390209d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69\" (UID: \"d7464deb-27d5-4134-ada8-b359f390209d\") " pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"
Sep 15 11:50:58.143023 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:58.143000    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7464deb-27d5-4134-ada8-b359f390209d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69\" (UID: \"d7464deb-27d5-4134-ada8-b359f390209d\") " pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"
Sep 15 11:50:58.150093 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:58.150067    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfxb7\" (UniqueName: \"kubernetes.io/projected/d7464deb-27d5-4134-ada8-b359f390209d-kube-api-access-wfxb7\") pod \"payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69\" (UID: \"d7464deb-27d5-4134-ada8-b359f390209d\") " pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"
Sep 15 11:50:58.181491 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:58.181459    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:50:58.305679 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:58.305593    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"
Sep 15 11:50:58.580760 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:58.580729    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"]
Sep 15 11:50:58.582420 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:50:58.582394    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7464deb_27d5_4134_ada8_b359f390209d.slice/crio-da8bc02fdac6c541903e75e02641e6b00ed24b50b324642e3f5d2c73995e6a51 WatchSource:0}: Error finding container da8bc02fdac6c541903e75e02641e6b00ed24b50b324642e3f5d2c73995e6a51: Status 404 returned error can't find the container with id da8bc02fdac6c541903e75e02641e6b00ed24b50b324642e3f5d2c73995e6a51
Sep 15 11:50:58.645134 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:58.645104    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69" event={"ID":"d7464deb-27d5-4134-ada8-b359f390209d","Type":"ContainerStarted","Data":"da8bc02fdac6c541903e75e02641e6b00ed24b50b324642e3f5d2c73995e6a51"}
Sep 15 11:50:59.651964 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:59.651930    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69" event={"ID":"d7464deb-27d5-4134-ada8-b359f390209d","Type":"ContainerStarted","Data":"440bfc52f73a52dd7decec716a2c4eeda22f0aeea2f3175ac92b9ea429fbd65b"}
Sep 15 11:50:59.652421 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:59.651990    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"
Sep 15 11:50:59.668342 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:50:59.668285    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69" podStartSLOduration=2.668266477 podStartE2EDuration="2.668266477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:50:59.667901281 +0000 UTC m=+821.919458338" watchObservedRunningTime="2026-09-15 11:50:59.668266477 +0000 UTC m=+821.919823536"
Sep 15 11:51:02.629728 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:02.629693    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:10.660143 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:10.660110    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"
Sep 15 11:51:15.040896 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:15.040860    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:18.914900 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:18.914833    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:20.314298 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:20.314252    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:20.509335 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:20.509300    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:21.325999 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:21.325965    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:21.948249 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:21.948216    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:22.705554 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:22.705515    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:23.317484 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:23.317452    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:26.529793 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:26.529734    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:27.281687 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.281654    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"]
Sep 15 11:51:27.281981 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.281889    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69" podUID="d7464deb-27d5-4134-ada8-b359f390209d" containerName="payload-processing" containerID="cri-o://440bfc52f73a52dd7decec716a2c4eeda22f0aeea2f3175ac92b9ea429fbd65b" gracePeriod=30
Sep 15 11:51:27.287881 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.287565    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:27.348797 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.348764    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:27.448693 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.448445    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:27.515258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.515221    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:27.543278 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.543226    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"
Sep 15 11:51:27.627808 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.627769    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:27.636945 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.636917    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7464deb-27d5-4134-ada8-b359f390209d-plugins-config-volume\") pod \"d7464deb-27d5-4134-ada8-b359f390209d\" (UID: \"d7464deb-27d5-4134-ada8-b359f390209d\") "
Sep 15 11:51:27.637074 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.637030    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfxb7\" (UniqueName: \"kubernetes.io/projected/d7464deb-27d5-4134-ada8-b359f390209d-kube-api-access-wfxb7\") pod \"d7464deb-27d5-4134-ada8-b359f390209d\" (UID: \"d7464deb-27d5-4134-ada8-b359f390209d\") "
Sep 15 11:51:27.637280 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.637262    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7464deb-27d5-4134-ada8-b359f390209d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d7464deb-27d5-4134-ada8-b359f390209d" (UID: "d7464deb-27d5-4134-ada8-b359f390209d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:51:27.637346 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.637330    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7464deb-27d5-4134-ada8-b359f390209d-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:51:27.639028 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.638995    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7464deb-27d5-4134-ada8-b359f390209d-kube-api-access-wfxb7" (OuterVolumeSpecName: "kube-api-access-wfxb7") pod "d7464deb-27d5-4134-ada8-b359f390209d" (UID: "d7464deb-27d5-4134-ada8-b359f390209d"). InnerVolumeSpecName "kube-api-access-wfxb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:51:27.738575 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.738538    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfxb7\" (UniqueName: \"kubernetes.io/projected/d7464deb-27d5-4134-ada8-b359f390209d-kube-api-access-wfxb7\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:51:27.819249 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.819133    2571 generic.go:356] "Generic (PLEG): container finished" podID="d7464deb-27d5-4134-ada8-b359f390209d" containerID="440bfc52f73a52dd7decec716a2c4eeda22f0aeea2f3175ac92b9ea429fbd65b" exitCode=0
Sep 15 11:51:27.819249 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.819187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69" event={"ID":"d7464deb-27d5-4134-ada8-b359f390209d","Type":"ContainerDied","Data":"440bfc52f73a52dd7decec716a2c4eeda22f0aeea2f3175ac92b9ea429fbd65b"}
Sep 15 11:51:27.819249 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.819251    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69" event={"ID":"d7464deb-27d5-4134-ada8-b359f390209d","Type":"ContainerDied","Data":"da8bc02fdac6c541903e75e02641e6b00ed24b50b324642e3f5d2c73995e6a51"}
Sep 15 11:51:27.819537 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.819278    2571 scope.go:117] "RemoveContainer" containerID="440bfc52f73a52dd7decec716a2c4eeda22f0aeea2f3175ac92b9ea429fbd65b"
Sep 15 11:51:27.819537 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.819199    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"
Sep 15 11:51:27.829214 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.829188    2571 scope.go:117] "RemoveContainer" containerID="440bfc52f73a52dd7decec716a2c4eeda22f0aeea2f3175ac92b9ea429fbd65b"
Sep 15 11:51:27.829499 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:51:27.829477    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"440bfc52f73a52dd7decec716a2c4eeda22f0aeea2f3175ac92b9ea429fbd65b\": container with ID starting with 440bfc52f73a52dd7decec716a2c4eeda22f0aeea2f3175ac92b9ea429fbd65b not found: ID does not exist" containerID="440bfc52f73a52dd7decec716a2c4eeda22f0aeea2f3175ac92b9ea429fbd65b"
Sep 15 11:51:27.829624 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.829512    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"440bfc52f73a52dd7decec716a2c4eeda22f0aeea2f3175ac92b9ea429fbd65b"} err="failed to get container status \"440bfc52f73a52dd7decec716a2c4eeda22f0aeea2f3175ac92b9ea429fbd65b\": rpc error: code = NotFound desc = could not find container \"440bfc52f73a52dd7decec716a2c4eeda22f0aeea2f3175ac92b9ea429fbd65b\": container with ID starting with 440bfc52f73a52dd7decec716a2c4eeda22f0aeea2f3175ac92b9ea429fbd65b not found: ID does not exist"
Sep 15 11:51:27.841723 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.841701    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"]
Sep 15 11:51:27.847329 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.847306    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c353d682-7bbcfc6686-xsj69"]
Sep 15 11:51:27.898449 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:27.898419    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:28.215865 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:28.215823    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7464deb-27d5-4134-ada8-b359f390209d" path="/var/lib/kubelet/pods/d7464deb-27d5-4134-ada8-b359f390209d/volumes"
Sep 15 11:51:28.329671 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:28.329636    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:28.469888 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:28.469777    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:28.563099 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:28.563064    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:28.811314 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:28.811226    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:29.382693 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:29.382665    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:29.541566 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:29.541539    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:30.805352 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:30.805318    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:31.384661 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:31.384625    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:31.642173 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:31.642064    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:31.801442 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:31.801411    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:32.329056 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:32.329022    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:33.207511 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:33.207462    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:33.276846 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:33.276815    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:33.653702 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:33.653608    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:33.752495 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:33.752455    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:33.832585 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:33.832551    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:49.610354 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:49.610318    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:55.201495 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:55.201446    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:55.912911 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:55.912875    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:56.544899 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:56.544862    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:57.291837 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:57.291805    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:51:58.312678 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:51:58.312649    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:01.198719 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:01.198682    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:01.912573 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:01.912534    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:02.760428 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:02.760394    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:03.608845 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:03.608809    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:13.123183 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:13.123087    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:15.164935 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:15.164904    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:15.266143 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:15.266047    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:15.591536 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:15.591449    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:15.701321 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:15.701288    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:16.063253 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:16.063226    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:16.503145 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:16.503110    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:18.205125 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:18.205099    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 11:52:18.205540 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:18.205099    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 11:52:18.350620 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:18.350589    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:19.035787 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:19.035742    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:19.133439 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:19.133405    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:19.235660 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:19.235617    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:19.334771 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:19.334691    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:20.039487 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:20.039453    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:21.082817 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.082780    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:21.178997 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.178964    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:21.516095 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.516058    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:21.643249 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.643218    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:21.762059 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.762019    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:21.936107 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.936029    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"]
Sep 15 11:52:21.936523 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.936509    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7464deb-27d5-4134-ada8-b359f390209d" containerName="payload-processing"
Sep 15 11:52:21.936574 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.936524    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7464deb-27d5-4134-ada8-b359f390209d" containerName="payload-processing"
Sep 15 11:52:21.936618 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.936588    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7464deb-27d5-4134-ada8-b359f390209d" containerName="payload-processing"
Sep 15 11:52:21.940910 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.940894    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"
Sep 15 11:52:21.943797 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.943777    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-f6336aa2-dockercfg-47wwp\""
Sep 15 11:52:21.943911 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.943815    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-f6336aa2\""
Sep 15 11:52:21.953349 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.953327    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"]
Sep 15 11:52:21.982571 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.982545    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr69w\" (UniqueName: \"kubernetes.io/projected/8d707d2e-af0c-4013-855c-59be0ee8e833-kube-api-access-wr69w\") pod \"payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz\" (UID: \"8d707d2e-af0c-4013-855c-59be0ee8e833\") " pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"
Sep 15 11:52:21.982711 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:21.982647    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d707d2e-af0c-4013-855c-59be0ee8e833-plugins-config-volume\") pod \"payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz\" (UID: \"8d707d2e-af0c-4013-855c-59be0ee8e833\") " pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"
Sep 15 11:52:22.083972 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:22.083921    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr69w\" (UniqueName: \"kubernetes.io/projected/8d707d2e-af0c-4013-855c-59be0ee8e833-kube-api-access-wr69w\") pod \"payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz\" (UID: \"8d707d2e-af0c-4013-855c-59be0ee8e833\") " pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"
Sep 15 11:52:22.084424 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:22.083993    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d707d2e-af0c-4013-855c-59be0ee8e833-plugins-config-volume\") pod \"payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz\" (UID: \"8d707d2e-af0c-4013-855c-59be0ee8e833\") " pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"
Sep 15 11:52:22.084674 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:22.084653    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d707d2e-af0c-4013-855c-59be0ee8e833-plugins-config-volume\") pod \"payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz\" (UID: \"8d707d2e-af0c-4013-855c-59be0ee8e833\") " pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"
Sep 15 11:52:22.098383 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:22.098352    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr69w\" (UniqueName: \"kubernetes.io/projected/8d707d2e-af0c-4013-855c-59be0ee8e833-kube-api-access-wr69w\") pod \"payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz\" (UID: \"8d707d2e-af0c-4013-855c-59be0ee8e833\") " pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"
Sep 15 11:52:22.251872 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:22.251841    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"
Sep 15 11:52:22.535831 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:22.535800    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"]
Sep 15 11:52:22.536305 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:52:22.536277    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d707d2e_af0c_4013_855c_59be0ee8e833.slice/crio-5376cabd93aa8302f95f1596443f5bd6b8184d8827ac738c3c8b0f30cc58e2c2 WatchSource:0}: Error finding container 5376cabd93aa8302f95f1596443f5bd6b8184d8827ac738c3c8b0f30cc58e2c2: Status 404 returned error can't find the container with id 5376cabd93aa8302f95f1596443f5bd6b8184d8827ac738c3c8b0f30cc58e2c2
Sep 15 11:52:23.138523 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:23.138483    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz" event={"ID":"8d707d2e-af0c-4013-855c-59be0ee8e833","Type":"ContainerStarted","Data":"809638215df5087d10f0275e90462a3a8309d8ea423aac7f0c7e0009706c50e6"}
Sep 15 11:52:23.138921 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:23.138543    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz" event={"ID":"8d707d2e-af0c-4013-855c-59be0ee8e833","Type":"ContainerStarted","Data":"5376cabd93aa8302f95f1596443f5bd6b8184d8827ac738c3c8b0f30cc58e2c2"}
Sep 15 11:52:23.138921 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:23.138585    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"
Sep 15 11:52:23.162564 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:23.162515    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz" podStartSLOduration=2.162499986 podStartE2EDuration="2.162499986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:52:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:52:23.159482967 +0000 UTC m=+905.411040023" watchObservedRunningTime="2026-09-15 11:52:23.162499986 +0000 UTC m=+905.414057043"
Sep 15 11:52:34.147071 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:34.147039    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"
Sep 15 11:52:43.318473 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:43.318442    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:44.030149 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:44.030111    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:44.594305 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:44.594272    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:45.419406 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:45.419375    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:46.322978 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:46.322936    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:46.953298 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:46.953257    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:47.765573 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:47.765533    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:48.720536 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:48.720500    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:50.599015 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:50.598979    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:51.430519 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.430483    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:51.453579 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.453547    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"]
Sep 15 11:52:51.453778 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.453752    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz" podUID="8d707d2e-af0c-4013-855c-59be0ee8e833" containerName="payload-processing" containerID="cri-o://809638215df5087d10f0275e90462a3a8309d8ea423aac7f0c7e0009706c50e6" gracePeriod=30
Sep 15 11:52:51.531612 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.531585    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:51.687291 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.687265    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:51.703930 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.703906    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"
Sep 15 11:52:51.777766 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.777720    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr69w\" (UniqueName: \"kubernetes.io/projected/8d707d2e-af0c-4013-855c-59be0ee8e833-kube-api-access-wr69w\") pod \"8d707d2e-af0c-4013-855c-59be0ee8e833\" (UID: \"8d707d2e-af0c-4013-855c-59be0ee8e833\") "
Sep 15 11:52:51.777973 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.777806    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d707d2e-af0c-4013-855c-59be0ee8e833-plugins-config-volume\") pod \"8d707d2e-af0c-4013-855c-59be0ee8e833\" (UID: \"8d707d2e-af0c-4013-855c-59be0ee8e833\") "
Sep 15 11:52:51.778657 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.778568    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d707d2e-af0c-4013-855c-59be0ee8e833-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8d707d2e-af0c-4013-855c-59be0ee8e833" (UID: "8d707d2e-af0c-4013-855c-59be0ee8e833"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:52:51.780238 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.780209    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d707d2e-af0c-4013-855c-59be0ee8e833-kube-api-access-wr69w" (OuterVolumeSpecName: "kube-api-access-wr69w") pod "8d707d2e-af0c-4013-855c-59be0ee8e833" (UID: "8d707d2e-af0c-4013-855c-59be0ee8e833"). InnerVolumeSpecName "kube-api-access-wr69w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:52:51.792676 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.792653    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:51.878950 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.878915    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr69w\" (UniqueName: \"kubernetes.io/projected/8d707d2e-af0c-4013-855c-59be0ee8e833-kube-api-access-wr69w\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:52:51.878950 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.878947    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d707d2e-af0c-4013-855c-59be0ee8e833-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:52:51.919773 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:51.919732    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:52.299832 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:52.299796    2571 generic.go:356] "Generic (PLEG): container finished" podID="8d707d2e-af0c-4013-855c-59be0ee8e833" containerID="809638215df5087d10f0275e90462a3a8309d8ea423aac7f0c7e0009706c50e6" exitCode=0
Sep 15 11:52:52.300022 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:52.299843    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"
Sep 15 11:52:52.300022 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:52.299877    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz" event={"ID":"8d707d2e-af0c-4013-855c-59be0ee8e833","Type":"ContainerDied","Data":"809638215df5087d10f0275e90462a3a8309d8ea423aac7f0c7e0009706c50e6"}
Sep 15 11:52:52.300022 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:52.299933    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz" event={"ID":"8d707d2e-af0c-4013-855c-59be0ee8e833","Type":"ContainerDied","Data":"5376cabd93aa8302f95f1596443f5bd6b8184d8827ac738c3c8b0f30cc58e2c2"}
Sep 15 11:52:52.300022 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:52.299958    2571 scope.go:117] "RemoveContainer" containerID="809638215df5087d10f0275e90462a3a8309d8ea423aac7f0c7e0009706c50e6"
Sep 15 11:52:52.309203 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:52.309181    2571 scope.go:117] "RemoveContainer" containerID="809638215df5087d10f0275e90462a3a8309d8ea423aac7f0c7e0009706c50e6"
Sep 15 11:52:52.309505 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:52:52.309486    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"809638215df5087d10f0275e90462a3a8309d8ea423aac7f0c7e0009706c50e6\": container with ID starting with 809638215df5087d10f0275e90462a3a8309d8ea423aac7f0c7e0009706c50e6 not found: ID does not exist" containerID="809638215df5087d10f0275e90462a3a8309d8ea423aac7f0c7e0009706c50e6"
Sep 15 11:52:52.309552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:52.309514    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809638215df5087d10f0275e90462a3a8309d8ea423aac7f0c7e0009706c50e6"} err="failed to get container status \"809638215df5087d10f0275e90462a3a8309d8ea423aac7f0c7e0009706c50e6\": rpc error: code = NotFound desc = could not find container \"809638215df5087d10f0275e90462a3a8309d8ea423aac7f0c7e0009706c50e6\": container with ID starting with 809638215df5087d10f0275e90462a3a8309d8ea423aac7f0c7e0009706c50e6 not found: ID does not exist"
Sep 15 11:52:52.329939 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:52.329905    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"]
Sep 15 11:52:52.330103 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:52.329942    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:52.342527 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:52.342498    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f6336aa2-5787744f5c-sxbrz"]
Sep 15 11:52:52.823099 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:52.823062    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:53.102093 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:53.102009    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:54.124201 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:54.124147    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:54.214235 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:54.214200    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d707d2e-af0c-4013-855c-59be0ee8e833" path="/var/lib/kubelet/pods/8d707d2e-af0c-4013-855c-59be0ee8e833/volumes"
Sep 15 11:52:54.945704 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:54.945664    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:52:55.068677 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:52:55.068642    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:01.886053 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:01.886015    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:02.060649 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:02.060620    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:02.478009 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:02.477974    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:04.351415 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:04.351383    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:05.320751 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:05.320719    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:06.508379 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:06.508347    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:07.184555 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:07.184514    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:08.157761 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:08.157727    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:16.051076 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.051037    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"]
Sep 15 11:53:16.051533 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.051323    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp" podUID="d1a827e1-3177-4ac3-a07f-fbaed48d6a9e" containerName="maas-api" containerID="cri-o://85dd3ae6daa22bcdfb7927587ec92429f974474bfeda06f40dd0d68596edafe8" gracePeriod=30
Sep 15 11:53:16.089600 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.089563    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:16.121100 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.121067    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"]
Sep 15 11:53:16.121318 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.121295    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf" podUID="cc017203-aeca-4090-af25-657ae66ab10e" containerName="payload-processing" containerID="cri-o://04c670f8fc6a011f7e8de425b3cf80aea3402f0a2a133ea448d0dc62c8c47701" gracePeriod=30
Sep 15 11:53:16.128521 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.128487    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"]
Sep 15 11:53:16.128749 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.128718    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf" podUID="2d814eab-685c-4bd9-aefd-c5efeff1a5e6" containerName="payload-pre-processing" containerID="cri-o://27f485b3d97e431847d59d9155a025ee8c6f92988d0ef4024adf4fd6fbc0f2d5" gracePeriod=30
Sep 15 11:53:16.168397 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.168363    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:16.290185 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.290122    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:16.368376 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.368262    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:16.416019 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.415985    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"
Sep 15 11:53:16.436333 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.436203    2571 generic.go:356] "Generic (PLEG): container finished" podID="2d814eab-685c-4bd9-aefd-c5efeff1a5e6" containerID="27f485b3d97e431847d59d9155a025ee8c6f92988d0ef4024adf4fd6fbc0f2d5" exitCode=0
Sep 15 11:53:16.436333 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.436277    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf" event={"ID":"2d814eab-685c-4bd9-aefd-c5efeff1a5e6","Type":"ContainerDied","Data":"27f485b3d97e431847d59d9155a025ee8c6f92988d0ef4024adf4fd6fbc0f2d5"}
Sep 15 11:53:16.438366 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.438341    2571 generic.go:356] "Generic (PLEG): container finished" podID="d1a827e1-3177-4ac3-a07f-fbaed48d6a9e" containerID="85dd3ae6daa22bcdfb7927587ec92429f974474bfeda06f40dd0d68596edafe8" exitCode=0
Sep 15 11:53:16.438493 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.438420    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp" event={"ID":"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e","Type":"ContainerDied","Data":"85dd3ae6daa22bcdfb7927587ec92429f974474bfeda06f40dd0d68596edafe8"}
Sep 15 11:53:16.439746 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.439701    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxbnx\" (UniqueName: \"kubernetes.io/projected/cc017203-aeca-4090-af25-657ae66ab10e-kube-api-access-jxbnx\") pod \"cc017203-aeca-4090-af25-657ae66ab10e\" (UID: \"cc017203-aeca-4090-af25-657ae66ab10e\") "
Sep 15 11:53:16.439867 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.439773    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc017203-aeca-4090-af25-657ae66ab10e-plugins-config-volume\") pod \"cc017203-aeca-4090-af25-657ae66ab10e\" (UID: \"cc017203-aeca-4090-af25-657ae66ab10e\") "
Sep 15 11:53:16.446567 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.440580    2571 generic.go:356] "Generic (PLEG): container finished" podID="cc017203-aeca-4090-af25-657ae66ab10e" containerID="04c670f8fc6a011f7e8de425b3cf80aea3402f0a2a133ea448d0dc62c8c47701" exitCode=0
Sep 15 11:53:16.446567 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.440721    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"
Sep 15 11:53:16.446567 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.440807    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf" event={"ID":"cc017203-aeca-4090-af25-657ae66ab10e","Type":"ContainerDied","Data":"04c670f8fc6a011f7e8de425b3cf80aea3402f0a2a133ea448d0dc62c8c47701"}
Sep 15 11:53:16.446567 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.440852    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf" event={"ID":"cc017203-aeca-4090-af25-657ae66ab10e","Type":"ContainerDied","Data":"7d3e8190b2f204a03f7769ce3278b7d5375eebe60c4d8a7b8f809fb0fede91f6"}
Sep 15 11:53:16.446567 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.440881    2571 scope.go:117] "RemoveContainer" containerID="04c670f8fc6a011f7e8de425b3cf80aea3402f0a2a133ea448d0dc62c8c47701"
Sep 15 11:53:16.446567 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.442838    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc017203-aeca-4090-af25-657ae66ab10e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc017203-aeca-4090-af25-657ae66ab10e" (UID: "cc017203-aeca-4090-af25-657ae66ab10e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:53:16.449079 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.448201    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc017203-aeca-4090-af25-657ae66ab10e-kube-api-access-jxbnx" (OuterVolumeSpecName: "kube-api-access-jxbnx") pod "cc017203-aeca-4090-af25-657ae66ab10e" (UID: "cc017203-aeca-4090-af25-657ae66ab10e"). InnerVolumeSpecName "kube-api-access-jxbnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:16.466740 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.466514    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"
Sep 15 11:53:16.472761 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.472474    2571 scope.go:117] "RemoveContainer" containerID="04c670f8fc6a011f7e8de425b3cf80aea3402f0a2a133ea448d0dc62c8c47701"
Sep 15 11:53:16.473436 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:53:16.473408    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04c670f8fc6a011f7e8de425b3cf80aea3402f0a2a133ea448d0dc62c8c47701\": container with ID starting with 04c670f8fc6a011f7e8de425b3cf80aea3402f0a2a133ea448d0dc62c8c47701 not found: ID does not exist" containerID="04c670f8fc6a011f7e8de425b3cf80aea3402f0a2a133ea448d0dc62c8c47701"
Sep 15 11:53:16.473590 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.473450    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04c670f8fc6a011f7e8de425b3cf80aea3402f0a2a133ea448d0dc62c8c47701"} err="failed to get container status \"04c670f8fc6a011f7e8de425b3cf80aea3402f0a2a133ea448d0dc62c8c47701\": rpc error: code = NotFound desc = could not find container \"04c670f8fc6a011f7e8de425b3cf80aea3402f0a2a133ea448d0dc62c8c47701\": container with ID starting with 04c670f8fc6a011f7e8de425b3cf80aea3402f0a2a133ea448d0dc62c8c47701 not found: ID does not exist"
Sep 15 11:53:16.541626 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.541593    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5576h\" (UniqueName: \"kubernetes.io/projected/2d814eab-685c-4bd9-aefd-c5efeff1a5e6-kube-api-access-5576h\") pod \"2d814eab-685c-4bd9-aefd-c5efeff1a5e6\" (UID: \"2d814eab-685c-4bd9-aefd-c5efeff1a5e6\") "
Sep 15 11:53:16.541790 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.541644    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d814eab-685c-4bd9-aefd-c5efeff1a5e6-plugins-config-volume\") pod \"2d814eab-685c-4bd9-aefd-c5efeff1a5e6\" (UID: \"2d814eab-685c-4bd9-aefd-c5efeff1a5e6\") "
Sep 15 11:53:16.542014 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.541986    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxbnx\" (UniqueName: \"kubernetes.io/projected/cc017203-aeca-4090-af25-657ae66ab10e-kube-api-access-jxbnx\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:16.542108 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.542015    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc017203-aeca-4090-af25-657ae66ab10e-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:16.542108 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.542081    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d814eab-685c-4bd9-aefd-c5efeff1a5e6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d814eab-685c-4bd9-aefd-c5efeff1a5e6" (UID: "2d814eab-685c-4bd9-aefd-c5efeff1a5e6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:53:16.543900 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.543874    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d814eab-685c-4bd9-aefd-c5efeff1a5e6-kube-api-access-5576h" (OuterVolumeSpecName: "kube-api-access-5576h") pod "2d814eab-685c-4bd9-aefd-c5efeff1a5e6" (UID: "2d814eab-685c-4bd9-aefd-c5efeff1a5e6"). InnerVolumeSpecName "kube-api-access-5576h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:16.546951 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.546934    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:53:16.642612 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.642518    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-maas-api-tls\") pod \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") "
Sep 15 11:53:16.642612 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.642594    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb6wc\" (UniqueName: \"kubernetes.io/projected/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-kube-api-access-nb6wc\") pod \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") "
Sep 15 11:53:16.642612 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.642614    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-metrics-certs\") pod \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") "
Sep 15 11:53:16.642884 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.642651    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-openshift-service-ca\") pod \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\" (UID: \"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e\") "
Sep 15 11:53:16.642978 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.642955    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5576h\" (UniqueName: \"kubernetes.io/projected/2d814eab-685c-4bd9-aefd-c5efeff1a5e6-kube-api-access-5576h\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:16.643044 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.642981    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d814eab-685c-4bd9-aefd-c5efeff1a5e6-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:16.643131 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.643107    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d1a827e1-3177-4ac3-a07f-fbaed48d6a9e" (UID: "d1a827e1-3177-4ac3-a07f-fbaed48d6a9e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:53:16.644741 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.644715    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d1a827e1-3177-4ac3-a07f-fbaed48d6a9e" (UID: "d1a827e1-3177-4ac3-a07f-fbaed48d6a9e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:53:16.644859 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.644757    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-kube-api-access-nb6wc" (OuterVolumeSpecName: "kube-api-access-nb6wc") pod "d1a827e1-3177-4ac3-a07f-fbaed48d6a9e" (UID: "d1a827e1-3177-4ac3-a07f-fbaed48d6a9e"). InnerVolumeSpecName "kube-api-access-nb6wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:16.645076 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.645052    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d1a827e1-3177-4ac3-a07f-fbaed48d6a9e" (UID: "d1a827e1-3177-4ac3-a07f-fbaed48d6a9e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:53:16.743629 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.743593    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-maas-api-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:16.743629 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.743627    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb6wc\" (UniqueName: \"kubernetes.io/projected/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-kube-api-access-nb6wc\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:16.743826 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.743639    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:16.743826 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.743652    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e-openshift-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:16.776695 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.776663    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"]
Sep 15 11:53:16.785821 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.785795    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-155ffe-8b846877c-f69zf"]
Sep 15 11:53:16.821781 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.821749    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:16.916953 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:16.916872    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:17.448408 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:17.448372    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"
Sep 15 11:53:17.448408 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:17.448391    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf" event={"ID":"2d814eab-685c-4bd9-aefd-c5efeff1a5e6","Type":"ContainerDied","Data":"98f9b7f0e7fadec1de837326570161406ef8a734625890a5c6edb5c116e40530"}
Sep 15 11:53:17.448943 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:17.448459    2571 scope.go:117] "RemoveContainer" containerID="27f485b3d97e431847d59d9155a025ee8c6f92988d0ef4024adf4fd6fbc0f2d5"
Sep 15 11:53:17.450176 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:17.450138    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"
Sep 15 11:53:17.450300 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:17.450194    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp" event={"ID":"d1a827e1-3177-4ac3-a07f-fbaed48d6a9e","Type":"ContainerDied","Data":"a5f71f6aba5a9841aa0003e7601ef493cac5368e815f32c3b7971cf7c06d3fd5"}
Sep 15 11:53:17.458285 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:17.458259    2571 scope.go:117] "RemoveContainer" containerID="85dd3ae6daa22bcdfb7927587ec92429f974474bfeda06f40dd0d68596edafe8"
Sep 15 11:53:17.484539 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:17.484507    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"]
Sep 15 11:53:17.490010 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:17.489981    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-155ffe-7d466d8674-xldmf"]
Sep 15 11:53:17.506881 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:17.506834    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"]
Sep 15 11:53:17.510006 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:17.509980    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-155ffe-856855b5df-srxrp"]
Sep 15 11:53:17.760257 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:17.760177    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:18.214837 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:18.214806    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d814eab-685c-4bd9-aefd-c5efeff1a5e6" path="/var/lib/kubelet/pods/2d814eab-685c-4bd9-aefd-c5efeff1a5e6/volumes"
Sep 15 11:53:18.215209 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:18.215195    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc017203-aeca-4090-af25-657ae66ab10e" path="/var/lib/kubelet/pods/cc017203-aeca-4090-af25-657ae66ab10e/volumes"
Sep 15 11:53:18.215547 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:18.215535    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1a827e1-3177-4ac3-a07f-fbaed48d6a9e" path="/var/lib/kubelet/pods/d1a827e1-3177-4ac3-a07f-fbaed48d6a9e/volumes"
Sep 15 11:53:23.663357 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:23.663320    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:23.764876 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:23.764842    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:23.932390 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:23.932312    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"]
Sep 15 11:53:23.932572 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:23.932544    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" containerName="istio-proxy" containerID="cri-o://6d292c5567d20f66d1ee2a75222d3dc8c88c5af2a4c245622bc62fa9dab12034" gracePeriod=30
Sep 15 11:53:23.950951 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:23.950927    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:25.230645 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:25.230609    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:25.914136 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:25.914106    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:28.457902 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:28.457868    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:29.201191 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.201116    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:53:29.265087 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.265052    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-workload-socket\") pod \"de74fa49-ba93-46c1-9267-f75eccec220b\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") "
Sep 15 11:53:29.265258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.265108    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-istio-data\") pod \"de74fa49-ba93-46c1-9267-f75eccec220b\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") "
Sep 15 11:53:29.265258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.265138    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de74fa49-ba93-46c1-9267-f75eccec220b-istio-token\") pod \"de74fa49-ba93-46c1-9267-f75eccec220b\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") "
Sep 15 11:53:29.265258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.265197    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-credential-socket\") pod \"de74fa49-ba93-46c1-9267-f75eccec220b\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") "
Sep 15 11:53:29.265414 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.265389    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5c7b\" (UniqueName: \"kubernetes.io/projected/de74fa49-ba93-46c1-9267-f75eccec220b-kube-api-access-n5c7b\") pod \"de74fa49-ba93-46c1-9267-f75eccec220b\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") "
Sep 15 11:53:29.265478 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.265453    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-workload-certs\") pod \"de74fa49-ba93-46c1-9267-f75eccec220b\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") "
Sep 15 11:53:29.265532 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.265372    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de74fa49-ba93-46c1-9267-f75eccec220b" (UID: "de74fa49-ba93-46c1-9267-f75eccec220b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:29.265532 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.265441    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-istio-data" (OuterVolumeSpecName: "istio-data") pod "de74fa49-ba93-46c1-9267-f75eccec220b" (UID: "de74fa49-ba93-46c1-9267-f75eccec220b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:29.265532 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.265506    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de74fa49-ba93-46c1-9267-f75eccec220b" (UID: "de74fa49-ba93-46c1-9267-f75eccec220b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:29.265532 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.265509    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-istio-envoy\") pod \"de74fa49-ba93-46c1-9267-f75eccec220b\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") "
Sep 15 11:53:29.265819 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.265643    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de74fa49-ba93-46c1-9267-f75eccec220b-istio-podinfo\") pod \"de74fa49-ba93-46c1-9267-f75eccec220b\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") "
Sep 15 11:53:29.265819 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.265682    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de74fa49-ba93-46c1-9267-f75eccec220b" (UID: "de74fa49-ba93-46c1-9267-f75eccec220b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:29.265819 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.265719    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de74fa49-ba93-46c1-9267-f75eccec220b-istiod-ca-cert\") pod \"de74fa49-ba93-46c1-9267-f75eccec220b\" (UID: \"de74fa49-ba93-46c1-9267-f75eccec220b\") "
Sep 15 11:53:29.266098 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.266072    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de74fa49-ba93-46c1-9267-f75eccec220b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de74fa49-ba93-46c1-9267-f75eccec220b" (UID: "de74fa49-ba93-46c1-9267-f75eccec220b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:53:29.266216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.266198    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-istio-data\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:29.266278 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.266223    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-credential-socket\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:29.266278 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.266239    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-workload-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:29.266278 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.266252    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-workload-socket\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:29.267599 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.267552    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de74fa49-ba93-46c1-9267-f75eccec220b-istio-token" (OuterVolumeSpecName: "istio-token") pod "de74fa49-ba93-46c1-9267-f75eccec220b" (UID: "de74fa49-ba93-46c1-9267-f75eccec220b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:29.267728 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.267704    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de74fa49-ba93-46c1-9267-f75eccec220b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de74fa49-ba93-46c1-9267-f75eccec220b" (UID: "de74fa49-ba93-46c1-9267-f75eccec220b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 11:53:29.267868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.267851    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de74fa49-ba93-46c1-9267-f75eccec220b-kube-api-access-n5c7b" (OuterVolumeSpecName: "kube-api-access-n5c7b") pod "de74fa49-ba93-46c1-9267-f75eccec220b" (UID: "de74fa49-ba93-46c1-9267-f75eccec220b"). InnerVolumeSpecName "kube-api-access-n5c7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:29.267960 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.267945    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de74fa49-ba93-46c1-9267-f75eccec220b" (UID: "de74fa49-ba93-46c1-9267-f75eccec220b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 11:53:29.366794 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.366766    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de74fa49-ba93-46c1-9267-f75eccec220b-istio-podinfo\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:29.366794 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.366790    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de74fa49-ba93-46c1-9267-f75eccec220b-istiod-ca-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:29.366794 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.366799    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de74fa49-ba93-46c1-9267-f75eccec220b-istio-token\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:29.366978 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.366807    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5c7b\" (UniqueName: \"kubernetes.io/projected/de74fa49-ba93-46c1-9267-f75eccec220b-kube-api-access-n5c7b\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:29.366978 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.366816    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de74fa49-ba93-46c1-9267-f75eccec220b-istio-envoy\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:29.516989 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.516902    2571 generic.go:356] "Generic (PLEG): container finished" podID="de74fa49-ba93-46c1-9267-f75eccec220b" containerID="6d292c5567d20f66d1ee2a75222d3dc8c88c5af2a4c245622bc62fa9dab12034" exitCode=0
Sep 15 11:53:29.516989 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.516958    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"
Sep 15 11:53:29.517440 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.516987    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" event={"ID":"de74fa49-ba93-46c1-9267-f75eccec220b","Type":"ContainerDied","Data":"6d292c5567d20f66d1ee2a75222d3dc8c88c5af2a4c245622bc62fa9dab12034"}
Sep 15 11:53:29.517440 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.517046    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g" event={"ID":"de74fa49-ba93-46c1-9267-f75eccec220b","Type":"ContainerDied","Data":"927b5bc8be4ddc21b325d1973a416f8f97f80039de00fd40e84fab3d654da9c9"}
Sep 15 11:53:29.517440 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.517068    2571 scope.go:117] "RemoveContainer" containerID="6d292c5567d20f66d1ee2a75222d3dc8c88c5af2a4c245622bc62fa9dab12034"
Sep 15 11:53:29.526723 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.526704    2571 scope.go:117] "RemoveContainer" containerID="1184322e52e186a6c2f02258878329658e696b4045cabd5a209e4f719b259aad"
Sep 15 11:53:29.537266 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.537235    2571 scope.go:117] "RemoveContainer" containerID="6d292c5567d20f66d1ee2a75222d3dc8c88c5af2a4c245622bc62fa9dab12034"
Sep 15 11:53:29.537604 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:53:29.537575    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d292c5567d20f66d1ee2a75222d3dc8c88c5af2a4c245622bc62fa9dab12034\": container with ID starting with 6d292c5567d20f66d1ee2a75222d3dc8c88c5af2a4c245622bc62fa9dab12034 not found: ID does not exist" containerID="6d292c5567d20f66d1ee2a75222d3dc8c88c5af2a4c245622bc62fa9dab12034"
Sep 15 11:53:29.537758 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.537614    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d292c5567d20f66d1ee2a75222d3dc8c88c5af2a4c245622bc62fa9dab12034"} err="failed to get container status \"6d292c5567d20f66d1ee2a75222d3dc8c88c5af2a4c245622bc62fa9dab12034\": rpc error: code = NotFound desc = could not find container \"6d292c5567d20f66d1ee2a75222d3dc8c88c5af2a4c245622bc62fa9dab12034\": container with ID starting with 6d292c5567d20f66d1ee2a75222d3dc8c88c5af2a4c245622bc62fa9dab12034 not found: ID does not exist"
Sep 15 11:53:29.537758 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.537638    2571 scope.go:117] "RemoveContainer" containerID="1184322e52e186a6c2f02258878329658e696b4045cabd5a209e4f719b259aad"
Sep 15 11:53:29.538135 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:53:29.538117    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1184322e52e186a6c2f02258878329658e696b4045cabd5a209e4f719b259aad\": container with ID starting with 1184322e52e186a6c2f02258878329658e696b4045cabd5a209e4f719b259aad not found: ID does not exist" containerID="1184322e52e186a6c2f02258878329658e696b4045cabd5a209e4f719b259aad"
Sep 15 11:53:29.538226 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.538141    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1184322e52e186a6c2f02258878329658e696b4045cabd5a209e4f719b259aad"} err="failed to get container status \"1184322e52e186a6c2f02258878329658e696b4045cabd5a209e4f719b259aad\": rpc error: code = NotFound desc = could not find container \"1184322e52e186a6c2f02258878329658e696b4045cabd5a209e4f719b259aad\": container with ID starting with 1184322e52e186a6c2f02258878329658e696b4045cabd5a209e4f719b259aad not found: ID does not exist"
Sep 15 11:53:29.540099 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.540076    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"]
Sep 15 11:53:29.544424 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:29.544403    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-155ffe-openshift-default-dd6f8f5c8-wm74g"]
Sep 15 11:53:30.214609 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:30.214573    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" path="/var/lib/kubelet/pods/de74fa49-ba93-46c1-9267-f75eccec220b/volumes"
Sep 15 11:53:34.501352 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:34.501319    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:34.566560 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:34.566535    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:34.661481 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:34.661444    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:34.761021 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:34.760946    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:34.911682 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:34.911647    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:34.942484 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:34.942452    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"]
Sep 15 11:53:34.942755 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:34.942724    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht" podUID="4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a" containerName="payload-processing" containerID="cri-o://ff1f572d59cca8720b5ee2d312448a0e574283d38b4fda0b02ff1f6d34e2159b" gracePeriod=30
Sep 15 11:53:34.951401 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:34.951256    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"]
Sep 15 11:53:34.951525 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:34.951496    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt" podUID="6c3b9d7b-c822-4195-a180-1060cf837f29" containerName="payload-pre-processing" containerID="cri-o://3140d24b806b0c59c0a6f049320a12d795e070d20e4bdf9c29b08bfacfa0b517" gracePeriod=30
Sep 15 11:53:35.015010 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.014951    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:35.113761 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.113668    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:35.216668 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.216636    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:35.241603 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.241579    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"
Sep 15 11:53:35.244601 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.244576    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"
Sep 15 11:53:35.324221 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.324109    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qnxt\" (UniqueName: \"kubernetes.io/projected/6c3b9d7b-c822-4195-a180-1060cf837f29-kube-api-access-7qnxt\") pod \"6c3b9d7b-c822-4195-a180-1060cf837f29\" (UID: \"6c3b9d7b-c822-4195-a180-1060cf837f29\") "
Sep 15 11:53:35.324387 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.324231    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c3b9d7b-c822-4195-a180-1060cf837f29-plugins-config-volume\") pod \"6c3b9d7b-c822-4195-a180-1060cf837f29\" (UID: \"6c3b9d7b-c822-4195-a180-1060cf837f29\") "
Sep 15 11:53:35.324387 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.324270    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a-plugins-config-volume\") pod \"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a\" (UID: \"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a\") "
Sep 15 11:53:35.324507 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.324410    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9r9jp\" (UniqueName: \"kubernetes.io/projected/4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a-kube-api-access-9r9jp\") pod \"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a\" (UID: \"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a\") "
Sep 15 11:53:35.324653 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.324625    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a" (UID: "4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:53:35.324653 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.324637    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c3b9d7b-c822-4195-a180-1060cf837f29-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6c3b9d7b-c822-4195-a180-1060cf837f29" (UID: "6c3b9d7b-c822-4195-a180-1060cf837f29"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:53:35.324862 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.324840    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c3b9d7b-c822-4195-a180-1060cf837f29-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:35.324862 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.324860    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:35.326658 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.326627    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a-kube-api-access-9r9jp" (OuterVolumeSpecName: "kube-api-access-9r9jp") pod "4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a" (UID: "4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a"). InnerVolumeSpecName "kube-api-access-9r9jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:35.326835 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.326817    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c3b9d7b-c822-4195-a180-1060cf837f29-kube-api-access-7qnxt" (OuterVolumeSpecName: "kube-api-access-7qnxt") pod "6c3b9d7b-c822-4195-a180-1060cf837f29" (UID: "6c3b9d7b-c822-4195-a180-1060cf837f29"). InnerVolumeSpecName "kube-api-access-7qnxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:53:35.425491 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.425460    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r9jp\" (UniqueName: \"kubernetes.io/projected/4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a-kube-api-access-9r9jp\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:35.425491 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.425484    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qnxt\" (UniqueName: \"kubernetes.io/projected/6c3b9d7b-c822-4195-a180-1060cf837f29-kube-api-access-7qnxt\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:53:35.528814 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.528763    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:35.551565 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.551535    2571 generic.go:356] "Generic (PLEG): container finished" podID="4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a" containerID="ff1f572d59cca8720b5ee2d312448a0e574283d38b4fda0b02ff1f6d34e2159b" exitCode=0
Sep 15 11:53:35.551689 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.551579    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"
Sep 15 11:53:35.551689 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.551621    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht" event={"ID":"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a","Type":"ContainerDied","Data":"ff1f572d59cca8720b5ee2d312448a0e574283d38b4fda0b02ff1f6d34e2159b"}
Sep 15 11:53:35.551689 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.551680    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht" event={"ID":"4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a","Type":"ContainerDied","Data":"8da4460d3b9979ce91d46b849d2725aab93b8f95c50415034a731e512716406f"}
Sep 15 11:53:35.551850 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.551715    2571 scope.go:117] "RemoveContainer" containerID="ff1f572d59cca8720b5ee2d312448a0e574283d38b4fda0b02ff1f6d34e2159b"
Sep 15 11:53:35.553258 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.553226    2571 generic.go:356] "Generic (PLEG): container finished" podID="6c3b9d7b-c822-4195-a180-1060cf837f29" containerID="3140d24b806b0c59c0a6f049320a12d795e070d20e4bdf9c29b08bfacfa0b517" exitCode=0
Sep 15 11:53:35.553387 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.553279    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"
Sep 15 11:53:35.553387 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.553279    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt" event={"ID":"6c3b9d7b-c822-4195-a180-1060cf837f29","Type":"ContainerDied","Data":"3140d24b806b0c59c0a6f049320a12d795e070d20e4bdf9c29b08bfacfa0b517"}
Sep 15 11:53:35.553468 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.553421    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt" event={"ID":"6c3b9d7b-c822-4195-a180-1060cf837f29","Type":"ContainerDied","Data":"4d03fd0c9bb0105308fab8a1d4b2bd112060ac4e25e09781c77726d2326f36d7"}
Sep 15 11:53:35.563107 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.563088    2571 scope.go:117] "RemoveContainer" containerID="ff1f572d59cca8720b5ee2d312448a0e574283d38b4fda0b02ff1f6d34e2159b"
Sep 15 11:53:35.563388 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:53:35.563370    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1f572d59cca8720b5ee2d312448a0e574283d38b4fda0b02ff1f6d34e2159b\": container with ID starting with ff1f572d59cca8720b5ee2d312448a0e574283d38b4fda0b02ff1f6d34e2159b not found: ID does not exist" containerID="ff1f572d59cca8720b5ee2d312448a0e574283d38b4fda0b02ff1f6d34e2159b"
Sep 15 11:53:35.563463 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.563398    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1f572d59cca8720b5ee2d312448a0e574283d38b4fda0b02ff1f6d34e2159b"} err="failed to get container status \"ff1f572d59cca8720b5ee2d312448a0e574283d38b4fda0b02ff1f6d34e2159b\": rpc error: code = NotFound desc = could not find container \"ff1f572d59cca8720b5ee2d312448a0e574283d38b4fda0b02ff1f6d34e2159b\": container with ID starting with ff1f572d59cca8720b5ee2d312448a0e574283d38b4fda0b02ff1f6d34e2159b not found: ID does not exist"
Sep 15 11:53:35.563463 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.563421    2571 scope.go:117] "RemoveContainer" containerID="3140d24b806b0c59c0a6f049320a12d795e070d20e4bdf9c29b08bfacfa0b517"
Sep 15 11:53:35.571886 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.571868    2571 scope.go:117] "RemoveContainer" containerID="3140d24b806b0c59c0a6f049320a12d795e070d20e4bdf9c29b08bfacfa0b517"
Sep 15 11:53:35.572116 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:53:35.572098    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3140d24b806b0c59c0a6f049320a12d795e070d20e4bdf9c29b08bfacfa0b517\": container with ID starting with 3140d24b806b0c59c0a6f049320a12d795e070d20e4bdf9c29b08bfacfa0b517 not found: ID does not exist" containerID="3140d24b806b0c59c0a6f049320a12d795e070d20e4bdf9c29b08bfacfa0b517"
Sep 15 11:53:35.572214 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.572123    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3140d24b806b0c59c0a6f049320a12d795e070d20e4bdf9c29b08bfacfa0b517"} err="failed to get container status \"3140d24b806b0c59c0a6f049320a12d795e070d20e4bdf9c29b08bfacfa0b517\": rpc error: code = NotFound desc = could not find container \"3140d24b806b0c59c0a6f049320a12d795e070d20e4bdf9c29b08bfacfa0b517\": container with ID starting with 3140d24b806b0c59c0a6f049320a12d795e070d20e4bdf9c29b08bfacfa0b517 not found: ID does not exist"
Sep 15 11:53:35.578109 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.578057    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"]
Sep 15 11:53:35.584658 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.584637    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1b147a-56d66fb6b7-hrdht"]
Sep 15 11:53:35.601628 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.601607    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"]
Sep 15 11:53:35.608909 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.608885    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1b147a-6dd579bc98-s8dzt"]
Sep 15 11:53:35.792361 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:35.792328    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:36.213890 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:36.213815    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a" path="/var/lib/kubelet/pods/4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a/volumes"
Sep 15 11:53:36.214210 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:36.214193    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c3b9d7b-c822-4195-a180-1060cf837f29" path="/var/lib/kubelet/pods/6c3b9d7b-c822-4195-a180-1060cf837f29/volumes"
Sep 15 11:53:41.960060 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:41.959978    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:42.060210 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:42.060176    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:42.232617 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:42.232539    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:42.782116 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:42.782077    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:43.089944 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.089865    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"]
Sep 15 11:53:43.090646 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090622    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1a827e1-3177-4ac3-a07f-fbaed48d6a9e" containerName="maas-api"
Sep 15 11:53:43.090646 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090646    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1a827e1-3177-4ac3-a07f-fbaed48d6a9e" containerName="maas-api"
Sep 15 11:53:43.090815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090681    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d814eab-685c-4bd9-aefd-c5efeff1a5e6" containerName="payload-pre-processing"
Sep 15 11:53:43.090815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090690    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d814eab-685c-4bd9-aefd-c5efeff1a5e6" containerName="payload-pre-processing"
Sep 15 11:53:43.090815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090701    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a" containerName="payload-processing"
Sep 15 11:53:43.090815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090711    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a" containerName="payload-processing"
Sep 15 11:53:43.090815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090725    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" containerName="istio-proxy"
Sep 15 11:53:43.090815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090734    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" containerName="istio-proxy"
Sep 15 11:53:43.090815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090746    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d707d2e-af0c-4013-855c-59be0ee8e833" containerName="payload-processing"
Sep 15 11:53:43.090815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090754    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d707d2e-af0c-4013-855c-59be0ee8e833" containerName="payload-processing"
Sep 15 11:53:43.090815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090777    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc017203-aeca-4090-af25-657ae66ab10e" containerName="payload-processing"
Sep 15 11:53:43.090815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090785    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc017203-aeca-4090-af25-657ae66ab10e" containerName="payload-processing"
Sep 15 11:53:43.090815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090799    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" containerName="istio-proxy"
Sep 15 11:53:43.090815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090808    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" containerName="istio-proxy"
Sep 15 11:53:43.090815 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090818    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c3b9d7b-c822-4195-a180-1060cf837f29" containerName="payload-pre-processing"
Sep 15 11:53:43.091263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090827    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c3b9d7b-c822-4195-a180-1060cf837f29" containerName="payload-pre-processing"
Sep 15 11:53:43.091263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090920    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1a827e1-3177-4ac3-a07f-fbaed48d6a9e" containerName="maas-api"
Sep 15 11:53:43.091263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090930    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc017203-aeca-4090-af25-657ae66ab10e" containerName="payload-processing"
Sep 15 11:53:43.091263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090938    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c3b9d7b-c822-4195-a180-1060cf837f29" containerName="payload-pre-processing"
Sep 15 11:53:43.091263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090949    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d707d2e-af0c-4013-855c-59be0ee8e833" containerName="payload-processing"
Sep 15 11:53:43.091263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090960    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" containerName="istio-proxy"
Sep 15 11:53:43.091263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090968    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d814eab-685c-4bd9-aefd-c5efeff1a5e6" containerName="payload-pre-processing"
Sep 15 11:53:43.091263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090978    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="de74fa49-ba93-46c1-9267-f75eccec220b" containerName="istio-proxy"
Sep 15 11:53:43.091263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.090988    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b7d0f1e-b5a1-4bba-b93a-9f7251abfa6a" containerName="payload-processing"
Sep 15 11:53:43.096113 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.096094    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.099113 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.099089    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-42b26e-openshift-default-dockercfg-ktrq2\""
Sep 15 11:53:43.105532 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.105512    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"]
Sep 15 11:53:43.200497 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.200464    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-podinfo\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.200665 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.200504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-workload-certs\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.200665 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.200546    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-envoy\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.200665 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.200591    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-token\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.200665 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.200628    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-workload-socket\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.200816 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.200667    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-data\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.200816 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.200738    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-credential-socket\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.200816 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.200763    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/385370d3-ef33-4288-b609-b082c2b6d6a0-istiod-ca-cert\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.200914 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.200812    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt9zh\" (UniqueName: \"kubernetes.io/projected/385370d3-ef33-4288-b609-b082c2b6d6a0-kube-api-access-wt9zh\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.301959 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.301928    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-credential-socket\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.301959 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.301964    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/385370d3-ef33-4288-b609-b082c2b6d6a0-istiod-ca-cert\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.302213 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.302006    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt9zh\" (UniqueName: \"kubernetes.io/projected/385370d3-ef33-4288-b609-b082c2b6d6a0-kube-api-access-wt9zh\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.302213 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.302067    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-podinfo\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.302213 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.302097    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-workload-certs\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.302404 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.302328    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-envoy\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.302404 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.302393    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-credential-socket\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.302518 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.302418    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-workload-certs\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.302655 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.302637    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-token\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.302736 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.302666    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-workload-socket\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.302793 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.302736    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-data\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.302846 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.302788    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/385370d3-ef33-4288-b609-b082c2b6d6a0-istiod-ca-cert\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.302963 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.302940    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-workload-socket\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.303065 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.303041    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-data\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.305000 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.304975    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-envoy\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.305164 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.305133    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-podinfo\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.310641 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.310620    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-token\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.310736 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.310628    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt9zh\" (UniqueName: \"kubernetes.io/projected/385370d3-ef33-4288-b609-b082c2b6d6a0-kube-api-access-wt9zh\") pod \"e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") " pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.407693 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.407617    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:43.598431 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.598392    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:43.655406 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.655377    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:43.684479 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.684457    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"]
Sep 15 11:53:43.686306 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:53:43.686277    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod385370d3_ef33_4288_b609_b082c2b6d6a0.slice/crio-31eebbf904faa64a6fdc27e356bfb0df3b46d13f177f0527fcfc49b4e9a11f85 WatchSource:0}: Error finding container 31eebbf904faa64a6fdc27e356bfb0df3b46d13f177f0527fcfc49b4e9a11f85: Status 404 returned error can't find the container with id 31eebbf904faa64a6fdc27e356bfb0df3b46d13f177f0527fcfc49b4e9a11f85
Sep 15 11:53:43.688381 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.688344    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:53:43.688482 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.688427    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:53:43.688482 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:43.688472    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:53:44.606503 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:44.606462    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" event={"ID":"385370d3-ef33-4288-b609-b082c2b6d6a0","Type":"ContainerStarted","Data":"5e88240d59af254db0f79c9355235cd1e019e733dac458a44807896fbe9733ab"}
Sep 15 11:53:44.606971 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:44.606526    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" event={"ID":"385370d3-ef33-4288-b609-b082c2b6d6a0","Type":"ContainerStarted","Data":"31eebbf904faa64a6fdc27e356bfb0df3b46d13f177f0527fcfc49b4e9a11f85"}
Sep 15 11:53:44.629384 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:44.629335    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" podStartSLOduration=1.62931935 podStartE2EDuration="1.62931935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:53:44.628003391 +0000 UTC m=+986.879560485" watchObservedRunningTime="2026-09-15 11:53:44.62931935 +0000 UTC m=+986.880876406"
Sep 15 11:53:45.407928 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:45.407899    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:45.412749 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:45.412716    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:45.611711 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:45.611681    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:45.612902 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:45.612873    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:53:46.529950 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:46.529900    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:46.695536 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:46.695482    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:46.792425 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:46.792305    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:47.720230 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.720195    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"]
Sep 15 11:53:47.724173 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.724133    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:47.726737 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.726719    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-42b26e-serving-cert\""
Sep 15 11:53:47.737339 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.737316    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"]
Sep 15 11:53:47.754999 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.754971    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:47.814761 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.814728    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:47.847975 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.847941    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kftwf\" (UniqueName: \"kubernetes.io/projected/d48a91f1-2a37-4744-8d00-371698d76b0b-kube-api-access-kftwf\") pod \"maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:47.848139 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.847985    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d48a91f1-2a37-4744-8d00-371698d76b0b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:47.848139 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.848009    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d48a91f1-2a37-4744-8d00-371698d76b0b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:47.848289 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.848148    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d48a91f1-2a37-4744-8d00-371698d76b0b-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:47.949427 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.949391    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kftwf\" (UniqueName: \"kubernetes.io/projected/d48a91f1-2a37-4744-8d00-371698d76b0b-kube-api-access-kftwf\") pod \"maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:47.949597 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.949453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d48a91f1-2a37-4744-8d00-371698d76b0b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:47.949597 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.949483    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d48a91f1-2a37-4744-8d00-371698d76b0b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:47.949597 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.949571    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d48a91f1-2a37-4744-8d00-371698d76b0b-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:47.950147 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.950124    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d48a91f1-2a37-4744-8d00-371698d76b0b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:47.952038 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.952014    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d48a91f1-2a37-4744-8d00-371698d76b0b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:47.952128 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.952014    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d48a91f1-2a37-4744-8d00-371698d76b0b-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:47.957106 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.957084    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kftwf\" (UniqueName: \"kubernetes.io/projected/d48a91f1-2a37-4744-8d00-371698d76b0b-kube-api-access-kftwf\") pod \"maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:47.966377 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:47.966345    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:48.036826 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:48.036752    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:48.233843 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:48.233773    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:48.312724 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:48.312696    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"]
Sep 15 11:53:48.313973 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:48.313928    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:48.314418 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:53:48.314360    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd48a91f1_2a37_4744_8d00_371698d76b0b.slice/crio-0eaefff609ba5dfbf4486b4218365cc5029e4149bda160ff57b2c37e707e2d82 WatchSource:0}: Error finding container 0eaefff609ba5dfbf4486b4218365cc5029e4149bda160ff57b2c37e707e2d82: Status 404 returned error can't find the container with id 0eaefff609ba5dfbf4486b4218365cc5029e4149bda160ff57b2c37e707e2d82
Sep 15 11:53:48.315994 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:48.315971    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 11:53:48.630586 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:48.630506    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w" event={"ID":"d48a91f1-2a37-4744-8d00-371698d76b0b","Type":"ContainerStarted","Data":"0eaefff609ba5dfbf4486b4218365cc5029e4149bda160ff57b2c37e707e2d82"}
Sep 15 11:53:49.637602 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:49.637567    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w" event={"ID":"d48a91f1-2a37-4744-8d00-371698d76b0b","Type":"ContainerStarted","Data":"4e6c58d0e2fb115a09c09d0c823a8773cda1ad44f2640d46ba41370564a05e87"}
Sep 15 11:53:49.638026 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:49.637653    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:49.656585 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:49.656532    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w" podStartSLOduration=2.24922807 podStartE2EDuration="2.656515833s" totalImagesPullingTime="407.287763ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:53:49.655953098 +0000 UTC m=+991.907510194" watchObservedRunningTime="2026-09-15 11:53:49.656515833 +0000 UTC m=+991.908072892"
Sep 15 11:53:50.671796 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:50.671757    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:55.617897 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:55.617797    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:55.649868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:55.649839    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 11:53:57.590590 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:57.590553    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:57.700244 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:57.700213    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:53:57.853747 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:53:57.853664    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:00.612889 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:00.612860    2571 patch_prober.go:28] interesting pod/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 15 11:54:00.613268 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:00.612909    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 15 11:54:00.703597 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:00.703565    2571 generic.go:356] "Generic (PLEG): container finished" podID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerID="5e88240d59af254db0f79c9355235cd1e019e733dac458a44807896fbe9733ab" exitCode=0
Sep 15 11:54:00.703747 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:00.703625    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" event={"ID":"385370d3-ef33-4288-b609-b082c2b6d6a0","Type":"ContainerDied","Data":"5e88240d59af254db0f79c9355235cd1e019e733dac458a44807896fbe9733ab"}
Sep 15 11:54:00.704004 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:00.703991    2571 scope.go:117] "RemoveContainer" containerID="5e88240d59af254db0f79c9355235cd1e019e733dac458a44807896fbe9733ab"
Sep 15 11:54:00.705049 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:00.705020    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:54:00.705118 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:00.705103    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:54:00.705189 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:00.705141    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 11:54:01.711291 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:01.711255    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" event={"ID":"385370d3-ef33-4288-b609-b082c2b6d6a0","Type":"ContainerStarted","Data":"6d69164dcfc90638ffb21e2666ed06ae9d06f5ad364edee9bcaf70133ba7609c"}
Sep 15 11:54:02.407996 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:02.407956    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:54:02.408266 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:02.408244    2571 patch_prober.go:28] interesting pod/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 15 11:54:02.408322 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:02.408292    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 15 11:54:03.408635 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:03.408590    2571 patch_prober.go:28] interesting pod/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 15 11:54:03.409017 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:03.408649    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 15 11:54:04.408279 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:04.408245    2571 patch_prober.go:28] interesting pod/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 15 11:54:04.408447 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:04.408295    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 15 11:54:05.408283 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:05.408243    2571 patch_prober.go:28] interesting pod/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 15 11:54:05.408653 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:05.408299    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 15 11:54:06.408446 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:06.408411    2571 patch_prober.go:28] interesting pod/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 15 11:54:06.408822 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:06.408468    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 15 11:54:07.413067 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:07.413035    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:54:07.413555 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:07.413444    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:54:07.414030 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:07.413996    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 11:54:08.351337 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:08.351301    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:08.691119 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:08.691013    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:09.141550 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:09.141513    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:10.075848 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:10.075809    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:10.677680 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:10.677651    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:11.463657 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:11.463626    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:11.771419 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:11.771328    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:12.063705 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:12.063618    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:12.326564 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:12.326475    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:14.245256 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:14.245223    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:14.881477 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:14.881420    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:14.987261 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:14.987227    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:15.082047 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:15.082014    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:16.013301 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.013266    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:16.118558 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.118523    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"]
Sep 15 11:54:16.120570 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.120531    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:16.122520 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.122503    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:16.125041 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.125020    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-7b7b3c-serving-cert\""
Sep 15 11:54:16.135637 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.135611    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"]
Sep 15 11:54:16.214606 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.214572    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:16.248878 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.247900    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48j9j\" (UniqueName: \"kubernetes.io/projected/882a3df3-f9b1-46a1-a103-ecaf1d61693e-kube-api-access-48j9j\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:16.248878 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.247984    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:16.248878 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.248018    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:16.248878 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.248078    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/882a3df3-f9b1-46a1-a103-ecaf1d61693e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:16.308617 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.308512    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:16.348820 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.348779    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48j9j\" (UniqueName: \"kubernetes.io/projected/882a3df3-f9b1-46a1-a103-ecaf1d61693e-kube-api-access-48j9j\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:16.349001 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.348849    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:16.349001 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.348872    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:16.349001 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.348914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/882a3df3-f9b1-46a1-a103-ecaf1d61693e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:16.349194 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:54:16.349028    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-serving-cert: secret "maas-api-e2e-shared-b-w2-7b7b3c-serving-cert" not found
Sep 15 11:54:16.349194 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:54:16.349110    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-maas-api-tls podName:882a3df3-f9b1-46a1-a103-ecaf1d61693e nodeName:}" failed. No retries permitted until 2026-09-15 11:54:16.849089454 +0000 UTC m=+1019.100646497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-maas-api-tls") pod "maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj" (UID: "882a3df3-f9b1-46a1-a103-ecaf1d61693e") : secret "maas-api-e2e-shared-b-w2-7b7b3c-serving-cert" not found
Sep 15 11:54:16.349586 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.349557    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/882a3df3-f9b1-46a1-a103-ecaf1d61693e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:16.351368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.351346    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:16.359781 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.359759    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48j9j\" (UniqueName: \"kubernetes.io/projected/882a3df3-f9b1-46a1-a103-ecaf1d61693e-kube-api-access-48j9j\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:16.715990 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.715947    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:16.819359 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.819326    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:16.840322 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.840291    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"]
Sep 15 11:54:16.843842 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.843822    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"
Sep 15 11:54:16.846310 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.846287    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-7b7b3c-dockercfg-txdvb\""
Sep 15 11:54:16.846419 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.846297    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-7b7b3c\""
Sep 15 11:54:16.855461 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.855435    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"]
Sep 15 11:54:16.856030 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.855904    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:16.856142 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:54:16.856059    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-serving-cert: secret "maas-api-e2e-shared-b-w2-7b7b3c-serving-cert" not found
Sep 15 11:54:16.856142 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:54:16.856140    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-maas-api-tls podName:882a3df3-f9b1-46a1-a103-ecaf1d61693e nodeName:}" failed. No retries permitted until 2026-09-15 11:54:17.856117936 +0000 UTC m=+1020.107674993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-maas-api-tls") pod "maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj" (UID: "882a3df3-f9b1-46a1-a103-ecaf1d61693e") : secret "maas-api-e2e-shared-b-w2-7b7b3c-serving-cert" not found
Sep 15 11:54:16.956657 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.956618    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6pxp\" (UniqueName: \"kubernetes.io/projected/b69fd742-5be7-4da2-b9bf-84884fa72229-kube-api-access-g6pxp\") pod \"payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx\" (UID: \"b69fd742-5be7-4da2-b9bf-84884fa72229\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"
Sep 15 11:54:16.956839 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:16.956665    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b69fd742-5be7-4da2-b9bf-84884fa72229-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx\" (UID: \"b69fd742-5be7-4da2-b9bf-84884fa72229\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"
Sep 15 11:54:17.057850 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.057759    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6pxp\" (UniqueName: \"kubernetes.io/projected/b69fd742-5be7-4da2-b9bf-84884fa72229-kube-api-access-g6pxp\") pod \"payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx\" (UID: \"b69fd742-5be7-4da2-b9bf-84884fa72229\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"
Sep 15 11:54:17.057850 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.057807    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b69fd742-5be7-4da2-b9bf-84884fa72229-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx\" (UID: \"b69fd742-5be7-4da2-b9bf-84884fa72229\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"
Sep 15 11:54:17.058562 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.058540    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b69fd742-5be7-4da2-b9bf-84884fa72229-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx\" (UID: \"b69fd742-5be7-4da2-b9bf-84884fa72229\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"
Sep 15 11:54:17.068868 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.068839    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6pxp\" (UniqueName: \"kubernetes.io/projected/b69fd742-5be7-4da2-b9bf-84884fa72229-kube-api-access-g6pxp\") pod \"payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx\" (UID: \"b69fd742-5be7-4da2-b9bf-84884fa72229\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"
Sep 15 11:54:17.156914 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.156880    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"
Sep 15 11:54:17.313179 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.313073    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:17.417633 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.417602    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:17.448568 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.448542    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"]
Sep 15 11:54:17.451136 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:54:17.451106    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb69fd742_5be7_4da2_b9bf_84884fa72229.slice/crio-9ec26151c343416c762e5d9626c64c7c7fd107aa3ab7e42bfa46d3aea07657e7 WatchSource:0}: Error finding container 9ec26151c343416c762e5d9626c64c7c7fd107aa3ab7e42bfa46d3aea07657e7: Status 404 returned error can't find the container with id 9ec26151c343416c762e5d9626c64c7c7fd107aa3ab7e42bfa46d3aea07657e7
Sep 15 11:54:17.809392 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.809355    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx" event={"ID":"b69fd742-5be7-4da2-b9bf-84884fa72229","Type":"ContainerStarted","Data":"deef65dcb6f625573f42dcce043e3f0d3aa98493804ae6e04271f1d300e4f788"}
Sep 15 11:54:17.809582 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.809413    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx" event={"ID":"b69fd742-5be7-4da2-b9bf-84884fa72229","Type":"ContainerStarted","Data":"9ec26151c343416c762e5d9626c64c7c7fd107aa3ab7e42bfa46d3aea07657e7"}
Sep 15 11:54:17.809582 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.809455    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"
Sep 15 11:54:17.828854 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.828805    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx" podStartSLOduration=1.828782014 podStartE2EDuration="1.828782014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:54:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:54:17.827145114 +0000 UTC m=+1020.078702172" watchObservedRunningTime="2026-09-15 11:54:17.828782014 +0000 UTC m=+1020.080339099"
Sep 15 11:54:17.873204 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.873166    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:17.875603 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.875578    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:17.936780 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:17.936746    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:18.216389 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:54:18.216350    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod882a3df3_f9b1_46a1_a103_ecaf1d61693e.slice/crio-15d0d2b7ed59356e51761401bf1e87785f2ea9cc678efe7c25dd13734ecf8605 WatchSource:0}: Error finding container 15d0d2b7ed59356e51761401bf1e87785f2ea9cc678efe7c25dd13734ecf8605: Status 404 returned error can't find the container with id 15d0d2b7ed59356e51761401bf1e87785f2ea9cc678efe7c25dd13734ecf8605
Sep 15 11:54:18.218753 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:18.218580    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"]
Sep 15 11:54:18.657812 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:18.657772    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:18.816937 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:18.816835    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj" event={"ID":"882a3df3-f9b1-46a1-a103-ecaf1d61693e","Type":"ContainerStarted","Data":"3e837195813cea45e3465675f28c8774a97cb410a880c03f474e200b82ec2a37"}
Sep 15 11:54:18.816937 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:18.816893    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj" event={"ID":"882a3df3-f9b1-46a1-a103-ecaf1d61693e","Type":"ContainerStarted","Data":"15d0d2b7ed59356e51761401bf1e87785f2ea9cc678efe7c25dd13734ecf8605"}
Sep 15 11:54:18.817361 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:18.817025    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:18.836164 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:18.836110    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj" podStartSLOduration=2.534104621 podStartE2EDuration="2.836095674s" totalImagesPullingTime="301.991053ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:54:18.833588708 +0000 UTC m=+1021.085145767" watchObservedRunningTime="2026-09-15 11:54:18.836095674 +0000 UTC m=+1021.087652761"
Sep 15 11:54:24.728675 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:24.728644    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:24.827619 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:24.827590    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 11:54:24.829329 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:24.829307    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:25.455481 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:25.455451    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:28.819313 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:28.819277    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"
Sep 15 11:54:31.300957 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:31.300919    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:31.400232 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:31.400195    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:31.559632 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:31.559543    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:31.869934 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:31.869858    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:32.262058 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:32.262029    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:34.497456 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:34.497419    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:35.068772 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:35.068738    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:35.176662 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:35.176620    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:35.275201 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:35.275149    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:36.005859 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:36.005829    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:36.940683 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:36.940649    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:37.687730 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.687694    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"]
Sep 15 11:54:37.691978 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.691956    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:37.694530 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.694503    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9064d2be-serving-cert\""
Sep 15 11:54:37.705183 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.705136    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"]
Sep 15 11:54:37.729907 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.729880    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:37.778597 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.778568    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-494fr\" (UniqueName: \"kubernetes.io/projected/8e9000e6-0a10-46df-bfd8-a208f810b6a3-kube-api-access-494fr\") pod \"maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:37.778727 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.778640    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-metrics-certs\") pod \"maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:37.778781 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.778727    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-maas-api-tls\") pod \"maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:37.778781 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.778763    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e9000e6-0a10-46df-bfd8-a208f810b6a3-openshift-service-ca\") pod \"maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:37.880125 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.880089    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-494fr\" (UniqueName: \"kubernetes.io/projected/8e9000e6-0a10-46df-bfd8-a208f810b6a3-kube-api-access-494fr\") pod \"maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:37.880309 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.880208    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-metrics-certs\") pod \"maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:37.880309 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.880268    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-maas-api-tls\") pod \"maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:37.880309 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.880293    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e9000e6-0a10-46df-bfd8-a208f810b6a3-openshift-service-ca\") pod \"maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:37.880427 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:54:37.880403    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-serving-cert: secret "maas-api-e2e-mt-9064d2be-serving-cert" not found
Sep 15 11:54:37.880485 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:54:37.880473    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-maas-api-tls podName:8e9000e6-0a10-46df-bfd8-a208f810b6a3 nodeName:}" failed. No retries permitted until 2026-09-15 11:54:38.380454201 +0000 UTC m=+1040.632011241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-maas-api-tls") pod "maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq" (UID: "8e9000e6-0a10-46df-bfd8-a208f810b6a3") : secret "maas-api-e2e-mt-9064d2be-serving-cert" not found
Sep 15 11:54:37.880832 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.880815    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e9000e6-0a10-46df-bfd8-a208f810b6a3-openshift-service-ca\") pod \"maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:37.882719 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.882696    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-metrics-certs\") pod \"maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:37.891070 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.891048    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-494fr\" (UniqueName: \"kubernetes.io/projected/8e9000e6-0a10-46df-bfd8-a208f810b6a3-kube-api-access-494fr\") pod \"maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:37.907341 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:37.907321    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:38.287786 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:38.287755    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:38.350107 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:38.350075    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:38.385454 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:38.385422    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-maas-api-tls\") pod \"maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:38.387824 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:38.387802    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-maas-api-tls\") pod \"maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:38.603955 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:38.603877    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:38.668095 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:38.668059    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:38.879277 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:38.879247    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"]
Sep 15 11:54:38.881064 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:54:38.881037    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e9000e6_0a10_46df_bfd8_a208f810b6a3.slice/crio-00b6994b450d1b0ad7844ba448cc3de28b25d1d6c8af18b5e8fa9c7e6bb4a3aa WatchSource:0}: Error finding container 00b6994b450d1b0ad7844ba448cc3de28b25d1d6c8af18b5e8fa9c7e6bb4a3aa: Status 404 returned error can't find the container with id 00b6994b450d1b0ad7844ba448cc3de28b25d1d6c8af18b5e8fa9c7e6bb4a3aa
Sep 15 11:54:38.930986 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:38.930958    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq" event={"ID":"8e9000e6-0a10-46df-bfd8-a208f810b6a3","Type":"ContainerStarted","Data":"00b6994b450d1b0ad7844ba448cc3de28b25d1d6c8af18b5e8fa9c7e6bb4a3aa"}
Sep 15 11:54:39.487763 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:39.487733    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:39.938440 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:39.938344    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq" event={"ID":"8e9000e6-0a10-46df-bfd8-a208f810b6a3","Type":"ContainerStarted","Data":"2c3cc89295e9329de1700e1dd9e4c60f9c8472790d2848a6c932fe57e9d06d09"}
Sep 15 11:54:39.938440 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:39.938411    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:39.958979 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:39.958924    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq" podStartSLOduration=2.373841107 podStartE2EDuration="2.958907317s" totalImagesPullingTime="585.06621ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:54:39.957395287 +0000 UTC m=+1042.208952346" watchObservedRunningTime="2026-09-15 11:54:39.958907317 +0000 UTC m=+1042.210464374"
Sep 15 11:54:39.988412 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:39.988382    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:40.169212 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:40.169178    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:45.949313 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:45.949283    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:54:53.405427 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:53.405386    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:54:59.727672 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:54:59.727615    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:00.211207 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:00.211175    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:00.308812 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:00.308763    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:00.885936 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:00.885882    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:00.983460 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:00.983423    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:01.134822 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:01.134784    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:01.375907 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:01.375877    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:02.021368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:02.021330    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:07.445469 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:07.445422    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:07.506446 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:07.506415    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:08.703514 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:08.703481    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:09.343401 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:09.343368    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:10.126209 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:10.126132    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:10.606352 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:10.606307    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:17.801876 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:17.801841    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:18.335310 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.335279    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"]
Sep 15 11:55:18.335522 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.335499    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq" podUID="8e9000e6-0a10-46df-bfd8-a208f810b6a3" containerName="maas-api" containerID="cri-o://2c3cc89295e9329de1700e1dd9e4c60f9c8472790d2848a6c932fe57e9d06d09" gracePeriod=30
Sep 15 11:55:18.368188 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.368145    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:18.434129 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.434102    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:18.497546 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.497518    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:18.567558 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.567526    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:18.593679 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.593613    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:55:18.631381 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.631347    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:18.691550 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.691517    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-metrics-certs\") pod \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") "
Sep 15 11:55:18.691550 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.691554    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-maas-api-tls\") pod \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") "
Sep 15 11:55:18.691799 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.691616    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-494fr\" (UniqueName: \"kubernetes.io/projected/8e9000e6-0a10-46df-bfd8-a208f810b6a3-kube-api-access-494fr\") pod \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") "
Sep 15 11:55:18.691799 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.691636    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e9000e6-0a10-46df-bfd8-a208f810b6a3-openshift-service-ca\") pod \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\" (UID: \"8e9000e6-0a10-46df-bfd8-a208f810b6a3\") "
Sep 15 11:55:18.692136 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.692103    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e9000e6-0a10-46df-bfd8-a208f810b6a3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8e9000e6-0a10-46df-bfd8-a208f810b6a3" (UID: "8e9000e6-0a10-46df-bfd8-a208f810b6a3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:55:18.693663 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.693640    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8e9000e6-0a10-46df-bfd8-a208f810b6a3" (UID: "8e9000e6-0a10-46df-bfd8-a208f810b6a3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:55:18.694190 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.694143    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8e9000e6-0a10-46df-bfd8-a208f810b6a3" (UID: "8e9000e6-0a10-46df-bfd8-a208f810b6a3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:55:18.694266 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.694172    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e9000e6-0a10-46df-bfd8-a208f810b6a3-kube-api-access-494fr" (OuterVolumeSpecName: "kube-api-access-494fr") pod "8e9000e6-0a10-46df-bfd8-a208f810b6a3" (UID: "8e9000e6-0a10-46df-bfd8-a208f810b6a3"). InnerVolumeSpecName "kube-api-access-494fr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:55:18.793625 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.793593    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:55:18.793625 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.793619    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e9000e6-0a10-46df-bfd8-a208f810b6a3-maas-api-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:55:18.793625 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.793629    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-494fr\" (UniqueName: \"kubernetes.io/projected/8e9000e6-0a10-46df-bfd8-a208f810b6a3-kube-api-access-494fr\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:55:18.793855 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.793638    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e9000e6-0a10-46df-bfd8-a208f810b6a3-openshift-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:55:18.940242 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:18.940138    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:19.047745 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:19.047709    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:19.153824 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:19.153788    2571 generic.go:356] "Generic (PLEG): container finished" podID="8e9000e6-0a10-46df-bfd8-a208f810b6a3" containerID="2c3cc89295e9329de1700e1dd9e4c60f9c8472790d2848a6c932fe57e9d06d09" exitCode=0
Sep 15 11:55:19.153824 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:19.153827    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"
Sep 15 11:55:19.154032 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:19.153873    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq" event={"ID":"8e9000e6-0a10-46df-bfd8-a208f810b6a3","Type":"ContainerDied","Data":"2c3cc89295e9329de1700e1dd9e4c60f9c8472790d2848a6c932fe57e9d06d09"}
Sep 15 11:55:19.154032 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:19.153959    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq" event={"ID":"8e9000e6-0a10-46df-bfd8-a208f810b6a3","Type":"ContainerDied","Data":"00b6994b450d1b0ad7844ba448cc3de28b25d1d6c8af18b5e8fa9c7e6bb4a3aa"}
Sep 15 11:55:19.154032 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:19.153983    2571 scope.go:117] "RemoveContainer" containerID="2c3cc89295e9329de1700e1dd9e4c60f9c8472790d2848a6c932fe57e9d06d09"
Sep 15 11:55:19.163873 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:19.163837    2571 scope.go:117] "RemoveContainer" containerID="2c3cc89295e9329de1700e1dd9e4c60f9c8472790d2848a6c932fe57e9d06d09"
Sep 15 11:55:19.164070 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:55:19.164054    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c3cc89295e9329de1700e1dd9e4c60f9c8472790d2848a6c932fe57e9d06d09\": container with ID starting with 2c3cc89295e9329de1700e1dd9e4c60f9c8472790d2848a6c932fe57e9d06d09 not found: ID does not exist" containerID="2c3cc89295e9329de1700e1dd9e4c60f9c8472790d2848a6c932fe57e9d06d09"
Sep 15 11:55:19.164114 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:19.164078    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c3cc89295e9329de1700e1dd9e4c60f9c8472790d2848a6c932fe57e9d06d09"} err="failed to get container status \"2c3cc89295e9329de1700e1dd9e4c60f9c8472790d2848a6c932fe57e9d06d09\": rpc error: code = NotFound desc = could not find container \"2c3cc89295e9329de1700e1dd9e4c60f9c8472790d2848a6c932fe57e9d06d09\": container with ID starting with 2c3cc89295e9329de1700e1dd9e4c60f9c8472790d2848a6c932fe57e9d06d09 not found: ID does not exist"
Sep 15 11:55:19.175423 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:19.175399    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"]
Sep 15 11:55:19.178870 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:19.178847    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9064d2be-7f767cdd6c-n48tq"]
Sep 15 11:55:19.658500 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:19.658466    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:20.214341 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:20.214299    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e9000e6-0a10-46df-bfd8-a208f810b6a3" path="/var/lib/kubelet/pods/8e9000e6-0a10-46df-bfd8-a208f810b6a3/volumes"
Sep 15 11:55:20.486629 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:20.486545    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:24.899733 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:24.899701    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:25.001242 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:25.001208    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:25.229638 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:25.229611    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:25.529450 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:25.529374    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:25.626370 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:25.626341    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:25.761350 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:25.761315    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:31.626103 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:31.626045    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:31.691486 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:31.691456    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:31.775368 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:31.775338    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:31.877367 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:31.877284    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:31.976351 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:31.976320    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:38.241915 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:38.241884    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:38.342490 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:38.342456    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:39.166018 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:39.165988    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:39.506384 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:39.506342    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:39.791620 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:39.791542    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:42.204674 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:42.204622    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:42.588675 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:42.588586    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:42.729536 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:42.729506    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:43.375404 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:43.375371    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:44.014068 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.014027    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"]
Sep 15 11:55:44.014734 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.014710    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e9000e6-0a10-46df-bfd8-a208f810b6a3" containerName="maas-api"
Sep 15 11:55:44.014734 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.014734    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e9000e6-0a10-46df-bfd8-a208f810b6a3" containerName="maas-api"
Sep 15 11:55:44.014939 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.014886    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e9000e6-0a10-46df-bfd8-a208f810b6a3" containerName="maas-api"
Sep 15 11:55:44.020127 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.020100    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.023320 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.023298    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w1-7f9f55-serving-cert\""
Sep 15 11:55:44.037613 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.037588    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"]
Sep 15 11:55:44.042385 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.042362    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.042525 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.042409    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzmhq\" (UniqueName: \"kubernetes.io/projected/0a83c2f7-fa7c-477d-a471-5b52c481636b-kube-api-access-qzmhq\") pod \"maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.042525 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.042483    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.042649 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.042547    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a83c2f7-fa7c-477d-a471-5b52c481636b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.064981 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.064951    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:44.143654 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.143621    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a83c2f7-fa7c-477d-a471-5b52c481636b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.143830 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.143752    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.143830 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.143806    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzmhq\" (UniqueName: \"kubernetes.io/projected/0a83c2f7-fa7c-477d-a471-5b52c481636b-kube-api-access-qzmhq\") pod \"maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.143954 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.143853    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.144014 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:55:44.143985    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-serving-cert: secret "maas-api-e2e-shared-a-w1-7f9f55-serving-cert" not found
Sep 15 11:55:44.144080 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:55:44.144068    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-maas-api-tls podName:0a83c2f7-fa7c-477d-a471-5b52c481636b nodeName:}" failed. No retries permitted until 2026-09-15 11:55:44.644046745 +0000 UTC m=+1106.895603796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-maas-api-tls") pod "maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8" (UID: "0a83c2f7-fa7c-477d-a471-5b52c481636b") : secret "maas-api-e2e-shared-a-w1-7f9f55-serving-cert" not found
Sep 15 11:55:44.144304 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.144284    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a83c2f7-fa7c-477d-a471-5b52c481636b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.146261 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.146243    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.152807 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.152773    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzmhq\" (UniqueName: \"kubernetes.io/projected/0a83c2f7-fa7c-477d-a471-5b52c481636b-kube-api-access-qzmhq\") pod \"maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.165755 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.165727    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:44.289211 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.289067    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:44.641566 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.641473    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:44.648561 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.648532    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.650882 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.650849    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:44.739321 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.739287    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:44.931350 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:44.931258    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:45.204342 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:45.204317    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"]
Sep 15 11:55:45.206035 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:55:45.206002    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a83c2f7_fa7c_477d_a471_5b52c481636b.slice/crio-c9d0be8180d1aa28cb537f3fd6cc2ae3c2e95e8d6b3dec6ded42eea460f40491 WatchSource:0}: Error finding container c9d0be8180d1aa28cb537f3fd6cc2ae3c2e95e8d6b3dec6ded42eea460f40491: Status 404 returned error can't find the container with id c9d0be8180d1aa28cb537f3fd6cc2ae3c2e95e8d6b3dec6ded42eea460f40491
Sep 15 11:55:45.298413 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:45.298381    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8" event={"ID":"0a83c2f7-fa7c-477d-a471-5b52c481636b","Type":"ContainerStarted","Data":"c9d0be8180d1aa28cb537f3fd6cc2ae3c2e95e8d6b3dec6ded42eea460f40491"}
Sep 15 11:55:46.304712 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:46.304680    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8" event={"ID":"0a83c2f7-fa7c-477d-a471-5b52c481636b","Type":"ContainerStarted","Data":"10557ae3de2d03a18341b47f2a466fe226b582116d21156dc81a50e20b04f7b8"}
Sep 15 11:55:46.305142 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:46.304798    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:55:46.321603 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:46.321555    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8" podStartSLOduration=2.985569542 podStartE2EDuration="3.321539604s" totalImagesPullingTime="335.970062ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:55:46.321290281 +0000 UTC m=+1108.572847339" watchObservedRunningTime="2026-09-15 11:55:46.321539604 +0000 UTC m=+1108.573096677"
Sep 15 11:55:47.803381 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:47.803344    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:55:52.316441 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:55:52.316409    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 11:56:06.173674 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:06.173635    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:06.719595 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:06.719547    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:07.389225 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:07.389191    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:07.668382 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:07.668291    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:08.016253 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:08.016210    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:08.215421 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:08.215379    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:08.376070 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:08.375965    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:08.758460 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:08.758430    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:11.173253 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:11.173221    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:11.810276 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:11.810228    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:11.931667 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:11.931635    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:12.046634 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:12.046603    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:12.864603 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:12.864553    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:13.667837 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:13.667798    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:14.216034 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.216002    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"]
Sep 15 11:56:14.219976 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.219954    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.222634 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.222610    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w1-d2de76-serving-cert\""
Sep 15 11:56:14.229122 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.229097    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"]
Sep 15 11:56:14.242346 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.242322    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:14.246588 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.246562    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lc6t\" (UniqueName: \"kubernetes.io/projected/d5b876cb-22d3-48d8-9445-01999cdc8573-kube-api-access-5lc6t\") pod \"maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.246709 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.246675    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.246765 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.246720    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.246983 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.246961    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5b876cb-22d3-48d8-9445-01999cdc8573-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.339274 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.339244    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:14.347582 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.347559    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.347690 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.347597    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.347690 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.347653    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5b876cb-22d3-48d8-9445-01999cdc8573-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.347690 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.347679    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lc6t\" (UniqueName: \"kubernetes.io/projected/d5b876cb-22d3-48d8-9445-01999cdc8573-kube-api-access-5lc6t\") pod \"maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.347812 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:56:14.347770    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-serving-cert: secret "maas-api-e2e-shared-b-w1-d2de76-serving-cert" not found
Sep 15 11:56:14.347860 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:56:14.347847    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-maas-api-tls podName:d5b876cb-22d3-48d8-9445-01999cdc8573 nodeName:}" failed. No retries permitted until 2026-09-15 11:56:14.847825639 +0000 UTC m=+1137.099382696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-maas-api-tls") pod "maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28" (UID: "d5b876cb-22d3-48d8-9445-01999cdc8573") : secret "maas-api-e2e-shared-b-w1-d2de76-serving-cert" not found
Sep 15 11:56:14.348382 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.348361    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5b876cb-22d3-48d8-9445-01999cdc8573-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.350090 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.350069    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.355925 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.355900    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lc6t\" (UniqueName: \"kubernetes.io/projected/d5b876cb-22d3-48d8-9445-01999cdc8573-kube-api-access-5lc6t\") pod \"maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.778441 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.778384    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:14.853193 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.853138    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.855709 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.855684    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:14.867252 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.867223    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:14.949320 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:14.949288    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:15.132776 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:15.132691    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:15.405931 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:15.405902    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"]
Sep 15 11:56:15.407794 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:56:15.407770    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b876cb_22d3_48d8_9445_01999cdc8573.slice/crio-770db294153040e4f43e06f260741944e5ce1678805c5792236220159ef0fd24 WatchSource:0}: Error finding container 770db294153040e4f43e06f260741944e5ce1678805c5792236220159ef0fd24: Status 404 returned error can't find the container with id 770db294153040e4f43e06f260741944e5ce1678805c5792236220159ef0fd24
Sep 15 11:56:15.463571 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:15.463535    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28" event={"ID":"d5b876cb-22d3-48d8-9445-01999cdc8573","Type":"ContainerStarted","Data":"770db294153040e4f43e06f260741944e5ce1678805c5792236220159ef0fd24"}
Sep 15 11:56:16.471783 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:16.471748    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28" event={"ID":"d5b876cb-22d3-48d8-9445-01999cdc8573","Type":"ContainerStarted","Data":"79ce20ced60a1453e28543270774ff3c99be98af0ca0ca60df44a931917f09ee"}
Sep 15 11:56:16.472180 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:16.471814    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:16.490633 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:16.490575    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28" podStartSLOduration=1.8320123270000002 podStartE2EDuration="2.490561246s" totalImagesPullingTime="658.548919ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:56:16.488964792 +0000 UTC m=+1138.740521851" watchObservedRunningTime="2026-09-15 11:56:16.490561246 +0000 UTC m=+1138.742118304"
Sep 15 11:56:22.485728 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:22.485695    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 11:56:36.322216 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:36.322179    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:36.959583 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:36.959551    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:37.112408 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:37.112378    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:37.819552 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:37.819521    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:38.513115 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:38.513082    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:38.661375 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:38.661339    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:39.444197 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:39.444146    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:45.932761 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:45.932691    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:46.314380 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:46.314348    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:46.610012 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:46.609929    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:48.870732 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:48.870689    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:49.080650 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:49.080618    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:49.182369 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:49.182288    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:49.640122 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:49.640087    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:50.404543 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:50.404505    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:51.403092 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:51.403059    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:52.021650 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.021621    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"]
Sep 15 11:56:52.029600 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.029577    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.036793 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.035397    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-cc429a8e-serving-cert\""
Sep 15 11:56:52.045209 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.045180    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"]
Sep 15 11:56:52.065533 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.065503    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:52.133585 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.133547    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4mm9\" (UniqueName: \"kubernetes.io/projected/f0982b88-4a3d-4d11-94c2-5a7bf4369844-kube-api-access-h4mm9\") pod \"maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.133585 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.133588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-metrics-certs\") pod \"maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.133826 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.133626    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0982b88-4a3d-4d11-94c2-5a7bf4369844-openshift-service-ca\") pod \"maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.133826 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.133661    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-maas-api-tls\") pod \"maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.166648 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.166616    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:52.234990 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.234955    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4mm9\" (UniqueName: \"kubernetes.io/projected/f0982b88-4a3d-4d11-94c2-5a7bf4369844-kube-api-access-h4mm9\") pod \"maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.235221 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.234991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-metrics-certs\") pod \"maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.235221 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.235120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0982b88-4a3d-4d11-94c2-5a7bf4369844-openshift-service-ca\") pod \"maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.235221 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.235191    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-maas-api-tls\") pod \"maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.235398 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:56:52.235329    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-serving-cert: secret "maas-api-e2e-mt-cc429a8e-serving-cert" not found
Sep 15 11:56:52.235435 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:56:52.235415    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-maas-api-tls podName:f0982b88-4a3d-4d11-94c2-5a7bf4369844 nodeName:}" failed. No retries permitted until 2026-09-15 11:56:52.735392816 +0000 UTC m=+1174.986949857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-maas-api-tls") pod "maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj" (UID: "f0982b88-4a3d-4d11-94c2-5a7bf4369844") : secret "maas-api-e2e-mt-cc429a8e-serving-cert" not found
Sep 15 11:56:52.235743 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.235725    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0982b88-4a3d-4d11-94c2-5a7bf4369844-openshift-service-ca\") pod \"maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.237520 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.237501    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-metrics-certs\") pod \"maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.243232 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.243211    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4mm9\" (UniqueName: \"kubernetes.io/projected/f0982b88-4a3d-4d11-94c2-5a7bf4369844-kube-api-access-h4mm9\") pod \"maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.488740 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.488710    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:52.588306 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.588272    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:52.617592 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.617555    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"]
Sep 15 11:56:52.621452 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.621432    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"
Sep 15 11:56:52.624347 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.624313    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-cc429a8e\""
Sep 15 11:56:52.624472 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.624393    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-cc429a8e-dockercfg-mpwsj\""
Sep 15 11:56:52.629817 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.629792    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"]
Sep 15 11:56:52.639653 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.639625    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp\" (UID: \"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"
Sep 15 11:56:52.639771 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.639696    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcjxq\" (UniqueName: \"kubernetes.io/projected/67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14-kube-api-access-wcjxq\") pod \"payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp\" (UID: \"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"
Sep 15 11:56:52.653444 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.653423    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"]
Sep 15 11:56:52.656932 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.656906    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:56:52.657055 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.657038    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"
Sep 15 11:56:52.668406 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.668376    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"]
Sep 15 11:56:52.740593 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.740510    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-maas-api-tls\") pod \"maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.740593 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.740564    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp\" (UID: \"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"
Sep 15 11:56:52.740843 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.740600    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b070e864-e1ee-4e4c-9144-5985f158cb61-plugins-config-volume\") pod \"payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw\" (UID: \"b070e864-e1ee-4e4c-9144-5985f158cb61\") " pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"
Sep 15 11:56:52.740843 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.740643    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcjxq\" (UniqueName: \"kubernetes.io/projected/67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14-kube-api-access-wcjxq\") pod \"payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp\" (UID: \"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"
Sep 15 11:56:52.740843 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.740674    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s79gw\" (UniqueName: \"kubernetes.io/projected/b070e864-e1ee-4e4c-9144-5985f158cb61-kube-api-access-s79gw\") pod \"payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw\" (UID: \"b070e864-e1ee-4e4c-9144-5985f158cb61\") " pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"
Sep 15 11:56:52.741324 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.741306    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp\" (UID: \"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"
Sep 15 11:56:52.742999 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.742981    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-maas-api-tls\") pod \"maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.749035 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.749008    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcjxq\" (UniqueName: \"kubernetes.io/projected/67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14-kube-api-access-wcjxq\") pod \"payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp\" (UID: \"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"
Sep 15 11:56:52.841663 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.841624    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b070e864-e1ee-4e4c-9144-5985f158cb61-plugins-config-volume\") pod \"payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw\" (UID: \"b070e864-e1ee-4e4c-9144-5985f158cb61\") " pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"
Sep 15 11:56:52.841841 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.841800    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s79gw\" (UniqueName: \"kubernetes.io/projected/b070e864-e1ee-4e4c-9144-5985f158cb61-kube-api-access-s79gw\") pod \"payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw\" (UID: \"b070e864-e1ee-4e4c-9144-5985f158cb61\") " pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"
Sep 15 11:56:52.842395 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.842375    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b070e864-e1ee-4e4c-9144-5985f158cb61-plugins-config-volume\") pod \"payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw\" (UID: \"b070e864-e1ee-4e4c-9144-5985f158cb61\") " pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"
Sep 15 11:56:52.852118 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.852097    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s79gw\" (UniqueName: \"kubernetes.io/projected/b070e864-e1ee-4e4c-9144-5985f158cb61-kube-api-access-s79gw\") pod \"payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw\" (UID: \"b070e864-e1ee-4e4c-9144-5985f158cb61\") " pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"
Sep 15 11:56:52.934344 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.934310    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"
Sep 15 11:56:52.953599 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.953576    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:52.967765 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:52.967738    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"
Sep 15 11:56:53.215557 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.215472    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"]
Sep 15 11:56:53.218481 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:56:53.218444    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b2aa8d_4df4_4c0f_8e1d_41fb56e2dc14.slice/crio-946bb8f2181d4f02c515a11061f1fe3400ab716a4ad9cd5f615f907b8c4e6b73 WatchSource:0}: Error finding container 946bb8f2181d4f02c515a11061f1fe3400ab716a4ad9cd5f615f907b8c4e6b73: Status 404 returned error can't find the container with id 946bb8f2181d4f02c515a11061f1fe3400ab716a4ad9cd5f615f907b8c4e6b73
Sep 15 11:56:53.251666 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.251629    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"]
Sep 15 11:56:53.252850 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:56:53.252812    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0982b88_4a3d_4d11_94c2_5a7bf4369844.slice/crio-e93dd32a2589cfd7e1e2f423cf425dd18e3acbcd159d963114ad79c48ad9b72b WatchSource:0}: Error finding container e93dd32a2589cfd7e1e2f423cf425dd18e3acbcd159d963114ad79c48ad9b72b: Status 404 returned error can't find the container with id e93dd32a2589cfd7e1e2f423cf425dd18e3acbcd159d963114ad79c48ad9b72b
Sep 15 11:56:53.259602 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.259576    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"]
Sep 15 11:56:53.261791 ip-10-0-141-110 kubenswrapper[2571]: W0915 11:56:53.261766    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb070e864_e1ee_4e4c_9144_5985f158cb61.slice/crio-822e66d69f0d5109a5f6736afa1a60694753ecc240111fabbb859819a14d759d WatchSource:0}: Error finding container 822e66d69f0d5109a5f6736afa1a60694753ecc240111fabbb859819a14d759d: Status 404 returned error can't find the container with id 822e66d69f0d5109a5f6736afa1a60694753ecc240111fabbb859819a14d759d
Sep 15 11:56:53.676549 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.676510    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw" event={"ID":"b070e864-e1ee-4e4c-9144-5985f158cb61","Type":"ContainerStarted","Data":"e41732a6d11fdee99271ede1fa6dae83739f22d36467b30ed68051b9cd183c6a"}
Sep 15 11:56:53.676708 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.676673    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"
Sep 15 11:56:53.676802 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.676705    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw" event={"ID":"b070e864-e1ee-4e4c-9144-5985f158cb61","Type":"ContainerStarted","Data":"822e66d69f0d5109a5f6736afa1a60694753ecc240111fabbb859819a14d759d"}
Sep 15 11:56:53.678446 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.678421    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj" event={"ID":"f0982b88-4a3d-4d11-94c2-5a7bf4369844","Type":"ContainerStarted","Data":"c9bc9491b68c9f0239f6ed372ea83955b3640077f6f7db7bb39ce3270c587eca"}
Sep 15 11:56:53.678560 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.678469    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj" event={"ID":"f0982b88-4a3d-4d11-94c2-5a7bf4369844","Type":"ContainerStarted","Data":"e93dd32a2589cfd7e1e2f423cf425dd18e3acbcd159d963114ad79c48ad9b72b"}
Sep 15 11:56:53.678809 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.678749    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:56:53.680289 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.680264    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp" event={"ID":"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14","Type":"ContainerStarted","Data":"75116460b12b3de6b33b338e1d801fe3f8e2a09c69dd135333feb36d223a6dea"}
Sep 15 11:56:53.680407 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.680304    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp" event={"ID":"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14","Type":"ContainerStarted","Data":"946bb8f2181d4f02c515a11061f1fe3400ab716a4ad9cd5f615f907b8c4e6b73"}
Sep 15 11:56:53.680407 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.680352    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"
Sep 15 11:56:53.693177 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.693112    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw" podStartSLOduration=1.693097106 podStartE2EDuration="1.693097106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:56:53.692011318 +0000 UTC m=+1175.943568378" watchObservedRunningTime="2026-09-15 11:56:53.693097106 +0000 UTC m=+1175.944654160"
Sep 15 11:56:53.707948 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.707906    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp" podStartSLOduration=1.7078899939999999 podStartE2EDuration="1.707889994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:56:53.707616595 +0000 UTC m=+1175.959173651" watchObservedRunningTime="2026-09-15 11:56:53.707889994 +0000 UTC m=+1175.959447050"
Sep 15 11:56:53.726067 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:53.726026    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj" podStartSLOduration=1.392658715 podStartE2EDuration="1.726012039s" totalImagesPullingTime="333.353324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 11:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 11:56:53.723183218 +0000 UTC m=+1175.974740280" watchObservedRunningTime="2026-09-15 11:56:53.726012039 +0000 UTC m=+1175.977569119"
Sep 15 11:56:59.692034 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:56:59.692004    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:57:04.688922 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:04.688890    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"
Sep 15 11:57:04.689343 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:04.688968    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"
Sep 15 11:57:14.176365 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:14.176313    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:14.516318 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:14.516280    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:15.392111 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:15.391987    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:18.054346 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:18.054309    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:18.247165 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:18.247129    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 11:57:18.250913 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:18.250889    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 11:57:18.473614 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:18.473585    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:19.609413 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:19.609379    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:21.601043 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:21.601000    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:26.278412 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:26.278372    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:36.394389 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:36.394357    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:54.873786 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:54.873751    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:55.413494 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:55.413459    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:56.042671 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:56.042638    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:56.813995 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:56.813955    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:57.499898 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:57.499867    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:57:58.317333 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:57:58.317302    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:09.633603 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:09.633562    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"]
Sep 15 11:58:09.634070 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:09.633821    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj" podUID="f0982b88-4a3d-4d11-94c2-5a7bf4369844" containerName="maas-api" containerID="cri-o://c9bc9491b68c9f0239f6ed372ea83955b3640077f6f7db7bb39ce3270c587eca" gracePeriod=30
Sep 15 11:58:09.660964 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:09.660929    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:09.688263 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:09.687744    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj" podUID="f0982b88-4a3d-4d11-94c2-5a7bf4369844" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.68:8443/health\": dial tcp 10.134.0.68:8443: connect: connection refused"
Sep 15 11:58:09.691795 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:09.691765    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"]
Sep 15 11:58:09.692016 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:09.691988    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw" podUID="b070e864-e1ee-4e4c-9144-5985f158cb61" containerName="payload-processing" containerID="cri-o://e41732a6d11fdee99271ede1fa6dae83739f22d36467b30ed68051b9cd183c6a" gracePeriod=30
Sep 15 11:58:09.700940 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:09.700919    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"]
Sep 15 11:58:09.701244 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:09.701135    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp" podUID="67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14" containerName="payload-pre-processing" containerID="cri-o://75116460b12b3de6b33b338e1d801fe3f8e2a09c69dd135333feb36d223a6dea" gracePeriod=30
Sep 15 11:58:09.741129 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:09.741091    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:09.818672 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:09.818640    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:09.887074 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:09.886999    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:10.003813 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.003786    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:58:10.007967 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.007948    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"
Sep 15 11:58:10.017312 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.017282    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"
Sep 15 11:58:10.112115 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.112084    2571 generic.go:356] "Generic (PLEG): container finished" podID="b070e864-e1ee-4e4c-9144-5985f158cb61" containerID="e41732a6d11fdee99271ede1fa6dae83739f22d36467b30ed68051b9cd183c6a" exitCode=0
Sep 15 11:58:10.112327 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.112123    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"
Sep 15 11:58:10.112327 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.112192    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw" event={"ID":"b070e864-e1ee-4e4c-9144-5985f158cb61","Type":"ContainerDied","Data":"e41732a6d11fdee99271ede1fa6dae83739f22d36467b30ed68051b9cd183c6a"}
Sep 15 11:58:10.112327 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.112252    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw" event={"ID":"b070e864-e1ee-4e4c-9144-5985f158cb61","Type":"ContainerDied","Data":"822e66d69f0d5109a5f6736afa1a60694753ecc240111fabbb859819a14d759d"}
Sep 15 11:58:10.112327 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.112285    2571 scope.go:117] "RemoveContainer" containerID="e41732a6d11fdee99271ede1fa6dae83739f22d36467b30ed68051b9cd183c6a"
Sep 15 11:58:10.114027 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.113865    2571 generic.go:356] "Generic (PLEG): container finished" podID="f0982b88-4a3d-4d11-94c2-5a7bf4369844" containerID="c9bc9491b68c9f0239f6ed372ea83955b3640077f6f7db7bb39ce3270c587eca" exitCode=0
Sep 15 11:58:10.114027 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.113923    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"
Sep 15 11:58:10.114027 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.113945    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj" event={"ID":"f0982b88-4a3d-4d11-94c2-5a7bf4369844","Type":"ContainerDied","Data":"c9bc9491b68c9f0239f6ed372ea83955b3640077f6f7db7bb39ce3270c587eca"}
Sep 15 11:58:10.114027 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.113986    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj" event={"ID":"f0982b88-4a3d-4d11-94c2-5a7bf4369844","Type":"ContainerDied","Data":"e93dd32a2589cfd7e1e2f423cf425dd18e3acbcd159d963114ad79c48ad9b72b"}
Sep 15 11:58:10.116630 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.116215    2571 generic.go:356] "Generic (PLEG): container finished" podID="67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14" containerID="75116460b12b3de6b33b338e1d801fe3f8e2a09c69dd135333feb36d223a6dea" exitCode=0
Sep 15 11:58:10.116630 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.116307    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp" event={"ID":"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14","Type":"ContainerDied","Data":"75116460b12b3de6b33b338e1d801fe3f8e2a09c69dd135333feb36d223a6dea"}
Sep 15 11:58:10.116630 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.116343    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp" event={"ID":"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14","Type":"ContainerDied","Data":"946bb8f2181d4f02c515a11061f1fe3400ab716a4ad9cd5f615f907b8c4e6b73"}
Sep 15 11:58:10.116630 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.116397    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"
Sep 15 11:58:10.123969 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.123949    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14-plugins-config-volume\") pod \"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14\" (UID: \"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14\") "
Sep 15 11:58:10.124080 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.123980    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0982b88-4a3d-4d11-94c2-5a7bf4369844-openshift-service-ca\") pod \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") "
Sep 15 11:58:10.124080 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.124034    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-maas-api-tls\") pod \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") "
Sep 15 11:58:10.124190 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.124085    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b070e864-e1ee-4e4c-9144-5985f158cb61-plugins-config-volume\") pod \"b070e864-e1ee-4e4c-9144-5985f158cb61\" (UID: \"b070e864-e1ee-4e4c-9144-5985f158cb61\") "
Sep 15 11:58:10.124190 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.124128    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcjxq\" (UniqueName: \"kubernetes.io/projected/67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14-kube-api-access-wcjxq\") pod \"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14\" (UID: \"67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14\") "
Sep 15 11:58:10.124262 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.124188    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s79gw\" (UniqueName: \"kubernetes.io/projected/b070e864-e1ee-4e4c-9144-5985f158cb61-kube-api-access-s79gw\") pod \"b070e864-e1ee-4e4c-9144-5985f158cb61\" (UID: \"b070e864-e1ee-4e4c-9144-5985f158cb61\") "
Sep 15 11:58:10.124262 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.124254    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-metrics-certs\") pod \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") "
Sep 15 11:58:10.124340 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.124303    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4mm9\" (UniqueName: \"kubernetes.io/projected/f0982b88-4a3d-4d11-94c2-5a7bf4369844-kube-api-access-h4mm9\") pod \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\" (UID: \"f0982b88-4a3d-4d11-94c2-5a7bf4369844\") "
Sep 15 11:58:10.124450 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.124426    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0982b88-4a3d-4d11-94c2-5a7bf4369844-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0982b88-4a3d-4d11-94c2-5a7bf4369844" (UID: "f0982b88-4a3d-4d11-94c2-5a7bf4369844"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:58:10.124496 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.124472    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14" (UID: "67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:58:10.124726 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.124706    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:58:10.124816 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.124730    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0982b88-4a3d-4d11-94c2-5a7bf4369844-openshift-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:58:10.125950 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.125911    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b070e864-e1ee-4e4c-9144-5985f158cb61-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b070e864-e1ee-4e4c-9144-5985f158cb61" (UID: "b070e864-e1ee-4e4c-9144-5985f158cb61"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 11:58:10.127007 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.126637    2571 scope.go:117] "RemoveContainer" containerID="e41732a6d11fdee99271ede1fa6dae83739f22d36467b30ed68051b9cd183c6a"
Sep 15 11:58:10.127007 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.126972    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14-kube-api-access-wcjxq" (OuterVolumeSpecName: "kube-api-access-wcjxq") pod "67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14" (UID: "67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14"). InnerVolumeSpecName "kube-api-access-wcjxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:10.127138 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.127047    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b070e864-e1ee-4e4c-9144-5985f158cb61-kube-api-access-s79gw" (OuterVolumeSpecName: "kube-api-access-s79gw") pod "b070e864-e1ee-4e4c-9144-5985f158cb61" (UID: "b070e864-e1ee-4e4c-9144-5985f158cb61"). InnerVolumeSpecName "kube-api-access-s79gw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:10.127138 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.127087    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0982b88-4a3d-4d11-94c2-5a7bf4369844-kube-api-access-h4mm9" (OuterVolumeSpecName: "kube-api-access-h4mm9") pod "f0982b88-4a3d-4d11-94c2-5a7bf4369844" (UID: "f0982b88-4a3d-4d11-94c2-5a7bf4369844"). InnerVolumeSpecName "kube-api-access-h4mm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 11:58:10.127138 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:58:10.127117    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e41732a6d11fdee99271ede1fa6dae83739f22d36467b30ed68051b9cd183c6a\": container with ID starting with e41732a6d11fdee99271ede1fa6dae83739f22d36467b30ed68051b9cd183c6a not found: ID does not exist" containerID="e41732a6d11fdee99271ede1fa6dae83739f22d36467b30ed68051b9cd183c6a"
Sep 15 11:58:10.127281 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.127217    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e41732a6d11fdee99271ede1fa6dae83739f22d36467b30ed68051b9cd183c6a"} err="failed to get container status \"e41732a6d11fdee99271ede1fa6dae83739f22d36467b30ed68051b9cd183c6a\": rpc error: code = NotFound desc = could not find container \"e41732a6d11fdee99271ede1fa6dae83739f22d36467b30ed68051b9cd183c6a\": container with ID starting with e41732a6d11fdee99271ede1fa6dae83739f22d36467b30ed68051b9cd183c6a not found: ID does not exist"
Sep 15 11:58:10.127281 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.127243    2571 scope.go:117] "RemoveContainer" containerID="c9bc9491b68c9f0239f6ed372ea83955b3640077f6f7db7bb39ce3270c587eca"
Sep 15 11:58:10.127397 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.127377    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f0982b88-4a3d-4d11-94c2-5a7bf4369844" (UID: "f0982b88-4a3d-4d11-94c2-5a7bf4369844"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:58:10.127850 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.127807    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0982b88-4a3d-4d11-94c2-5a7bf4369844" (UID: "f0982b88-4a3d-4d11-94c2-5a7bf4369844"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 11:58:10.137776 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.137754    2571 scope.go:117] "RemoveContainer" containerID="c9bc9491b68c9f0239f6ed372ea83955b3640077f6f7db7bb39ce3270c587eca"
Sep 15 11:58:10.138110 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:58:10.138090    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9bc9491b68c9f0239f6ed372ea83955b3640077f6f7db7bb39ce3270c587eca\": container with ID starting with c9bc9491b68c9f0239f6ed372ea83955b3640077f6f7db7bb39ce3270c587eca not found: ID does not exist" containerID="c9bc9491b68c9f0239f6ed372ea83955b3640077f6f7db7bb39ce3270c587eca"
Sep 15 11:58:10.138207 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.138117    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9bc9491b68c9f0239f6ed372ea83955b3640077f6f7db7bb39ce3270c587eca"} err="failed to get container status \"c9bc9491b68c9f0239f6ed372ea83955b3640077f6f7db7bb39ce3270c587eca\": rpc error: code = NotFound desc = could not find container \"c9bc9491b68c9f0239f6ed372ea83955b3640077f6f7db7bb39ce3270c587eca\": container with ID starting with c9bc9491b68c9f0239f6ed372ea83955b3640077f6f7db7bb39ce3270c587eca not found: ID does not exist"
Sep 15 11:58:10.138207 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.138136    2571 scope.go:117] "RemoveContainer" containerID="75116460b12b3de6b33b338e1d801fe3f8e2a09c69dd135333feb36d223a6dea"
Sep 15 11:58:10.146051 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.146029    2571 scope.go:117] "RemoveContainer" containerID="75116460b12b3de6b33b338e1d801fe3f8e2a09c69dd135333feb36d223a6dea"
Sep 15 11:58:10.146331 ip-10-0-141-110 kubenswrapper[2571]: E0915 11:58:10.146314    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75116460b12b3de6b33b338e1d801fe3f8e2a09c69dd135333feb36d223a6dea\": container with ID starting with 75116460b12b3de6b33b338e1d801fe3f8e2a09c69dd135333feb36d223a6dea not found: ID does not exist" containerID="75116460b12b3de6b33b338e1d801fe3f8e2a09c69dd135333feb36d223a6dea"
Sep 15 11:58:10.146399 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.146336    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75116460b12b3de6b33b338e1d801fe3f8e2a09c69dd135333feb36d223a6dea"} err="failed to get container status \"75116460b12b3de6b33b338e1d801fe3f8e2a09c69dd135333feb36d223a6dea\": rpc error: code = NotFound desc = could not find container \"75116460b12b3de6b33b338e1d801fe3f8e2a09c69dd135333feb36d223a6dea\": container with ID starting with 75116460b12b3de6b33b338e1d801fe3f8e2a09c69dd135333feb36d223a6dea not found: ID does not exist"
Sep 15 11:58:10.225448 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.225420    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4mm9\" (UniqueName: \"kubernetes.io/projected/f0982b88-4a3d-4d11-94c2-5a7bf4369844-kube-api-access-h4mm9\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:58:10.225553 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.225453    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-maas-api-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:58:10.225553 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.225469    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b070e864-e1ee-4e4c-9144-5985f158cb61-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:58:10.225553 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.225485    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcjxq\" (UniqueName: \"kubernetes.io/projected/67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14-kube-api-access-wcjxq\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:58:10.225553 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.225500    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s79gw\" (UniqueName: \"kubernetes.io/projected/b070e864-e1ee-4e4c-9144-5985f158cb61-kube-api-access-s79gw\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:58:10.225553 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.225514    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0982b88-4a3d-4d11-94c2-5a7bf4369844-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 11:58:10.306709 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.306667    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:10.429321 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.429225    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"]
Sep 15 11:58:10.431829 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.431753    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-cc429a8e-5bf49cc7b5-5nfqw"]
Sep 15 11:58:10.441499 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.441473    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"]
Sep 15 11:58:10.445256 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.445234    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-cc429a8e-6647864b9b-qz5sj"]
Sep 15 11:58:10.455445 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.455423    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"]
Sep 15 11:58:10.460955 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.460932    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cc429a8e-5c57f5b8b-7x7qp"]
Sep 15 11:58:10.865409 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:10.865375    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:11.617512 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:11.617473    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:12.214990 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:12.214946    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14" path="/var/lib/kubelet/pods/67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14/volumes"
Sep 15 11:58:12.215476 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:12.215363    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b070e864-e1ee-4e4c-9144-5985f158cb61" path="/var/lib/kubelet/pods/b070e864-e1ee-4e4c-9144-5985f158cb61/volumes"
Sep 15 11:58:12.215716 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:12.215701    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0982b88-4a3d-4d11-94c2-5a7bf4369844" path="/var/lib/kubelet/pods/f0982b88-4a3d-4d11-94c2-5a7bf4369844/volumes"
Sep 15 11:58:12.417304 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:12.417262    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:13.198877 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:13.198841    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:13.299017 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:13.298985    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:18.356963 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:18.356928    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:26.333715 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:26.333682    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:42.980542 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:42.980510    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:46.233556 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:46.233520    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:54.589496 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:54.589462    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:55.869792 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:55.869755    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:58:56.351010 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:58:56.350970    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:01.855859 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:01.855819    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:01.922064 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:01.922025    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:02.115879 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:02.115797    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:03.476247 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:03.476214    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:03.574851 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:03.574815    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:03.683367 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:03.683329    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:04.463466 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:04.463428    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:04.569614 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:04.569581    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:06.062801 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:06.062768    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:09.401494 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:09.401451    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:12.076669 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:12.076635    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:12.177535 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:12.177500    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:12.762544 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:12.762509    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:13.893617 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:13.893584    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:18.902656 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:18.902613    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:19.008009 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:19.007973    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:19.104285 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:19.104253    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:19.940786 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:19.940753    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:29.593419 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:29.593375    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:29.831954 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:29.831920    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:36.042329 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:36.042294    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:36.103485 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:36.103459    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:39.493882 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:39.493845    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:40.268822 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:40.268775    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:50.784858 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:50.784816    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:56.942903 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:56.942863    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:57.043742 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:57.043713    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:57.307665 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:57.307633    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:57.651075 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:57.650998    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:58.013198 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:58.013165    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 11:59:58.116109 ip-10-0-141-110 kubenswrapper[2571]: I0915 11:59:58.116076    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:00.417987 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:00.417958    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:01.158383 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:01.158354    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:01.303128 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:01.303094    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:02.093015 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:02.092975    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:03.127719 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:03.127683    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:03.818672 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:03.818622    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:04.489853 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.489814    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"]
Sep 15 12:00:04.490307 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.490292    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0982b88-4a3d-4d11-94c2-5a7bf4369844" containerName="maas-api"
Sep 15 12:00:04.490307 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.490308    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0982b88-4a3d-4d11-94c2-5a7bf4369844" containerName="maas-api"
Sep 15 12:00:04.490402 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.490322    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14" containerName="payload-pre-processing"
Sep 15 12:00:04.490402 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.490328    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14" containerName="payload-pre-processing"
Sep 15 12:00:04.490402 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.490345    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b070e864-e1ee-4e4c-9144-5985f158cb61" containerName="payload-processing"
Sep 15 12:00:04.490402 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.490351    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b070e864-e1ee-4e4c-9144-5985f158cb61" containerName="payload-processing"
Sep 15 12:00:04.490525 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.490427    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="67b2aa8d-4df4-4c0f-8e1d-41fb56e2dc14" containerName="payload-pre-processing"
Sep 15 12:00:04.490525 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.490435    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b070e864-e1ee-4e4c-9144-5985f158cb61" containerName="payload-processing"
Sep 15 12:00:04.490525 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.490442    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0982b88-4a3d-4d11-94c2-5a7bf4369844" containerName="maas-api"
Sep 15 12:00:04.493842 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.493825    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:04.496852 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.496827    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-a1650b-serving-cert\""
Sep 15 12:00:04.503879 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.503853    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"]
Sep 15 12:00:04.554296 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.554261    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/842cae86-09a6-473b-ac86-b9a8c357f737-openshift-service-ca\") pod \"maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:04.554461 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.554320    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dhvn\" (UniqueName: \"kubernetes.io/projected/842cae86-09a6-473b-ac86-b9a8c357f737-kube-api-access-6dhvn\") pod \"maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:04.554461 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.554416    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-metrics-certs\") pod \"maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:04.554461 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.554459    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-maas-api-tls\") pod \"maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:04.655629 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.655596    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-metrics-certs\") pod \"maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:04.655810 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.655639    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-maas-api-tls\") pod \"maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:04.655810 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.655719    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/842cae86-09a6-473b-ac86-b9a8c357f737-openshift-service-ca\") pod \"maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:04.655810 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.655751    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dhvn\" (UniqueName: \"kubernetes.io/projected/842cae86-09a6-473b-ac86-b9a8c357f737-kube-api-access-6dhvn\") pod \"maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:04.655915 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:00:04.655802    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-serving-cert: secret "maas-api-e2e-api-a-a1650b-serving-cert" not found
Sep 15 12:00:04.655915 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:00:04.655888    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-maas-api-tls podName:842cae86-09a6-473b-ac86-b9a8c357f737 nodeName:}" failed. No retries permitted until 2026-09-15 12:00:05.15586537 +0000 UTC m=+1367.407422409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-maas-api-tls") pod "maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm" (UID: "842cae86-09a6-473b-ac86-b9a8c357f737") : secret "maas-api-e2e-api-a-a1650b-serving-cert" not found
Sep 15 12:00:04.656448 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.656431    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/842cae86-09a6-473b-ac86-b9a8c357f737-openshift-service-ca\") pod \"maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:04.658037 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.658009    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-metrics-certs\") pod \"maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:04.664384 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.664365    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dhvn\" (UniqueName: \"kubernetes.io/projected/842cae86-09a6-473b-ac86-b9a8c357f737-kube-api-access-6dhvn\") pod \"maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:04.699768 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.699736    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:04.803855 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:04.803773    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:05.102885 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.102798    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"]
Sep 15 12:00:05.106871 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.106853    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"
Sep 15 12:00:05.109623 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.109599    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a1650b\""
Sep 15 12:00:05.116850 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.116769    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"]
Sep 15 12:00:05.128028 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.128005    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"]
Sep 15 12:00:05.131912 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.131891    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"
Sep 15 12:00:05.135790 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.135767    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-a1650b-dockercfg-ktgz8\""
Sep 15 12:00:05.142694 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.142670    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"]
Sep 15 12:00:05.160455 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.160429    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-maas-api-tls\") pod \"maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:05.160599 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.160493    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1a3b852-c2a1-4be9-89d7-33eecdcb8975-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7\" (UID: \"c1a3b852-c2a1-4be9-89d7-33eecdcb8975\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"
Sep 15 12:00:05.160599 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.160523    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzjfw\" (UniqueName: \"kubernetes.io/projected/c1a3b852-c2a1-4be9-89d7-33eecdcb8975-kube-api-access-zzjfw\") pod \"payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7\" (UID: \"c1a3b852-c2a1-4be9-89d7-33eecdcb8975\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"
Sep 15 12:00:05.163014 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.162990    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-maas-api-tls\") pod \"maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:05.177147 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.177100    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:05.261710 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.261676    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1a3b852-c2a1-4be9-89d7-33eecdcb8975-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7\" (UID: \"c1a3b852-c2a1-4be9-89d7-33eecdcb8975\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"
Sep 15 12:00:05.261924 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.261817    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzjfw\" (UniqueName: \"kubernetes.io/projected/c1a3b852-c2a1-4be9-89d7-33eecdcb8975-kube-api-access-zzjfw\") pod \"payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7\" (UID: \"c1a3b852-c2a1-4be9-89d7-33eecdcb8975\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"
Sep 15 12:00:05.261924 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.261920    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx6kz\" (UniqueName: \"kubernetes.io/projected/94ccd828-26dc-42bb-a41e-5c3335eeac60-kube-api-access-wx6kz\") pod \"payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs\" (UID: \"94ccd828-26dc-42bb-a41e-5c3335eeac60\") " pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"
Sep 15 12:00:05.262119 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.262038    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94ccd828-26dc-42bb-a41e-5c3335eeac60-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs\" (UID: \"94ccd828-26dc-42bb-a41e-5c3335eeac60\") " pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"
Sep 15 12:00:05.262653 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.262627    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1a3b852-c2a1-4be9-89d7-33eecdcb8975-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7\" (UID: \"c1a3b852-c2a1-4be9-89d7-33eecdcb8975\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"
Sep 15 12:00:05.270423 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.270400    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzjfw\" (UniqueName: \"kubernetes.io/projected/c1a3b852-c2a1-4be9-89d7-33eecdcb8975-kube-api-access-zzjfw\") pod \"payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7\" (UID: \"c1a3b852-c2a1-4be9-89d7-33eecdcb8975\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"
Sep 15 12:00:05.363383 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.363289    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx6kz\" (UniqueName: \"kubernetes.io/projected/94ccd828-26dc-42bb-a41e-5c3335eeac60-kube-api-access-wx6kz\") pod \"payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs\" (UID: \"94ccd828-26dc-42bb-a41e-5c3335eeac60\") " pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"
Sep 15 12:00:05.363383 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.363355    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94ccd828-26dc-42bb-a41e-5c3335eeac60-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs\" (UID: \"94ccd828-26dc-42bb-a41e-5c3335eeac60\") " pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"
Sep 15 12:00:05.364019 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.363999    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94ccd828-26dc-42bb-a41e-5c3335eeac60-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs\" (UID: \"94ccd828-26dc-42bb-a41e-5c3335eeac60\") " pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"
Sep 15 12:00:05.371320 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.371297    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx6kz\" (UniqueName: \"kubernetes.io/projected/94ccd828-26dc-42bb-a41e-5c3335eeac60-kube-api-access-wx6kz\") pod \"payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs\" (UID: \"94ccd828-26dc-42bb-a41e-5c3335eeac60\") " pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"
Sep 15 12:00:05.405083 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.405056    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:05.420453 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.420423    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"
Sep 15 12:00:05.445326 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.445290    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"
Sep 15 12:00:05.501567 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.501530    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:05.684022 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.683990    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"]
Sep 15 12:00:05.685393 ip-10-0-141-110 kubenswrapper[2571]: W0915 12:00:05.685366    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842cae86_09a6_473b_ac86_b9a8c357f737.slice/crio-d0132a6c01fa9dface62417dbe3c8adeb299c7f102f105656914acd51b96905f WatchSource:0}: Error finding container d0132a6c01fa9dface62417dbe3c8adeb299c7f102f105656914acd51b96905f: Status 404 returned error can't find the container with id d0132a6c01fa9dface62417dbe3c8adeb299c7f102f105656914acd51b96905f
Sep 15 12:00:05.686855 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.686834    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 12:00:05.708676 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.708649    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"]
Sep 15 12:00:05.710473 ip-10-0-141-110 kubenswrapper[2571]: W0915 12:00:05.710452    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a3b852_c2a1_4be9_89d7_33eecdcb8975.slice/crio-c2230df75c80570f33c417a9981077561494bc48c20c1f6b4552c0f021a2a8bc WatchSource:0}: Error finding container c2230df75c80570f33c417a9981077561494bc48c20c1f6b4552c0f021a2a8bc: Status 404 returned error can't find the container with id c2230df75c80570f33c417a9981077561494bc48c20c1f6b4552c0f021a2a8bc
Sep 15 12:00:05.746848 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.746822    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"]
Sep 15 12:00:05.757634 ip-10-0-141-110 kubenswrapper[2571]: W0915 12:00:05.757512    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ccd828_26dc_42bb_a41e_5c3335eeac60.slice/crio-308bc755b3dfa3377fba7bfc083eab92de9539415c00be6af2b175528bdf38d9 WatchSource:0}: Error finding container 308bc755b3dfa3377fba7bfc083eab92de9539415c00be6af2b175528bdf38d9: Status 404 returned error can't find the container with id 308bc755b3dfa3377fba7bfc083eab92de9539415c00be6af2b175528bdf38d9
Sep 15 12:00:05.779233 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.779194    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs" event={"ID":"94ccd828-26dc-42bb-a41e-5c3335eeac60","Type":"ContainerStarted","Data":"308bc755b3dfa3377fba7bfc083eab92de9539415c00be6af2b175528bdf38d9"}
Sep 15 12:00:05.781796 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.781691    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7" event={"ID":"c1a3b852-c2a1-4be9-89d7-33eecdcb8975","Type":"ContainerStarted","Data":"c2230df75c80570f33c417a9981077561494bc48c20c1f6b4552c0f021a2a8bc"}
Sep 15 12:00:05.783421 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:05.783399    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm" event={"ID":"842cae86-09a6-473b-ac86-b9a8c357f737","Type":"ContainerStarted","Data":"d0132a6c01fa9dface62417dbe3c8adeb299c7f102f105656914acd51b96905f"}
Sep 15 12:00:06.792245 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:06.792205    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs" event={"ID":"94ccd828-26dc-42bb-a41e-5c3335eeac60","Type":"ContainerStarted","Data":"611df312e7c8a7eb0e1247475384dd3317c5807298124929573233c3747febf8"}
Sep 15 12:00:06.792698 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:06.792390    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"
Sep 15 12:00:06.793929 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:06.793900    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7" event={"ID":"c1a3b852-c2a1-4be9-89d7-33eecdcb8975","Type":"ContainerStarted","Data":"05d8f5054dde99fa1eb0b975f0b65530edcda6f655a6a6d7ae4396a5ca64b207"}
Sep 15 12:00:06.794087 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:06.793962    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"
Sep 15 12:00:06.795845 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:06.795823    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm" event={"ID":"842cae86-09a6-473b-ac86-b9a8c357f737","Type":"ContainerStarted","Data":"248ccae37c9325011182f90b78d9bd73f342f4b886256ea040bf6f794e0d8c2c"}
Sep 15 12:00:06.795960 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:06.795927    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:06.813522 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:06.813461    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs" podStartSLOduration=1.813447372 podStartE2EDuration="1.813447372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:00:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:00:06.812294416 +0000 UTC m=+1369.063851475" watchObservedRunningTime="2026-09-15 12:00:06.813447372 +0000 UTC m=+1369.065004428"
Sep 15 12:00:06.832748 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:06.832702    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm" podStartSLOduration=2.430544817 podStartE2EDuration="2.832688604s" totalImagesPullingTime="402.143787ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:00:06.830824698 +0000 UTC m=+1369.082381758" watchObservedRunningTime="2026-09-15 12:00:06.832688604 +0000 UTC m=+1369.084245664"
Sep 15 12:00:10.706721 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:10.706677    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:12.807321 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:12.807291    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:00:12.828615 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:12.828566    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7" podStartSLOduration=7.828548631 podStartE2EDuration="7.828548631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:00:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:00:06.850266083 +0000 UTC m=+1369.101823141" watchObservedRunningTime="2026-09-15 12:00:12.828548631 +0000 UTC m=+1375.080105726"
Sep 15 12:00:17.804383 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:17.804347    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"
Sep 15 12:00:17.804865 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:17.804492    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"
Sep 15 12:00:26.158652 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:26.158621    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:26.601912 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:26.601872    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:26.801317 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:26.801281    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:27.124098 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:27.124063    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:27.288484 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:27.288449    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:27.400615 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:27.400529    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:28.130049 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:28.130011    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:28.966509 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:28.966477    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:29.877343 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:29.877311    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:30.505072 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:30.505041    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:30.603587 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:30.603548    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:30.701551 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:30.701519    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:31.413387 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:31.413348    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:32.311806 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:32.311762    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:33.017218 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:33.017183    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:33.728125 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:33.728088    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:34.577121 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.577079    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"]
Sep 15 12:00:34.581428 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.581404    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:34.583980 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.583954    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-6b0cb9-serving-cert\""
Sep 15 12:00:34.591677 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.591650    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"]
Sep 15 12:00:34.611396 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.611365    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:34.669651 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.669617    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:34.675964 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.675936    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r5dc\" (UniqueName: \"kubernetes.io/projected/96403478-bc17-43e7-9ee4-38e701426018-kube-api-access-6r5dc\") pod \"maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:34.676071 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.676040    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-metrics-certs\") pod \"maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:34.676112 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.676073    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96403478-bc17-43e7-9ee4-38e701426018-openshift-service-ca\") pod \"maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:34.676168 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.676134    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-maas-api-tls\") pod \"maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:34.777526 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.777489    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-maas-api-tls\") pod \"maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:34.777993 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.777548    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r5dc\" (UniqueName: \"kubernetes.io/projected/96403478-bc17-43e7-9ee4-38e701426018-kube-api-access-6r5dc\") pod \"maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:34.777993 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.777610    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-metrics-certs\") pod \"maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:34.777993 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.777634    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96403478-bc17-43e7-9ee4-38e701426018-openshift-service-ca\") pod \"maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:34.777993 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:00:34.777670    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-serving-cert: secret "maas-api-e2e-api-b-6b0cb9-serving-cert" not found
Sep 15 12:00:34.777993 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:00:34.777805    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-maas-api-tls podName:96403478-bc17-43e7-9ee4-38e701426018 nodeName:}" failed. No retries permitted until 2026-09-15 12:00:35.277779614 +0000 UTC m=+1397.529336649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-maas-api-tls") pod "maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg" (UID: "96403478-bc17-43e7-9ee4-38e701426018") : secret "maas-api-e2e-api-b-6b0cb9-serving-cert" not found
Sep 15 12:00:34.778353 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.778335    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96403478-bc17-43e7-9ee4-38e701426018-openshift-service-ca\") pod \"maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:34.780107 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.780089    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-metrics-certs\") pod \"maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:34.786121 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:34.786100    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r5dc\" (UniqueName: \"kubernetes.io/projected/96403478-bc17-43e7-9ee4-38e701426018-kube-api-access-6r5dc\") pod \"maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:35.174560 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:35.174516    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:35.272617 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:35.272581    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:35.283171 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:35.283118    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-maas-api-tls\") pod \"maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:35.285851 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:35.285826    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-maas-api-tls\") pod \"maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:35.337200 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:35.337166    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:35.494876 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:35.494843    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:35.769198 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:35.769167    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"]
Sep 15 12:00:35.770992 ip-10-0-141-110 kubenswrapper[2571]: W0915 12:00:35.770964    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96403478_bc17_43e7_9ee4_38e701426018.slice/crio-6f6b0c449f40a252eec546db07ac1c364a58f00851f2ffd2f5f91f20f71dba4d WatchSource:0}: Error finding container 6f6b0c449f40a252eec546db07ac1c364a58f00851f2ffd2f5f91f20f71dba4d: Status 404 returned error can't find the container with id 6f6b0c449f40a252eec546db07ac1c364a58f00851f2ffd2f5f91f20f71dba4d
Sep 15 12:00:35.965861 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:35.965825    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg" event={"ID":"96403478-bc17-43e7-9ee4-38e701426018","Type":"ContainerStarted","Data":"6f6b0c449f40a252eec546db07ac1c364a58f00851f2ffd2f5f91f20f71dba4d"}
Sep 15 12:00:39.989415 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:39.989380    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg" event={"ID":"96403478-bc17-43e7-9ee4-38e701426018","Type":"ContainerStarted","Data":"d26dc6d1f51caaee55050cf17708a4f8fedc488cc39edeabd972e04e1109b1c3"}
Sep 15 12:00:39.989813 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:39.989535    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:40.008788 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:40.008747    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg" podStartSLOduration=2.218045248 podStartE2EDuration="6.008733339s" totalImagesPullingTime="3.790688091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:00:40.007690559 +0000 UTC m=+1402.259247640" watchObservedRunningTime="2026-09-15 12:00:40.008733339 +0000 UTC m=+1402.260290374"
Sep 15 12:00:46.002229 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:46.002196    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:00:56.698460 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:56.698424    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:57.387240 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:57.387140    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:58.076366 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:58.076331    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:58.911903 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:58.911863    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:00:59.562645 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:00:59.562597    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:00.325326 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:00.325291    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:00.530333 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:00.530301    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:00.997132 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:00.997089    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:03.808472 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:03.808442    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:04.504665 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:04.504630    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:05.251634 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:05.251596    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:05.911502 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:05.911470    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:09.970603 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:09.970550    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:10.025459 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:10.025428    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:19.115633 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.115585    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"]
Sep 15 12:01:19.116481 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.116448    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm" podUID="842cae86-09a6-473b-ac86-b9a8c357f737" containerName="maas-api" containerID="cri-o://248ccae37c9325011182f90b78d9bd73f342f4b886256ea040bf6f794e0d8c2c" gracePeriod=30
Sep 15 12:01:19.148515 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.148450    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:19.170646 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.170614    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"]
Sep 15 12:01:19.170881 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.170853    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs" podUID="94ccd828-26dc-42bb-a41e-5c3335eeac60" containerName="payload-processing" containerID="cri-o://611df312e7c8a7eb0e1247475384dd3317c5807298124929573233c3747febf8" gracePeriod=30
Sep 15 12:01:19.178108 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.178083    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"]
Sep 15 12:01:19.178352 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.178325    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7" podUID="c1a3b852-c2a1-4be9-89d7-33eecdcb8975" containerName="payload-pre-processing" containerID="cri-o://05d8f5054dde99fa1eb0b975f0b65530edcda6f655a6a6d7ae4396a5ca64b207" gracePeriod=30
Sep 15 12:01:19.477004 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.476981    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"
Sep 15 12:01:19.482516 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.482495    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:01:19.494100 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.494079    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"
Sep 15 12:01:19.643544 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.643472    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-metrics-certs\") pod \"842cae86-09a6-473b-ac86-b9a8c357f737\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") "
Sep 15 12:01:19.643544 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.643513    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzjfw\" (UniqueName: \"kubernetes.io/projected/c1a3b852-c2a1-4be9-89d7-33eecdcb8975-kube-api-access-zzjfw\") pod \"c1a3b852-c2a1-4be9-89d7-33eecdcb8975\" (UID: \"c1a3b852-c2a1-4be9-89d7-33eecdcb8975\") "
Sep 15 12:01:19.643544 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.643541    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1a3b852-c2a1-4be9-89d7-33eecdcb8975-plugins-config-volume\") pod \"c1a3b852-c2a1-4be9-89d7-33eecdcb8975\" (UID: \"c1a3b852-c2a1-4be9-89d7-33eecdcb8975\") "
Sep 15 12:01:19.643788 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.643577    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx6kz\" (UniqueName: \"kubernetes.io/projected/94ccd828-26dc-42bb-a41e-5c3335eeac60-kube-api-access-wx6kz\") pod \"94ccd828-26dc-42bb-a41e-5c3335eeac60\" (UID: \"94ccd828-26dc-42bb-a41e-5c3335eeac60\") "
Sep 15 12:01:19.643788 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.643601    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94ccd828-26dc-42bb-a41e-5c3335eeac60-plugins-config-volume\") pod \"94ccd828-26dc-42bb-a41e-5c3335eeac60\" (UID: \"94ccd828-26dc-42bb-a41e-5c3335eeac60\") "
Sep 15 12:01:19.643788 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.643704    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-maas-api-tls\") pod \"842cae86-09a6-473b-ac86-b9a8c357f737\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") "
Sep 15 12:01:19.643788 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.643740    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dhvn\" (UniqueName: \"kubernetes.io/projected/842cae86-09a6-473b-ac86-b9a8c357f737-kube-api-access-6dhvn\") pod \"842cae86-09a6-473b-ac86-b9a8c357f737\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") "
Sep 15 12:01:19.644016 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.643976    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1a3b852-c2a1-4be9-89d7-33eecdcb8975-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c1a3b852-c2a1-4be9-89d7-33eecdcb8975" (UID: "c1a3b852-c2a1-4be9-89d7-33eecdcb8975"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:01:19.644098 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.644072    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ccd828-26dc-42bb-a41e-5c3335eeac60-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "94ccd828-26dc-42bb-a41e-5c3335eeac60" (UID: "94ccd828-26dc-42bb-a41e-5c3335eeac60"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:01:19.644178 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.644108    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/842cae86-09a6-473b-ac86-b9a8c357f737-openshift-service-ca\") pod \"842cae86-09a6-473b-ac86-b9a8c357f737\" (UID: \"842cae86-09a6-473b-ac86-b9a8c357f737\") "
Sep 15 12:01:19.644492 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.644467    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/842cae86-09a6-473b-ac86-b9a8c357f737-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "842cae86-09a6-473b-ac86-b9a8c357f737" (UID: "842cae86-09a6-473b-ac86-b9a8c357f737"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:01:19.644769 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.644740    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/842cae86-09a6-473b-ac86-b9a8c357f737-openshift-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:01:19.644903 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.644772    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1a3b852-c2a1-4be9-89d7-33eecdcb8975-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:01:19.644903 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.644787    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94ccd828-26dc-42bb-a41e-5c3335eeac60-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:01:19.645970 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.645949    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "842cae86-09a6-473b-ac86-b9a8c357f737" (UID: "842cae86-09a6-473b-ac86-b9a8c357f737"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:01:19.645970 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.645960    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1a3b852-c2a1-4be9-89d7-33eecdcb8975-kube-api-access-zzjfw" (OuterVolumeSpecName: "kube-api-access-zzjfw") pod "c1a3b852-c2a1-4be9-89d7-33eecdcb8975" (UID: "c1a3b852-c2a1-4be9-89d7-33eecdcb8975"). InnerVolumeSpecName "kube-api-access-zzjfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:01:19.646092 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.645972    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "842cae86-09a6-473b-ac86-b9a8c357f737" (UID: "842cae86-09a6-473b-ac86-b9a8c357f737"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:01:19.646276 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.646254    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/842cae86-09a6-473b-ac86-b9a8c357f737-kube-api-access-6dhvn" (OuterVolumeSpecName: "kube-api-access-6dhvn") pod "842cae86-09a6-473b-ac86-b9a8c357f737" (UID: "842cae86-09a6-473b-ac86-b9a8c357f737"). InnerVolumeSpecName "kube-api-access-6dhvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:01:19.646353 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.646289    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ccd828-26dc-42bb-a41e-5c3335eeac60-kube-api-access-wx6kz" (OuterVolumeSpecName: "kube-api-access-wx6kz") pod "94ccd828-26dc-42bb-a41e-5c3335eeac60" (UID: "94ccd828-26dc-42bb-a41e-5c3335eeac60"). InnerVolumeSpecName "kube-api-access-wx6kz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:01:19.746388 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.746354    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:01:19.746388 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.746390    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzjfw\" (UniqueName: \"kubernetes.io/projected/c1a3b852-c2a1-4be9-89d7-33eecdcb8975-kube-api-access-zzjfw\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:01:19.746548 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.746400    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx6kz\" (UniqueName: \"kubernetes.io/projected/94ccd828-26dc-42bb-a41e-5c3335eeac60-kube-api-access-wx6kz\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:01:19.746548 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.746409    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/842cae86-09a6-473b-ac86-b9a8c357f737-maas-api-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:01:19.746548 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:19.746419    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dhvn\" (UniqueName: \"kubernetes.io/projected/842cae86-09a6-473b-ac86-b9a8c357f737-kube-api-access-6dhvn\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:01:20.223947 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.223906    2571 generic.go:356] "Generic (PLEG): container finished" podID="94ccd828-26dc-42bb-a41e-5c3335eeac60" containerID="611df312e7c8a7eb0e1247475384dd3317c5807298124929573233c3747febf8" exitCode=0
Sep 15 12:01:20.224423 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.223952    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"
Sep 15 12:01:20.224423 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.223986    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs" event={"ID":"94ccd828-26dc-42bb-a41e-5c3335eeac60","Type":"ContainerDied","Data":"611df312e7c8a7eb0e1247475384dd3317c5807298124929573233c3747febf8"}
Sep 15 12:01:20.224423 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.224051    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs" event={"ID":"94ccd828-26dc-42bb-a41e-5c3335eeac60","Type":"ContainerDied","Data":"308bc755b3dfa3377fba7bfc083eab92de9539415c00be6af2b175528bdf38d9"}
Sep 15 12:01:20.224423 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.224089    2571 scope.go:117] "RemoveContainer" containerID="611df312e7c8a7eb0e1247475384dd3317c5807298124929573233c3747febf8"
Sep 15 12:01:20.226106 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.225714    2571 generic.go:356] "Generic (PLEG): container finished" podID="c1a3b852-c2a1-4be9-89d7-33eecdcb8975" containerID="05d8f5054dde99fa1eb0b975f0b65530edcda6f655a6a6d7ae4396a5ca64b207" exitCode=0
Sep 15 12:01:20.226106 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.225857    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7" event={"ID":"c1a3b852-c2a1-4be9-89d7-33eecdcb8975","Type":"ContainerDied","Data":"05d8f5054dde99fa1eb0b975f0b65530edcda6f655a6a6d7ae4396a5ca64b207"}
Sep 15 12:01:20.226106 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.225898    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7" event={"ID":"c1a3b852-c2a1-4be9-89d7-33eecdcb8975","Type":"ContainerDied","Data":"c2230df75c80570f33c417a9981077561494bc48c20c1f6b4552c0f021a2a8bc"}
Sep 15 12:01:20.226106 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.225973    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"
Sep 15 12:01:20.228396 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.228319    2571 generic.go:356] "Generic (PLEG): container finished" podID="842cae86-09a6-473b-ac86-b9a8c357f737" containerID="248ccae37c9325011182f90b78d9bd73f342f4b886256ea040bf6f794e0d8c2c" exitCode=0
Sep 15 12:01:20.228520 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.228427    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm" event={"ID":"842cae86-09a6-473b-ac86-b9a8c357f737","Type":"ContainerDied","Data":"248ccae37c9325011182f90b78d9bd73f342f4b886256ea040bf6f794e0d8c2c"}
Sep 15 12:01:20.228520 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.228463    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm" event={"ID":"842cae86-09a6-473b-ac86-b9a8c357f737","Type":"ContainerDied","Data":"d0132a6c01fa9dface62417dbe3c8adeb299c7f102f105656914acd51b96905f"}
Sep 15 12:01:20.228520 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.228498    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"
Sep 15 12:01:20.237838 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.237820    2571 scope.go:117] "RemoveContainer" containerID="611df312e7c8a7eb0e1247475384dd3317c5807298124929573233c3747febf8"
Sep 15 12:01:20.238110 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:01:20.238092    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"611df312e7c8a7eb0e1247475384dd3317c5807298124929573233c3747febf8\": container with ID starting with 611df312e7c8a7eb0e1247475384dd3317c5807298124929573233c3747febf8 not found: ID does not exist" containerID="611df312e7c8a7eb0e1247475384dd3317c5807298124929573233c3747febf8"
Sep 15 12:01:20.238177 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.238118    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"611df312e7c8a7eb0e1247475384dd3317c5807298124929573233c3747febf8"} err="failed to get container status \"611df312e7c8a7eb0e1247475384dd3317c5807298124929573233c3747febf8\": rpc error: code = NotFound desc = could not find container \"611df312e7c8a7eb0e1247475384dd3317c5807298124929573233c3747febf8\": container with ID starting with 611df312e7c8a7eb0e1247475384dd3317c5807298124929573233c3747febf8 not found: ID does not exist"
Sep 15 12:01:20.238177 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.238134    2571 scope.go:117] "RemoveContainer" containerID="05d8f5054dde99fa1eb0b975f0b65530edcda6f655a6a6d7ae4396a5ca64b207"
Sep 15 12:01:20.247022 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.247005    2571 scope.go:117] "RemoveContainer" containerID="05d8f5054dde99fa1eb0b975f0b65530edcda6f655a6a6d7ae4396a5ca64b207"
Sep 15 12:01:20.247287 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:01:20.247262    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d8f5054dde99fa1eb0b975f0b65530edcda6f655a6a6d7ae4396a5ca64b207\": container with ID starting with 05d8f5054dde99fa1eb0b975f0b65530edcda6f655a6a6d7ae4396a5ca64b207 not found: ID does not exist" containerID="05d8f5054dde99fa1eb0b975f0b65530edcda6f655a6a6d7ae4396a5ca64b207"
Sep 15 12:01:20.247373 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.247291    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d8f5054dde99fa1eb0b975f0b65530edcda6f655a6a6d7ae4396a5ca64b207"} err="failed to get container status \"05d8f5054dde99fa1eb0b975f0b65530edcda6f655a6a6d7ae4396a5ca64b207\": rpc error: code = NotFound desc = could not find container \"05d8f5054dde99fa1eb0b975f0b65530edcda6f655a6a6d7ae4396a5ca64b207\": container with ID starting with 05d8f5054dde99fa1eb0b975f0b65530edcda6f655a6a6d7ae4396a5ca64b207 not found: ID does not exist"
Sep 15 12:01:20.247373 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.247312    2571 scope.go:117] "RemoveContainer" containerID="248ccae37c9325011182f90b78d9bd73f342f4b886256ea040bf6f794e0d8c2c"
Sep 15 12:01:20.255848 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.255832    2571 scope.go:117] "RemoveContainer" containerID="248ccae37c9325011182f90b78d9bd73f342f4b886256ea040bf6f794e0d8c2c"
Sep 15 12:01:20.256198 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:01:20.256174    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"248ccae37c9325011182f90b78d9bd73f342f4b886256ea040bf6f794e0d8c2c\": container with ID starting with 248ccae37c9325011182f90b78d9bd73f342f4b886256ea040bf6f794e0d8c2c not found: ID does not exist" containerID="248ccae37c9325011182f90b78d9bd73f342f4b886256ea040bf6f794e0d8c2c"
Sep 15 12:01:20.256264 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.256207    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"248ccae37c9325011182f90b78d9bd73f342f4b886256ea040bf6f794e0d8c2c"} err="failed to get container status \"248ccae37c9325011182f90b78d9bd73f342f4b886256ea040bf6f794e0d8c2c\": rpc error: code = NotFound desc = could not find container \"248ccae37c9325011182f90b78d9bd73f342f4b886256ea040bf6f794e0d8c2c\": container with ID starting with 248ccae37c9325011182f90b78d9bd73f342f4b886256ea040bf6f794e0d8c2c not found: ID does not exist"
Sep 15 12:01:20.257009 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.256991    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"]
Sep 15 12:01:20.261203 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.261178    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a1650b-7949db9c6f-xszjs"]
Sep 15 12:01:20.272665 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.272638    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"]
Sep 15 12:01:20.282388 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.282368    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a1650b-85bd5fd5fd-c42b7"]
Sep 15 12:01:20.283095 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.283076    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:20.292753 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.292734    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"]
Sep 15 12:01:20.300226 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.300206    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a1650b-8587d8b57c-vdxjm"]
Sep 15 12:01:20.351264 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.351241    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:20.432493 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:20.432419    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:21.055127 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:21.055097    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:21.179500 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:21.179470    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:22.215163 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:22.215129    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="842cae86-09a6-473b-ac86-b9a8c357f737" path="/var/lib/kubelet/pods/842cae86-09a6-473b-ac86-b9a8c357f737/volumes"
Sep 15 12:01:22.215533 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:22.215518    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94ccd828-26dc-42bb-a41e-5c3335eeac60" path="/var/lib/kubelet/pods/94ccd828-26dc-42bb-a41e-5c3335eeac60/volumes"
Sep 15 12:01:22.215839 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:22.215827    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1a3b852-c2a1-4be9-89d7-33eecdcb8975" path="/var/lib/kubelet/pods/c1a3b852-c2a1-4be9-89d7-33eecdcb8975/volumes"
Sep 15 12:01:22.770104 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:22.770068    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:22.871123 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:22.871093    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:23.060142 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:23.060069    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:23.340587 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:23.340506    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:24.928378 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:24.928347    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:25.656058 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:25.656030    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:25.779586 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:25.779553    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:25.922792 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:25.922711    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:26.955547 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:26.955515    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:27.909602 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:27.909572    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:28.494184 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:28.494140    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:28.610842 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:28.610804    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:28.774201 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:28.774093    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:28.993270 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:28.993236    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:29.963679 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:29.963637    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:30.789027 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.788988    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"]
Sep 15 12:01:30.789527 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.789511    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1a3b852-c2a1-4be9-89d7-33eecdcb8975" containerName="payload-pre-processing"
Sep 15 12:01:30.789592 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.789529    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1a3b852-c2a1-4be9-89d7-33eecdcb8975" containerName="payload-pre-processing"
Sep 15 12:01:30.789592 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.789547    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842cae86-09a6-473b-ac86-b9a8c357f737" containerName="maas-api"
Sep 15 12:01:30.789592 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.789553    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="842cae86-09a6-473b-ac86-b9a8c357f737" containerName="maas-api"
Sep 15 12:01:30.789592 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.789563    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ccd828-26dc-42bb-a41e-5c3335eeac60" containerName="payload-processing"
Sep 15 12:01:30.789592 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.789569    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ccd828-26dc-42bb-a41e-5c3335eeac60" containerName="payload-processing"
Sep 15 12:01:30.789749 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.789658    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1a3b852-c2a1-4be9-89d7-33eecdcb8975" containerName="payload-pre-processing"
Sep 15 12:01:30.789749 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.789666    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="842cae86-09a6-473b-ac86-b9a8c357f737" containerName="maas-api"
Sep 15 12:01:30.789749 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.789673    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="94ccd828-26dc-42bb-a41e-5c3335eeac60" containerName="payload-processing"
Sep 15 12:01:30.794200 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.794178    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:30.796478 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.796450    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-030981-serving-cert\""
Sep 15 12:01:30.805030 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.805008    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"]
Sep 15 12:01:30.865585 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.865551    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b46701af-ecd2-468e-b7e3-6b30a6524f18-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:30.865748 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.865635    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-metrics-certs\") pod \"maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:30.865748 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.865682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-maas-api-tls\") pod \"maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:30.865748 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.865735    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcnnc\" (UniqueName: \"kubernetes.io/projected/b46701af-ecd2-468e-b7e3-6b30a6524f18-kube-api-access-mcnnc\") pod \"maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:30.885441 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.885396    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:30.966563 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.966530    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-metrics-certs\") pod \"maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:30.967044 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.966607    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-maas-api-tls\") pod \"maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:30.967044 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.966646    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcnnc\" (UniqueName: \"kubernetes.io/projected/b46701af-ecd2-468e-b7e3-6b30a6524f18-kube-api-access-mcnnc\") pod \"maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:30.967044 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:01:30.966747    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-serving-cert: secret "maas-api-e2e-ipp-a-030981-serving-cert" not found
Sep 15 12:01:30.967044 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.966747    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b46701af-ecd2-468e-b7e3-6b30a6524f18-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:30.967044 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:01:30.966829    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-maas-api-tls podName:b46701af-ecd2-468e-b7e3-6b30a6524f18 nodeName:}" failed. No retries permitted until 2026-09-15 12:01:31.466808411 +0000 UTC m=+1453.718365465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-maas-api-tls") pod "maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9" (UID: "b46701af-ecd2-468e-b7e3-6b30a6524f18") : secret "maas-api-e2e-ipp-a-030981-serving-cert" not found
Sep 15 12:01:30.967479 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.967458    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b46701af-ecd2-468e-b7e3-6b30a6524f18-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:30.968924 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.968905    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-metrics-certs\") pod \"maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:30.975522 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.975496    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcnnc\" (UniqueName: \"kubernetes.io/projected/b46701af-ecd2-468e-b7e3-6b30a6524f18-kube-api-access-mcnnc\") pod \"maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:30.985384 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:30.985355    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:31.355307 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.355276    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:31.454485 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.454457    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:31.473771 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.473746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-maas-api-tls\") pod \"maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:31.476355 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.476320    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-maas-api-tls\") pod \"maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:31.479242 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.479217    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"]
Sep 15 12:01:31.483230 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.483211    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"
Sep 15 12:01:31.485622 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.485604    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-030981\""
Sep 15 12:01:31.494002 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.493983    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"]
Sep 15 12:01:31.505263 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.505240    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"]
Sep 15 12:01:31.511449 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.511427    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"
Sep 15 12:01:31.513824 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.513808    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-030981-dockercfg-pn7hk\""
Sep 15 12:01:31.522835 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.522809    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"]
Sep 15 12:01:31.540427 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.540400    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:31.574714 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.574685    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cbmr\" (UniqueName: \"kubernetes.io/projected/633ce068-6c48-4d73-a90c-2488b10edde8-kube-api-access-7cbmr\") pod \"payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq\" (UID: \"633ce068-6c48-4d73-a90c-2488b10edde8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"
Sep 15 12:01:31.574831 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.574750    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxglb\" (UniqueName: \"kubernetes.io/projected/afcc333c-6c8c-426c-b195-f4e85854dbac-kube-api-access-gxglb\") pod \"payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f\" (UID: \"afcc333c-6c8c-426c-b195-f4e85854dbac\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"
Sep 15 12:01:31.574831 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.574811    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/633ce068-6c48-4d73-a90c-2488b10edde8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq\" (UID: \"633ce068-6c48-4d73-a90c-2488b10edde8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"
Sep 15 12:01:31.574924 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.574847    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afcc333c-6c8c-426c-b195-f4e85854dbac-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f\" (UID: \"afcc333c-6c8c-426c-b195-f4e85854dbac\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"
Sep 15 12:01:31.676501 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.676247    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxglb\" (UniqueName: \"kubernetes.io/projected/afcc333c-6c8c-426c-b195-f4e85854dbac-kube-api-access-gxglb\") pod \"payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f\" (UID: \"afcc333c-6c8c-426c-b195-f4e85854dbac\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"
Sep 15 12:01:31.676501 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.676394    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/633ce068-6c48-4d73-a90c-2488b10edde8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq\" (UID: \"633ce068-6c48-4d73-a90c-2488b10edde8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"
Sep 15 12:01:31.676501 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.676467    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afcc333c-6c8c-426c-b195-f4e85854dbac-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f\" (UID: \"afcc333c-6c8c-426c-b195-f4e85854dbac\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"
Sep 15 12:01:31.676774 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.676610    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cbmr\" (UniqueName: \"kubernetes.io/projected/633ce068-6c48-4d73-a90c-2488b10edde8-kube-api-access-7cbmr\") pod \"payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq\" (UID: \"633ce068-6c48-4d73-a90c-2488b10edde8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"
Sep 15 12:01:31.680172 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.677648    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/633ce068-6c48-4d73-a90c-2488b10edde8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq\" (UID: \"633ce068-6c48-4d73-a90c-2488b10edde8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"
Sep 15 12:01:31.680172 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.677768    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afcc333c-6c8c-426c-b195-f4e85854dbac-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f\" (UID: \"afcc333c-6c8c-426c-b195-f4e85854dbac\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"
Sep 15 12:01:31.688642 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.688607    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cbmr\" (UniqueName: \"kubernetes.io/projected/633ce068-6c48-4d73-a90c-2488b10edde8-kube-api-access-7cbmr\") pod \"payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq\" (UID: \"633ce068-6c48-4d73-a90c-2488b10edde8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"
Sep 15 12:01:31.688757 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.688648    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxglb\" (UniqueName: \"kubernetes.io/projected/afcc333c-6c8c-426c-b195-f4e85854dbac-kube-api-access-gxglb\") pod \"payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f\" (UID: \"afcc333c-6c8c-426c-b195-f4e85854dbac\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"
Sep 15 12:01:31.705544 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.705515    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:31.797308 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.797271    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"
Sep 15 12:01:31.822001 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.821952    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:31.824898 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.824876    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"
Sep 15 12:01:31.981146 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:31.981109    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"]
Sep 15 12:01:31.981468 ip-10-0-141-110 kubenswrapper[2571]: W0915 12:01:31.981318    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46701af_ecd2_468e_b7e3_6b30a6524f18.slice/crio-aff6c27f21c5827276ad190d7a5a7d57f811e749df60468ae834e535f87f9190 WatchSource:0}: Error finding container aff6c27f21c5827276ad190d7a5a7d57f811e749df60468ae834e535f87f9190: Status 404 returned error can't find the container with id aff6c27f21c5827276ad190d7a5a7d57f811e749df60468ae834e535f87f9190
Sep 15 12:01:32.077493 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:32.077469    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"]
Sep 15 12:01:32.078965 ip-10-0-141-110 kubenswrapper[2571]: W0915 12:01:32.078939    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod633ce068_6c48_4d73_a90c_2488b10edde8.slice/crio-625d3f412cca1ee04949bb68c07b06284b3b16a4d411c043a68c945ab20dd44a WatchSource:0}: Error finding container 625d3f412cca1ee04949bb68c07b06284b3b16a4d411c043a68c945ab20dd44a: Status 404 returned error can't find the container with id 625d3f412cca1ee04949bb68c07b06284b3b16a4d411c043a68c945ab20dd44a
Sep 15 12:01:32.109365 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:32.109341    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"]
Sep 15 12:01:32.117372 ip-10-0-141-110 kubenswrapper[2571]: W0915 12:01:32.117336    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafcc333c_6c8c_426c_b195_f4e85854dbac.slice/crio-fd5d21372ea33043b78e07ae0c106ee6fe07736f9fcdd5f44150c3b9aeaf5def WatchSource:0}: Error finding container fd5d21372ea33043b78e07ae0c106ee6fe07736f9fcdd5f44150c3b9aeaf5def: Status 404 returned error can't find the container with id fd5d21372ea33043b78e07ae0c106ee6fe07736f9fcdd5f44150c3b9aeaf5def
Sep 15 12:01:32.300278 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:32.300186    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f" event={"ID":"afcc333c-6c8c-426c-b195-f4e85854dbac","Type":"ContainerStarted","Data":"5f3d6a315483354f7fea8de9ed1fc35f7636e3a527f6a4eacf731405fcb7d308"}
Sep 15 12:01:32.300278 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:32.300254    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f" event={"ID":"afcc333c-6c8c-426c-b195-f4e85854dbac","Type":"ContainerStarted","Data":"fd5d21372ea33043b78e07ae0c106ee6fe07736f9fcdd5f44150c3b9aeaf5def"}
Sep 15 12:01:32.300501 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:32.300372    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"
Sep 15 12:01:32.301923 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:32.301901    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq" event={"ID":"633ce068-6c48-4d73-a90c-2488b10edde8","Type":"ContainerStarted","Data":"424a5b5f227df81256dab7d108051e3690f118f1cb73530dab8bd0e20143115d"}
Sep 15 12:01:32.302036 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:32.301943    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq" event={"ID":"633ce068-6c48-4d73-a90c-2488b10edde8","Type":"ContainerStarted","Data":"625d3f412cca1ee04949bb68c07b06284b3b16a4d411c043a68c945ab20dd44a"}
Sep 15 12:01:32.302036 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:32.302004    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"
Sep 15 12:01:32.303237 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:32.303206    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9" event={"ID":"b46701af-ecd2-468e-b7e3-6b30a6524f18","Type":"ContainerStarted","Data":"aff6c27f21c5827276ad190d7a5a7d57f811e749df60468ae834e535f87f9190"}
Sep 15 12:01:32.319883 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:32.319834    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f" podStartSLOduration=1.319816537 podStartE2EDuration="1.319816537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:01:32.316259979 +0000 UTC m=+1454.567817040" watchObservedRunningTime="2026-09-15 12:01:32.319816537 +0000 UTC m=+1454.571373598"
Sep 15 12:01:32.335472 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:32.335435    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq" podStartSLOduration=1.335421868 podStartE2EDuration="1.335421868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:01:32.332448642 +0000 UTC m=+1454.584005700" watchObservedRunningTime="2026-09-15 12:01:32.335421868 +0000 UTC m=+1454.586978957"
Sep 15 12:01:32.625467 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:32.625375    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:33.311556 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:33.311526    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9" event={"ID":"b46701af-ecd2-468e-b7e3-6b30a6524f18","Type":"ContainerStarted","Data":"e2be997dd7cfe2d463bd3d15ddf9b21c45f8aed3d70d9eaf8229507e041e1fb9"}
Sep 15 12:01:33.312029 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:33.311593    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:33.321189 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:33.321137    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:33.332503 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:33.332448    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9" podStartSLOduration=2.954251047 podStartE2EDuration="3.332428877s" totalImagesPullingTime="378.17783ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:01:33.330234859 +0000 UTC m=+1455.581791932" watchObservedRunningTime="2026-09-15 12:01:33.332428877 +0000 UTC m=+1455.583985938"
Sep 15 12:01:34.641502 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:34.641467    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:34.742148 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:34.742115    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:35.439008 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:35.438962    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:36.034560 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:36.034532    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:39.286567 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:39.286527    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:39.322185 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:39.322138    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:01:43.313961 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:43.313934    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"
Sep 15 12:01:43.314363 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:43.314300    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"
Sep 15 12:01:44.979401 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:44.979367    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"]
Sep 15 12:01:44.979868 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:44.979590    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg" podUID="96403478-bc17-43e7-9ee4-38e701426018" containerName="maas-api" containerID="cri-o://d26dc6d1f51caaee55050cf17708a4f8fedc488cc39edeabd972e04e1109b1c3" gracePeriod=30
Sep 15 12:01:45.014705 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.014669    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:45.239827 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.239765    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:01:45.315965 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.315935    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96403478-bc17-43e7-9ee4-38e701426018-openshift-service-ca\") pod \"96403478-bc17-43e7-9ee4-38e701426018\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") "
Sep 15 12:01:45.316188 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.315989    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-maas-api-tls\") pod \"96403478-bc17-43e7-9ee4-38e701426018\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") "
Sep 15 12:01:45.316188 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.316086    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r5dc\" (UniqueName: \"kubernetes.io/projected/96403478-bc17-43e7-9ee4-38e701426018-kube-api-access-6r5dc\") pod \"96403478-bc17-43e7-9ee4-38e701426018\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") "
Sep 15 12:01:45.316188 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.316144    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-metrics-certs\") pod \"96403478-bc17-43e7-9ee4-38e701426018\" (UID: \"96403478-bc17-43e7-9ee4-38e701426018\") "
Sep 15 12:01:45.316476 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.316403    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96403478-bc17-43e7-9ee4-38e701426018-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "96403478-bc17-43e7-9ee4-38e701426018" (UID: "96403478-bc17-43e7-9ee4-38e701426018"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:01:45.316654 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.316635    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96403478-bc17-43e7-9ee4-38e701426018-openshift-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:01:45.318540 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.318511    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "96403478-bc17-43e7-9ee4-38e701426018" (UID: "96403478-bc17-43e7-9ee4-38e701426018"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:01:45.318694 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.318662    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "96403478-bc17-43e7-9ee4-38e701426018" (UID: "96403478-bc17-43e7-9ee4-38e701426018"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:01:45.318811 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.318787    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96403478-bc17-43e7-9ee4-38e701426018-kube-api-access-6r5dc" (OuterVolumeSpecName: "kube-api-access-6r5dc") pod "96403478-bc17-43e7-9ee4-38e701426018" (UID: "96403478-bc17-43e7-9ee4-38e701426018"). InnerVolumeSpecName "kube-api-access-6r5dc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:01:45.392904 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.392872    2571 generic.go:356] "Generic (PLEG): container finished" podID="96403478-bc17-43e7-9ee4-38e701426018" containerID="d26dc6d1f51caaee55050cf17708a4f8fedc488cc39edeabd972e04e1109b1c3" exitCode=0
Sep 15 12:01:45.393077 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.392909    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg" event={"ID":"96403478-bc17-43e7-9ee4-38e701426018","Type":"ContainerDied","Data":"d26dc6d1f51caaee55050cf17708a4f8fedc488cc39edeabd972e04e1109b1c3"}
Sep 15 12:01:45.393077 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.392934    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"
Sep 15 12:01:45.393077 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.392983    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg" event={"ID":"96403478-bc17-43e7-9ee4-38e701426018","Type":"ContainerDied","Data":"6f6b0c449f40a252eec546db07ac1c364a58f00851f2ffd2f5f91f20f71dba4d"}
Sep 15 12:01:45.393077 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.393015    2571 scope.go:117] "RemoveContainer" containerID="d26dc6d1f51caaee55050cf17708a4f8fedc488cc39edeabd972e04e1109b1c3"
Sep 15 12:01:45.404380 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.404363    2571 scope.go:117] "RemoveContainer" containerID="d26dc6d1f51caaee55050cf17708a4f8fedc488cc39edeabd972e04e1109b1c3"
Sep 15 12:01:45.404664 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:01:45.404647    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d26dc6d1f51caaee55050cf17708a4f8fedc488cc39edeabd972e04e1109b1c3\": container with ID starting with d26dc6d1f51caaee55050cf17708a4f8fedc488cc39edeabd972e04e1109b1c3 not found: ID does not exist" containerID="d26dc6d1f51caaee55050cf17708a4f8fedc488cc39edeabd972e04e1109b1c3"
Sep 15 12:01:45.404734 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.404672    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26dc6d1f51caaee55050cf17708a4f8fedc488cc39edeabd972e04e1109b1c3"} err="failed to get container status \"d26dc6d1f51caaee55050cf17708a4f8fedc488cc39edeabd972e04e1109b1c3\": rpc error: code = NotFound desc = could not find container \"d26dc6d1f51caaee55050cf17708a4f8fedc488cc39edeabd972e04e1109b1c3\": container with ID starting with d26dc6d1f51caaee55050cf17708a4f8fedc488cc39edeabd972e04e1109b1c3 not found: ID does not exist"
Sep 15 12:01:45.417876 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.417854    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-maas-api-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:01:45.417876 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.417874    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r5dc\" (UniqueName: \"kubernetes.io/projected/96403478-bc17-43e7-9ee4-38e701426018-kube-api-access-6r5dc\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:01:45.418060 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.417883    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96403478-bc17-43e7-9ee4-38e701426018-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:01:45.435621 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.435595    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"]
Sep 15 12:01:45.440751 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:45.440728    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6b0cb9-6cddfbddc5-ss5bg"]
Sep 15 12:01:46.215855 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:46.215820    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96403478-bc17-43e7-9ee4-38e701426018" path="/var/lib/kubelet/pods/96403478-bc17-43e7-9ee4-38e701426018/volumes"
Sep 15 12:01:48.232007 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:48.231979    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:48.336595 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:48.336547    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:48.434827 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:48.434801    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:49.068096 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:49.068061    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:49.804987 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:49.804955    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:50.618698 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:50.618651    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:50.914185 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:50.914074    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:51.325834 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:51.325802    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:51.623887 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:51.623812    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:51.786741 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:51.786702    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:51.889274 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:51.889181    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:52.721364 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:52.721334    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:53.294996 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:53.294939    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:53.415301 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:53.415268    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:53.545450 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:53.545348    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:53.648207 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:53.648180    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:54.586258 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:54.586227    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:55.001883 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:55.001832    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:55.117835 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:55.117781    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:55.645097 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:55.645062    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:56.914497 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:56.914466    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:01:57.690537 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:01:57.690448    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:00.762544 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.762502    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"]
Sep 15 12:02:00.763316 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.763294    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96403478-bc17-43e7-9ee4-38e701426018" containerName="maas-api"
Sep 15 12:02:00.763316 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.763315    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="96403478-bc17-43e7-9ee4-38e701426018" containerName="maas-api"
Sep 15 12:02:00.763495 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.763424    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="96403478-bc17-43e7-9ee4-38e701426018" containerName="maas-api"
Sep 15 12:02:00.766307 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.766287    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"
Sep 15 12:02:00.768948 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.768923    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-0249d8\""
Sep 15 12:02:00.769143 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.769119    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-0249d8-dockercfg-8w799\""
Sep 15 12:02:00.777704 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.777677    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"]
Sep 15 12:02:00.875227 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.875187    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg2lm\" (UniqueName: \"kubernetes.io/projected/db39eef7-97f9-4651-955c-c07e9a6fc5e0-kube-api-access-lg2lm\") pod \"payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl\" (UID: \"db39eef7-97f9-4651-955c-c07e9a6fc5e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"
Sep 15 12:02:00.875428 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.875354    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db39eef7-97f9-4651-955c-c07e9a6fc5e0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl\" (UID: \"db39eef7-97f9-4651-955c-c07e9a6fc5e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"
Sep 15 12:02:00.976025 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.975988    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db39eef7-97f9-4651-955c-c07e9a6fc5e0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl\" (UID: \"db39eef7-97f9-4651-955c-c07e9a6fc5e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"
Sep 15 12:02:00.976212 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.976038    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg2lm\" (UniqueName: \"kubernetes.io/projected/db39eef7-97f9-4651-955c-c07e9a6fc5e0-kube-api-access-lg2lm\") pod \"payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl\" (UID: \"db39eef7-97f9-4651-955c-c07e9a6fc5e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"
Sep 15 12:02:00.976687 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.976669    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db39eef7-97f9-4651-955c-c07e9a6fc5e0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl\" (UID: \"db39eef7-97f9-4651-955c-c07e9a6fc5e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"
Sep 15 12:02:00.984089 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:00.984014    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg2lm\" (UniqueName: \"kubernetes.io/projected/db39eef7-97f9-4651-955c-c07e9a6fc5e0-kube-api-access-lg2lm\") pod \"payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl\" (UID: \"db39eef7-97f9-4651-955c-c07e9a6fc5e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"
Sep 15 12:02:01.077893 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:01.077801    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"
Sep 15 12:02:01.353434 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:01.353405    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"]
Sep 15 12:02:01.354419 ip-10-0-141-110 kubenswrapper[2571]: W0915 12:02:01.354386    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb39eef7_97f9_4651_955c_c07e9a6fc5e0.slice/crio-093930f8dfa40b90a0d3ff3261feb823a9dccd5780ef48459b825334850135d3 WatchSource:0}: Error finding container 093930f8dfa40b90a0d3ff3261feb823a9dccd5780ef48459b825334850135d3: Status 404 returned error can't find the container with id 093930f8dfa40b90a0d3ff3261feb823a9dccd5780ef48459b825334850135d3
Sep 15 12:02:01.499376 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:01.499343    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl" event={"ID":"db39eef7-97f9-4651-955c-c07e9a6fc5e0","Type":"ContainerStarted","Data":"7a175ee62b6cde8d8df8e90641f707ca38d0677947a3e61e86131b9a1ffebd31"}
Sep 15 12:02:01.499569 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:01.499406    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"
Sep 15 12:02:01.499569 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:01.499429    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl" event={"ID":"db39eef7-97f9-4651-955c-c07e9a6fc5e0","Type":"ContainerStarted","Data":"093930f8dfa40b90a0d3ff3261feb823a9dccd5780ef48459b825334850135d3"}
Sep 15 12:02:01.519540 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:01.519477    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl" podStartSLOduration=1.5194603500000001 podStartE2EDuration="1.51946035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:02:01.51679011 +0000 UTC m=+1483.768347171" watchObservedRunningTime="2026-09-15 12:02:01.51946035 +0000 UTC m=+1483.771017405"
Sep 15 12:02:01.547974 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:01.547940    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:01.648434 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:01.648337    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:01.750348 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:01.750314    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:04.226256 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:04.226227    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:04.806255 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:04.806219    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"]
Sep 15 12:02:04.806484 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:04.806460    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8" podUID="0a83c2f7-fa7c-477d-a471-5b52c481636b" containerName="maas-api" containerID="cri-o://10557ae3de2d03a18341b47f2a466fe226b582116d21156dc81a50e20b04f7b8" gracePeriod=30
Sep 15 12:02:04.828900 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:04.828873    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:04.910762 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:04.910723    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:04.983869 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:04.983814    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:05.051251 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.051174    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:05.069805 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.069746    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 12:02:05.118886 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.118855    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-metrics-certs\") pod \"0a83c2f7-fa7c-477d-a471-5b52c481636b\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") "
Sep 15 12:02:05.119068 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.118920    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a83c2f7-fa7c-477d-a471-5b52c481636b-openshift-service-ca\") pod \"0a83c2f7-fa7c-477d-a471-5b52c481636b\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") "
Sep 15 12:02:05.119068 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.118994    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-maas-api-tls\") pod \"0a83c2f7-fa7c-477d-a471-5b52c481636b\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") "
Sep 15 12:02:05.119210 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.119066    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzmhq\" (UniqueName: \"kubernetes.io/projected/0a83c2f7-fa7c-477d-a471-5b52c481636b-kube-api-access-qzmhq\") pod \"0a83c2f7-fa7c-477d-a471-5b52c481636b\" (UID: \"0a83c2f7-fa7c-477d-a471-5b52c481636b\") "
Sep 15 12:02:05.119422 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.119392    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a83c2f7-fa7c-477d-a471-5b52c481636b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0a83c2f7-fa7c-477d-a471-5b52c481636b" (UID: "0a83c2f7-fa7c-477d-a471-5b52c481636b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:02:05.119548 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.119523    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a83c2f7-fa7c-477d-a471-5b52c481636b-openshift-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:02:05.121358 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.121329    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0a83c2f7-fa7c-477d-a471-5b52c481636b" (UID: "0a83c2f7-fa7c-477d-a471-5b52c481636b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:02:05.121627 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.121600    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0a83c2f7-fa7c-477d-a471-5b52c481636b" (UID: "0a83c2f7-fa7c-477d-a471-5b52c481636b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:02:05.121761 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.121739    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a83c2f7-fa7c-477d-a471-5b52c481636b-kube-api-access-qzmhq" (OuterVolumeSpecName: "kube-api-access-qzmhq") pod "0a83c2f7-fa7c-477d-a471-5b52c481636b" (UID: "0a83c2f7-fa7c-477d-a471-5b52c481636b"). InnerVolumeSpecName "kube-api-access-qzmhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:02:05.220731 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.220690    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-maas-api-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:02:05.220731 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.220727    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzmhq\" (UniqueName: \"kubernetes.io/projected/0a83c2f7-fa7c-477d-a471-5b52c481636b-kube-api-access-qzmhq\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:02:05.220731 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.220737    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a83c2f7-fa7c-477d-a471-5b52c481636b-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:02:05.425140 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.425054    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:05.525703 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.525670    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:05.527485 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.527461    2571 generic.go:356] "Generic (PLEG): container finished" podID="0a83c2f7-fa7c-477d-a471-5b52c481636b" containerID="10557ae3de2d03a18341b47f2a466fe226b582116d21156dc81a50e20b04f7b8" exitCode=0
Sep 15 12:02:05.527608 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.527509    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"
Sep 15 12:02:05.527608 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.527541    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8" event={"ID":"0a83c2f7-fa7c-477d-a471-5b52c481636b","Type":"ContainerDied","Data":"10557ae3de2d03a18341b47f2a466fe226b582116d21156dc81a50e20b04f7b8"}
Sep 15 12:02:05.527608 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.527596    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8" event={"ID":"0a83c2f7-fa7c-477d-a471-5b52c481636b","Type":"ContainerDied","Data":"c9d0be8180d1aa28cb537f3fd6cc2ae3c2e95e8d6b3dec6ded42eea460f40491"}
Sep 15 12:02:05.527715 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.527626    2571 scope.go:117] "RemoveContainer" containerID="10557ae3de2d03a18341b47f2a466fe226b582116d21156dc81a50e20b04f7b8"
Sep 15 12:02:05.538008 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.537990    2571 scope.go:117] "RemoveContainer" containerID="10557ae3de2d03a18341b47f2a466fe226b582116d21156dc81a50e20b04f7b8"
Sep 15 12:02:05.538303 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:02:05.538283    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10557ae3de2d03a18341b47f2a466fe226b582116d21156dc81a50e20b04f7b8\": container with ID starting with 10557ae3de2d03a18341b47f2a466fe226b582116d21156dc81a50e20b04f7b8 not found: ID does not exist" containerID="10557ae3de2d03a18341b47f2a466fe226b582116d21156dc81a50e20b04f7b8"
Sep 15 12:02:05.538358 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.538312    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10557ae3de2d03a18341b47f2a466fe226b582116d21156dc81a50e20b04f7b8"} err="failed to get container status \"10557ae3de2d03a18341b47f2a466fe226b582116d21156dc81a50e20b04f7b8\": rpc error: code = NotFound desc = could not find container \"10557ae3de2d03a18341b47f2a466fe226b582116d21156dc81a50e20b04f7b8\": container with ID starting with 10557ae3de2d03a18341b47f2a466fe226b582116d21156dc81a50e20b04f7b8 not found: ID does not exist"
Sep 15 12:02:05.562812 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.557891    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"]
Sep 15 12:02:05.565769 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:05.565734    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7f9f55-59df4d946b-vwpq8"]
Sep 15 12:02:06.047150 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:06.047104    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:06.215098 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:06.215055    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a83c2f7-fa7c-477d-a471-5b52c481636b" path="/var/lib/kubelet/pods/0a83c2f7-fa7c-477d-a471-5b52c481636b/volumes"
Sep 15 12:02:07.000975 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:07.000944    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:07.788074 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:07.788042    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:08.556451 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:08.556418    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:09.407552 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:09.407525    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:10.661458 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:10.661427    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:11.364261 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:11.364234    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:12.383322 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:12.383293    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:12.481809 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:12.481779    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:12.508069 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:12.508042    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"
Sep 15 12:02:12.616381 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:12.616349    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:13.570717 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:13.570684    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:14.388319 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:14.388287    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:14.850034 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:14.849998    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:15.454503 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:15.454475    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:16.744256 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:16.744213    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:17.666509 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:17.666478    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:18.284402 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:18.284374    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 12:02:18.288531 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:18.288510    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 12:02:18.606332 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:18.606248    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:20.323513 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:20.323477    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-jjnsc_ba184fb9-5c6e-4777-98de-9b779cb5ac0c/payload-processing/0.log"
Sep 15 12:02:20.443167 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:20.443132    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-jjnsc_ba184fb9-5c6e-4777-98de-9b779cb5ac0c/payload-processing/0.log"
Sep 15 12:02:20.589443 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:20.589365    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl_db39eef7-97f9-4651-955c-c07e9a6fc5e0/payload-processing/0.log"
Sep 15 12:02:23.809760 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:23.809717    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"]
Sep 15 12:02:23.810233 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:23.809982    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28" podUID="d5b876cb-22d3-48d8-9445-01999cdc8573" containerName="maas-api" containerID="cri-o://79ce20ced60a1453e28543270774ff3c99be98af0ca0ca60df44a931917f09ee" gracePeriod=30
Sep 15 12:02:24.068680 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.068624    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 12:02:24.215951 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.215837    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lc6t\" (UniqueName: \"kubernetes.io/projected/d5b876cb-22d3-48d8-9445-01999cdc8573-kube-api-access-5lc6t\") pod \"d5b876cb-22d3-48d8-9445-01999cdc8573\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") "
Sep 15 12:02:24.215951 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.215902    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5b876cb-22d3-48d8-9445-01999cdc8573-openshift-service-ca\") pod \"d5b876cb-22d3-48d8-9445-01999cdc8573\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") "
Sep 15 12:02:24.216417 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.216314    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-maas-api-tls\") pod \"d5b876cb-22d3-48d8-9445-01999cdc8573\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") "
Sep 15 12:02:24.216417 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.216383    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-metrics-certs\") pod \"d5b876cb-22d3-48d8-9445-01999cdc8573\" (UID: \"d5b876cb-22d3-48d8-9445-01999cdc8573\") "
Sep 15 12:02:24.217985 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.217948    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5b876cb-22d3-48d8-9445-01999cdc8573-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d5b876cb-22d3-48d8-9445-01999cdc8573" (UID: "d5b876cb-22d3-48d8-9445-01999cdc8573"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:02:24.223278 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.223243    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5b876cb-22d3-48d8-9445-01999cdc8573-kube-api-access-5lc6t" (OuterVolumeSpecName: "kube-api-access-5lc6t") pod "d5b876cb-22d3-48d8-9445-01999cdc8573" (UID: "d5b876cb-22d3-48d8-9445-01999cdc8573"). InnerVolumeSpecName "kube-api-access-5lc6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:02:24.223500 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.223463    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d5b876cb-22d3-48d8-9445-01999cdc8573" (UID: "d5b876cb-22d3-48d8-9445-01999cdc8573"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:02:24.233039 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.232978    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d5b876cb-22d3-48d8-9445-01999cdc8573" (UID: "d5b876cb-22d3-48d8-9445-01999cdc8573"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:02:24.318106 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.318074    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lc6t\" (UniqueName: \"kubernetes.io/projected/d5b876cb-22d3-48d8-9445-01999cdc8573-kube-api-access-5lc6t\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:02:24.318106 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.318105    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5b876cb-22d3-48d8-9445-01999cdc8573-openshift-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:02:24.318288 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.318120    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-maas-api-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:02:24.318288 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.318132    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5b876cb-22d3-48d8-9445-01999cdc8573-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:02:24.643917 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.643882    2571 generic.go:356] "Generic (PLEG): container finished" podID="d5b876cb-22d3-48d8-9445-01999cdc8573" containerID="79ce20ced60a1453e28543270774ff3c99be98af0ca0ca60df44a931917f09ee" exitCode=0
Sep 15 12:02:24.644095 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.643927    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"
Sep 15 12:02:24.644095 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.643966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28" event={"ID":"d5b876cb-22d3-48d8-9445-01999cdc8573","Type":"ContainerDied","Data":"79ce20ced60a1453e28543270774ff3c99be98af0ca0ca60df44a931917f09ee"}
Sep 15 12:02:24.644095 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.644025    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28" event={"ID":"d5b876cb-22d3-48d8-9445-01999cdc8573","Type":"ContainerDied","Data":"770db294153040e4f43e06f260741944e5ce1678805c5792236220159ef0fd24"}
Sep 15 12:02:24.644095 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.644053    2571 scope.go:117] "RemoveContainer" containerID="79ce20ced60a1453e28543270774ff3c99be98af0ca0ca60df44a931917f09ee"
Sep 15 12:02:24.653330 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.653310    2571 scope.go:117] "RemoveContainer" containerID="79ce20ced60a1453e28543270774ff3c99be98af0ca0ca60df44a931917f09ee"
Sep 15 12:02:24.653588 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:02:24.653572    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79ce20ced60a1453e28543270774ff3c99be98af0ca0ca60df44a931917f09ee\": container with ID starting with 79ce20ced60a1453e28543270774ff3c99be98af0ca0ca60df44a931917f09ee not found: ID does not exist" containerID="79ce20ced60a1453e28543270774ff3c99be98af0ca0ca60df44a931917f09ee"
Sep 15 12:02:24.653635 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.653596    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79ce20ced60a1453e28543270774ff3c99be98af0ca0ca60df44a931917f09ee"} err="failed to get container status \"79ce20ced60a1453e28543270774ff3c99be98af0ca0ca60df44a931917f09ee\": rpc error: code = NotFound desc = could not find container \"79ce20ced60a1453e28543270774ff3c99be98af0ca0ca60df44a931917f09ee\": container with ID starting with 79ce20ced60a1453e28543270774ff3c99be98af0ca0ca60df44a931917f09ee not found: ID does not exist"
Sep 15 12:02:24.673093 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.673070    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"]
Sep 15 12:02:24.678266 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:24.678247    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-d2de76-6658766f77-g4j28"]
Sep 15 12:02:26.215707 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:26.215672    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5b876cb-22d3-48d8-9445-01999cdc8573" path="/var/lib/kubelet/pods/d5b876cb-22d3-48d8-9445-01999cdc8573/volumes"
Sep 15 12:02:26.468608 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:26.468534    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:26.638563 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:26.638537    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:27.579023 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:27.578989    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:31.710977 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:31.710946    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:31.811639 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:31.811609    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:33.733517 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:33.733486    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:54.230652 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:54.230574    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:02:58.774302 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:58.774267    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f_afcc333c-6c8c-426c-b195-f4e85854dbac/payload-processing/0.log"
Sep 15 12:02:58.912791 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:58.912763    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-jjnsc_ba184fb9-5c6e-4777-98de-9b779cb5ac0c/payload-processing/0.log"
Sep 15 12:02:59.046205 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:59.046138    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-jjnsc_ba184fb9-5c6e-4777-98de-9b779cb5ac0c/payload-processing/0.log"
Sep 15 12:02:59.177488 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:02:59.177460    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl_db39eef7-97f9-4651-955c-c07e9a6fc5e0/payload-processing/0.log"
Sep 15 12:03:02.793751 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:02.793719    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:02.894827 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:02.894795    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:03.345246 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:03.345179    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:03.448926 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:03.448895    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:03.549558 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:03.549528    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:04.257346 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:04.257312    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:04.895751 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:04.895717    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:05.739456 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:05.739416    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:06.511264 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:06.511236    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:09.759847 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:09.759810    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:09.860330 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:09.860305    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:28.404829 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:28.404785    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:28.506581 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:28.506547    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:29.074260 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:29.074233    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:29.729561 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:29.729521    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:30.384132 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:30.384069    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:31.176658 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:31.176627    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:31.704543 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:31.704510    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:32.504241 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:32.504209    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:33.253713 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:33.253679    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:34.932916 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:34.932883    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:35.483681 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:35.483640    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:35.559039 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:35.559007    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:35.620466 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:35.620435    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:35.721295 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:35.721261    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:35.826454 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:35.826386    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:36.085463 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:36.085384    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:36.186048 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:36.186017    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:36.735565 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:36.735535    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:37.532528 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:37.532496    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:38.203549 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:38.203517    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:38.832806 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:38.832757    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:45.487748 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:45.487719    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:45.588580 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:45.588550    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:46.805591 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:46.805547    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:47.606521 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:47.606487    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:51.251542 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:51.251509    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:51.306490 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:51.306459    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:03:57.208549 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:03:57.208479    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:02.768561 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:02.768528    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"]
Sep 15 12:04:02.770994 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:02.768755    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9" podUID="b46701af-ecd2-468e-b7e3-6b30a6524f18" containerName="maas-api" containerID="cri-o://e2be997dd7cfe2d463bd3d15ddf9b21c45f8aed3d70d9eaf8229507e041e1fb9" gracePeriod=30
Sep 15 12:04:02.793208 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:02.793182    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:02.821528 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:02.821282    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"]
Sep 15 12:04:02.821904 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:02.821862    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f" podUID="afcc333c-6c8c-426c-b195-f4e85854dbac" containerName="payload-processing" containerID="cri-o://5f3d6a315483354f7fea8de9ed1fc35f7636e3a527f6a4eacf731405fcb7d308" gracePeriod=30
Sep 15 12:04:02.825807 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:02.825772    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"]
Sep 15 12:04:02.826111 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:02.826061    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq" podUID="633ce068-6c48-4d73-a90c-2488b10edde8" containerName="payload-pre-processing" containerID="cri-o://424a5b5f227df81256dab7d108051e3690f118f1cb73530dab8bd0e20143115d" gracePeriod=30
Sep 15 12:04:02.908786 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:02.908754    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:03.004421 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.004393    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:03.104407 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.104376    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:03.150811 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.150787    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:04:03.154384 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.154353    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"
Sep 15 12:04:03.158197 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.158178    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"
Sep 15 12:04:03.200557 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.200522    2571 generic.go:356] "Generic (PLEG): container finished" podID="afcc333c-6c8c-426c-b195-f4e85854dbac" containerID="5f3d6a315483354f7fea8de9ed1fc35f7636e3a527f6a4eacf731405fcb7d308" exitCode=0
Sep 15 12:04:03.200762 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.200569    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"
Sep 15 12:04:03.200762 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.200609    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f" event={"ID":"afcc333c-6c8c-426c-b195-f4e85854dbac","Type":"ContainerDied","Data":"5f3d6a315483354f7fea8de9ed1fc35f7636e3a527f6a4eacf731405fcb7d308"}
Sep 15 12:04:03.200762 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.200665    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f" event={"ID":"afcc333c-6c8c-426c-b195-f4e85854dbac","Type":"ContainerDied","Data":"fd5d21372ea33043b78e07ae0c106ee6fe07736f9fcdd5f44150c3b9aeaf5def"}
Sep 15 12:04:03.200762 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.200695    2571 scope.go:117] "RemoveContainer" containerID="5f3d6a315483354f7fea8de9ed1fc35f7636e3a527f6a4eacf731405fcb7d308"
Sep 15 12:04:03.202315 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.202290    2571 generic.go:356] "Generic (PLEG): container finished" podID="633ce068-6c48-4d73-a90c-2488b10edde8" containerID="424a5b5f227df81256dab7d108051e3690f118f1cb73530dab8bd0e20143115d" exitCode=0
Sep 15 12:04:03.202445 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.202337    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"
Sep 15 12:04:03.202445 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.202396    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq" event={"ID":"633ce068-6c48-4d73-a90c-2488b10edde8","Type":"ContainerDied","Data":"424a5b5f227df81256dab7d108051e3690f118f1cb73530dab8bd0e20143115d"}
Sep 15 12:04:03.202445 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.202436    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq" event={"ID":"633ce068-6c48-4d73-a90c-2488b10edde8","Type":"ContainerDied","Data":"625d3f412cca1ee04949bb68c07b06284b3b16a4d411c043a68c945ab20dd44a"}
Sep 15 12:04:03.204041 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.204011    2571 generic.go:356] "Generic (PLEG): container finished" podID="b46701af-ecd2-468e-b7e3-6b30a6524f18" containerID="e2be997dd7cfe2d463bd3d15ddf9b21c45f8aed3d70d9eaf8229507e041e1fb9" exitCode=0
Sep 15 12:04:03.204146 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.204048    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"
Sep 15 12:04:03.204146 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.204059    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9" event={"ID":"b46701af-ecd2-468e-b7e3-6b30a6524f18","Type":"ContainerDied","Data":"e2be997dd7cfe2d463bd3d15ddf9b21c45f8aed3d70d9eaf8229507e041e1fb9"}
Sep 15 12:04:03.204146 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.204099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9" event={"ID":"b46701af-ecd2-468e-b7e3-6b30a6524f18","Type":"ContainerDied","Data":"aff6c27f21c5827276ad190d7a5a7d57f811e749df60468ae834e535f87f9190"}
Sep 15 12:04:03.231835 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.228137    2571 scope.go:117] "RemoveContainer" containerID="5f3d6a315483354f7fea8de9ed1fc35f7636e3a527f6a4eacf731405fcb7d308"
Sep 15 12:04:03.231835 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:04:03.228600    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f3d6a315483354f7fea8de9ed1fc35f7636e3a527f6a4eacf731405fcb7d308\": container with ID starting with 5f3d6a315483354f7fea8de9ed1fc35f7636e3a527f6a4eacf731405fcb7d308 not found: ID does not exist" containerID="5f3d6a315483354f7fea8de9ed1fc35f7636e3a527f6a4eacf731405fcb7d308"
Sep 15 12:04:03.231835 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.228638    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f3d6a315483354f7fea8de9ed1fc35f7636e3a527f6a4eacf731405fcb7d308"} err="failed to get container status \"5f3d6a315483354f7fea8de9ed1fc35f7636e3a527f6a4eacf731405fcb7d308\": rpc error: code = NotFound desc = could not find container \"5f3d6a315483354f7fea8de9ed1fc35f7636e3a527f6a4eacf731405fcb7d308\": container with ID starting with 5f3d6a315483354f7fea8de9ed1fc35f7636e3a527f6a4eacf731405fcb7d308 not found: ID does not exist"
Sep 15 12:04:03.231835 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.228661    2571 scope.go:117] "RemoveContainer" containerID="424a5b5f227df81256dab7d108051e3690f118f1cb73530dab8bd0e20143115d"
Sep 15 12:04:03.242383 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.242363    2571 scope.go:117] "RemoveContainer" containerID="424a5b5f227df81256dab7d108051e3690f118f1cb73530dab8bd0e20143115d"
Sep 15 12:04:03.242882 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:04:03.242856    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"424a5b5f227df81256dab7d108051e3690f118f1cb73530dab8bd0e20143115d\": container with ID starting with 424a5b5f227df81256dab7d108051e3690f118f1cb73530dab8bd0e20143115d not found: ID does not exist" containerID="424a5b5f227df81256dab7d108051e3690f118f1cb73530dab8bd0e20143115d"
Sep 15 12:04:03.242983 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.242896    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424a5b5f227df81256dab7d108051e3690f118f1cb73530dab8bd0e20143115d"} err="failed to get container status \"424a5b5f227df81256dab7d108051e3690f118f1cb73530dab8bd0e20143115d\": rpc error: code = NotFound desc = could not find container \"424a5b5f227df81256dab7d108051e3690f118f1cb73530dab8bd0e20143115d\": container with ID starting with 424a5b5f227df81256dab7d108051e3690f118f1cb73530dab8bd0e20143115d not found: ID does not exist"
Sep 15 12:04:03.242983 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.242924    2571 scope.go:117] "RemoveContainer" containerID="e2be997dd7cfe2d463bd3d15ddf9b21c45f8aed3d70d9eaf8229507e041e1fb9"
Sep 15 12:04:03.252203 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.252180    2571 scope.go:117] "RemoveContainer" containerID="e2be997dd7cfe2d463bd3d15ddf9b21c45f8aed3d70d9eaf8229507e041e1fb9"
Sep 15 12:04:03.252485 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:04:03.252460    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2be997dd7cfe2d463bd3d15ddf9b21c45f8aed3d70d9eaf8229507e041e1fb9\": container with ID starting with e2be997dd7cfe2d463bd3d15ddf9b21c45f8aed3d70d9eaf8229507e041e1fb9 not found: ID does not exist" containerID="e2be997dd7cfe2d463bd3d15ddf9b21c45f8aed3d70d9eaf8229507e041e1fb9"
Sep 15 12:04:03.252546 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.252501    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2be997dd7cfe2d463bd3d15ddf9b21c45f8aed3d70d9eaf8229507e041e1fb9"} err="failed to get container status \"e2be997dd7cfe2d463bd3d15ddf9b21c45f8aed3d70d9eaf8229507e041e1fb9\": rpc error: code = NotFound desc = could not find container \"e2be997dd7cfe2d463bd3d15ddf9b21c45f8aed3d70d9eaf8229507e041e1fb9\": container with ID starting with e2be997dd7cfe2d463bd3d15ddf9b21c45f8aed3d70d9eaf8229507e041e1fb9 not found: ID does not exist"
Sep 15 12:04:03.258835 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.258811    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afcc333c-6c8c-426c-b195-f4e85854dbac-plugins-config-volume\") pod \"afcc333c-6c8c-426c-b195-f4e85854dbac\" (UID: \"afcc333c-6c8c-426c-b195-f4e85854dbac\") "
Sep 15 12:04:03.258961 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.258855    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcnnc\" (UniqueName: \"kubernetes.io/projected/b46701af-ecd2-468e-b7e3-6b30a6524f18-kube-api-access-mcnnc\") pod \"b46701af-ecd2-468e-b7e3-6b30a6524f18\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") "
Sep 15 12:04:03.258961 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.258922    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-maas-api-tls\") pod \"b46701af-ecd2-468e-b7e3-6b30a6524f18\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") "
Sep 15 12:04:03.258961 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.258949    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxglb\" (UniqueName: \"kubernetes.io/projected/afcc333c-6c8c-426c-b195-f4e85854dbac-kube-api-access-gxglb\") pod \"afcc333c-6c8c-426c-b195-f4e85854dbac\" (UID: \"afcc333c-6c8c-426c-b195-f4e85854dbac\") "
Sep 15 12:04:03.259122 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.258975    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/633ce068-6c48-4d73-a90c-2488b10edde8-plugins-config-volume\") pod \"633ce068-6c48-4d73-a90c-2488b10edde8\" (UID: \"633ce068-6c48-4d73-a90c-2488b10edde8\") "
Sep 15 12:04:03.259122 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.259015    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-metrics-certs\") pod \"b46701af-ecd2-468e-b7e3-6b30a6524f18\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") "
Sep 15 12:04:03.259122 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.259060    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cbmr\" (UniqueName: \"kubernetes.io/projected/633ce068-6c48-4d73-a90c-2488b10edde8-kube-api-access-7cbmr\") pod \"633ce068-6c48-4d73-a90c-2488b10edde8\" (UID: \"633ce068-6c48-4d73-a90c-2488b10edde8\") "
Sep 15 12:04:03.259330 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.259195    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b46701af-ecd2-468e-b7e3-6b30a6524f18-openshift-service-ca\") pod \"b46701af-ecd2-468e-b7e3-6b30a6524f18\" (UID: \"b46701af-ecd2-468e-b7e3-6b30a6524f18\") "
Sep 15 12:04:03.259330 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.259215    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afcc333c-6c8c-426c-b195-f4e85854dbac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "afcc333c-6c8c-426c-b195-f4e85854dbac" (UID: "afcc333c-6c8c-426c-b195-f4e85854dbac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:04:03.259477 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.259451    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/633ce068-6c48-4d73-a90c-2488b10edde8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "633ce068-6c48-4d73-a90c-2488b10edde8" (UID: "633ce068-6c48-4d73-a90c-2488b10edde8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:04:03.259813 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.259761    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afcc333c-6c8c-426c-b195-f4e85854dbac-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:04:03.259813 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.259788    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/633ce068-6c48-4d73-a90c-2488b10edde8-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:04:03.259813 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.259796    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46701af-ecd2-468e-b7e3-6b30a6524f18-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b46701af-ecd2-468e-b7e3-6b30a6524f18" (UID: "b46701af-ecd2-468e-b7e3-6b30a6524f18"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:04:03.261419 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.261397    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/633ce068-6c48-4d73-a90c-2488b10edde8-kube-api-access-7cbmr" (OuterVolumeSpecName: "kube-api-access-7cbmr") pod "633ce068-6c48-4d73-a90c-2488b10edde8" (UID: "633ce068-6c48-4d73-a90c-2488b10edde8"). InnerVolumeSpecName "kube-api-access-7cbmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:04:03.261506 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.261427    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afcc333c-6c8c-426c-b195-f4e85854dbac-kube-api-access-gxglb" (OuterVolumeSpecName: "kube-api-access-gxglb") pod "afcc333c-6c8c-426c-b195-f4e85854dbac" (UID: "afcc333c-6c8c-426c-b195-f4e85854dbac"). InnerVolumeSpecName "kube-api-access-gxglb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:04:03.261506 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.261426    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b46701af-ecd2-468e-b7e3-6b30a6524f18" (UID: "b46701af-ecd2-468e-b7e3-6b30a6524f18"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:04:03.261590 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.261581    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b46701af-ecd2-468e-b7e3-6b30a6524f18" (UID: "b46701af-ecd2-468e-b7e3-6b30a6524f18"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:04:03.261627 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.261588    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b46701af-ecd2-468e-b7e3-6b30a6524f18-kube-api-access-mcnnc" (OuterVolumeSpecName: "kube-api-access-mcnnc") pod "b46701af-ecd2-468e-b7e3-6b30a6524f18" (UID: "b46701af-ecd2-468e-b7e3-6b30a6524f18"). InnerVolumeSpecName "kube-api-access-mcnnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:04:03.360477 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.360381    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:04:03.360477 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.360413    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cbmr\" (UniqueName: \"kubernetes.io/projected/633ce068-6c48-4d73-a90c-2488b10edde8-kube-api-access-7cbmr\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:04:03.360477 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.360427    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b46701af-ecd2-468e-b7e3-6b30a6524f18-openshift-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:04:03.360477 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.360439    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcnnc\" (UniqueName: \"kubernetes.io/projected/b46701af-ecd2-468e-b7e3-6b30a6524f18-kube-api-access-mcnnc\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:04:03.360477 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.360451    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b46701af-ecd2-468e-b7e3-6b30a6524f18-maas-api-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:04:03.360477 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.360462    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxglb\" (UniqueName: \"kubernetes.io/projected/afcc333c-6c8c-426c-b195-f4e85854dbac-kube-api-access-gxglb\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:04:03.464767 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.464716    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:03.524839 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.524809    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"]
Sep 15 12:04:03.527878 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.527834    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:03.528727 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.528703    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-030981-5b9b75845f-f8f7f"]
Sep 15 12:04:03.540357 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.540336    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"]
Sep 15 12:04:03.542280 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.542259    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-030981-7845f8fdfd-48ptq"]
Sep 15 12:04:03.553417 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.553389    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"]
Sep 15 12:04:03.557394 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:03.557368    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-030981-d6bbb9bc4-jd5b9"]
Sep 15 12:04:04.215434 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:04.215396    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="633ce068-6c48-4d73-a90c-2488b10edde8" path="/var/lib/kubelet/pods/633ce068-6c48-4d73-a90c-2488b10edde8/volumes"
Sep 15 12:04:04.215877 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:04.215859    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afcc333c-6c8c-426c-b195-f4e85854dbac" path="/var/lib/kubelet/pods/afcc333c-6c8c-426c-b195-f4e85854dbac/volumes"
Sep 15 12:04:04.216285 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:04.216269    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b46701af-ecd2-468e-b7e3-6b30a6524f18" path="/var/lib/kubelet/pods/b46701af-ecd2-468e-b7e3-6b30a6524f18/volumes"
Sep 15 12:04:04.290395 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:04.290360    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:04.966185 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:04.966126    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:05.614283 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:05.614241    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:08.547306 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:08.547269    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:10.056423 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:10.056391    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:40.264657 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:40.264598    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:45.375262 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:45.375230    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:46.077408 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:46.077370    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:52.045675 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:52.045637    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:52.146795 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:52.146757    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:52.343258 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:52.343124    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:52.974788 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:52.974754    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:53.887628 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:53.887583    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:54.517292 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:54.517258    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:55.427195 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:55.427149    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:04:56.314375 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:04:56.314338    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:03.222188 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.222105    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:03.250211 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.250171    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"]
Sep 15 12:05:03.250445 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.250413    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl" podUID="db39eef7-97f9-4651-955c-c07e9a6fc5e0" containerName="payload-processing" containerID="cri-o://7a175ee62b6cde8d8df8e90641f707ca38d0677947a3e61e86131b9a1ffebd31" gracePeriod=30
Sep 15 12:05:03.509987 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.509960    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"
Sep 15 12:05:03.549017 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.548982    2571 generic.go:356] "Generic (PLEG): container finished" podID="db39eef7-97f9-4651-955c-c07e9a6fc5e0" containerID="7a175ee62b6cde8d8df8e90641f707ca38d0677947a3e61e86131b9a1ffebd31" exitCode=0
Sep 15 12:05:03.549017 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.549027    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"
Sep 15 12:05:03.549273 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.549065    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl" event={"ID":"db39eef7-97f9-4651-955c-c07e9a6fc5e0","Type":"ContainerDied","Data":"7a175ee62b6cde8d8df8e90641f707ca38d0677947a3e61e86131b9a1ffebd31"}
Sep 15 12:05:03.549273 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.549118    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl" event={"ID":"db39eef7-97f9-4651-955c-c07e9a6fc5e0","Type":"ContainerDied","Data":"093930f8dfa40b90a0d3ff3261feb823a9dccd5780ef48459b825334850135d3"}
Sep 15 12:05:03.549273 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.549143    2571 scope.go:117] "RemoveContainer" containerID="7a175ee62b6cde8d8df8e90641f707ca38d0677947a3e61e86131b9a1ffebd31"
Sep 15 12:05:03.563336 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.563298    2571 scope.go:117] "RemoveContainer" containerID="7a175ee62b6cde8d8df8e90641f707ca38d0677947a3e61e86131b9a1ffebd31"
Sep 15 12:05:03.563936 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:05:03.563905    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a175ee62b6cde8d8df8e90641f707ca38d0677947a3e61e86131b9a1ffebd31\": container with ID starting with 7a175ee62b6cde8d8df8e90641f707ca38d0677947a3e61e86131b9a1ffebd31 not found: ID does not exist" containerID="7a175ee62b6cde8d8df8e90641f707ca38d0677947a3e61e86131b9a1ffebd31"
Sep 15 12:05:03.564061 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.563947    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a175ee62b6cde8d8df8e90641f707ca38d0677947a3e61e86131b9a1ffebd31"} err="failed to get container status \"7a175ee62b6cde8d8df8e90641f707ca38d0677947a3e61e86131b9a1ffebd31\": rpc error: code = NotFound desc = could not find container \"7a175ee62b6cde8d8df8e90641f707ca38d0677947a3e61e86131b9a1ffebd31\": container with ID starting with 7a175ee62b6cde8d8df8e90641f707ca38d0677947a3e61e86131b9a1ffebd31 not found: ID does not exist"
Sep 15 12:05:03.669609 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.669572    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db39eef7-97f9-4651-955c-c07e9a6fc5e0-plugins-config-volume\") pod \"db39eef7-97f9-4651-955c-c07e9a6fc5e0\" (UID: \"db39eef7-97f9-4651-955c-c07e9a6fc5e0\") "
Sep 15 12:05:03.669785 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.669640    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg2lm\" (UniqueName: \"kubernetes.io/projected/db39eef7-97f9-4651-955c-c07e9a6fc5e0-kube-api-access-lg2lm\") pod \"db39eef7-97f9-4651-955c-c07e9a6fc5e0\" (UID: \"db39eef7-97f9-4651-955c-c07e9a6fc5e0\") "
Sep 15 12:05:03.670069 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.670036    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db39eef7-97f9-4651-955c-c07e9a6fc5e0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "db39eef7-97f9-4651-955c-c07e9a6fc5e0" (UID: "db39eef7-97f9-4651-955c-c07e9a6fc5e0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:05:03.671838 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.671810    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db39eef7-97f9-4651-955c-c07e9a6fc5e0-kube-api-access-lg2lm" (OuterVolumeSpecName: "kube-api-access-lg2lm") pod "db39eef7-97f9-4651-955c-c07e9a6fc5e0" (UID: "db39eef7-97f9-4651-955c-c07e9a6fc5e0"). InnerVolumeSpecName "kube-api-access-lg2lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:03.770838 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.770752    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg2lm\" (UniqueName: \"kubernetes.io/projected/db39eef7-97f9-4651-955c-c07e9a6fc5e0-kube-api-access-lg2lm\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:03.770838 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.770786    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db39eef7-97f9-4651-955c-c07e9a6fc5e0-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:03.873237 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.873201    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"]
Sep 15 12:05:03.879084 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:03.879046    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0249d8-597dcfbc85-k5twl"]
Sep 15 12:05:04.216235 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:04.216196    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db39eef7-97f9-4651-955c-c07e9a6fc5e0" path="/var/lib/kubelet/pods/db39eef7-97f9-4651-955c-c07e9a6fc5e0/volumes"
Sep 15 12:05:06.348626 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:06.348591    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:06.410717 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:06.410681    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:10.003872 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:10.003832    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:10.085028 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:10.084987    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:10.325803 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:10.325680    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:10.951788 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:10.951753    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:11.993093 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:11.993059    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:12.593925 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:12.593891    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:13.299961 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:13.299919    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:21.212061 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.212024    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"]
Sep 15 12:05:21.212541 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.212305    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w" podUID="d48a91f1-2a37-4744-8d00-371698d76b0b" containerName="maas-api" containerID="cri-o://4e6c58d0e2fb115a09c09d0c823a8773cda1ad44f2640d46ba41370564a05e87" gracePeriod=30
Sep 15 12:05:21.241078 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.241046    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:21.479147 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.479083    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 12:05:21.552686 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.552653    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kftwf\" (UniqueName: \"kubernetes.io/projected/d48a91f1-2a37-4744-8d00-371698d76b0b-kube-api-access-kftwf\") pod \"d48a91f1-2a37-4744-8d00-371698d76b0b\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") "
Sep 15 12:05:21.552896 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.552753    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d48a91f1-2a37-4744-8d00-371698d76b0b-openshift-service-ca\") pod \"d48a91f1-2a37-4744-8d00-371698d76b0b\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") "
Sep 15 12:05:21.552896 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.552813    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d48a91f1-2a37-4744-8d00-371698d76b0b-maas-api-tls\") pod \"d48a91f1-2a37-4744-8d00-371698d76b0b\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") "
Sep 15 12:05:21.553037 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.552924    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d48a91f1-2a37-4744-8d00-371698d76b0b-metrics-certs\") pod \"d48a91f1-2a37-4744-8d00-371698d76b0b\" (UID: \"d48a91f1-2a37-4744-8d00-371698d76b0b\") "
Sep 15 12:05:21.553145 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.553112    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d48a91f1-2a37-4744-8d00-371698d76b0b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d48a91f1-2a37-4744-8d00-371698d76b0b" (UID: "d48a91f1-2a37-4744-8d00-371698d76b0b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:05:21.553426 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.553403    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d48a91f1-2a37-4744-8d00-371698d76b0b-openshift-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:21.555172 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.555127    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d48a91f1-2a37-4744-8d00-371698d76b0b-kube-api-access-kftwf" (OuterVolumeSpecName: "kube-api-access-kftwf") pod "d48a91f1-2a37-4744-8d00-371698d76b0b" (UID: "d48a91f1-2a37-4744-8d00-371698d76b0b"). InnerVolumeSpecName "kube-api-access-kftwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:21.555286 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.555243    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d48a91f1-2a37-4744-8d00-371698d76b0b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d48a91f1-2a37-4744-8d00-371698d76b0b" (UID: "d48a91f1-2a37-4744-8d00-371698d76b0b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:05:21.555429 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.555401    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d48a91f1-2a37-4744-8d00-371698d76b0b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d48a91f1-2a37-4744-8d00-371698d76b0b" (UID: "d48a91f1-2a37-4744-8d00-371698d76b0b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:05:21.653778 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.653736    2571 generic.go:356] "Generic (PLEG): container finished" podID="d48a91f1-2a37-4744-8d00-371698d76b0b" containerID="4e6c58d0e2fb115a09c09d0c823a8773cda1ad44f2640d46ba41370564a05e87" exitCode=0
Sep 15 12:05:21.653983 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.653789    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"
Sep 15 12:05:21.653983 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.653820    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w" event={"ID":"d48a91f1-2a37-4744-8d00-371698d76b0b","Type":"ContainerDied","Data":"4e6c58d0e2fb115a09c09d0c823a8773cda1ad44f2640d46ba41370564a05e87"}
Sep 15 12:05:21.653983 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.653871    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w" event={"ID":"d48a91f1-2a37-4744-8d00-371698d76b0b","Type":"ContainerDied","Data":"0eaefff609ba5dfbf4486b4218365cc5029e4149bda160ff57b2c37e707e2d82"}
Sep 15 12:05:21.653983 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.653896    2571 scope.go:117] "RemoveContainer" containerID="4e6c58d0e2fb115a09c09d0c823a8773cda1ad44f2640d46ba41370564a05e87"
Sep 15 12:05:21.653983 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.653961    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kftwf\" (UniqueName: \"kubernetes.io/projected/d48a91f1-2a37-4744-8d00-371698d76b0b-kube-api-access-kftwf\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:21.654363 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.654140    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d48a91f1-2a37-4744-8d00-371698d76b0b-maas-api-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:21.654363 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.654175    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d48a91f1-2a37-4744-8d00-371698d76b0b-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:21.664664 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.664642    2571 scope.go:117] "RemoveContainer" containerID="4e6c58d0e2fb115a09c09d0c823a8773cda1ad44f2640d46ba41370564a05e87"
Sep 15 12:05:21.664975 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:05:21.664953    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e6c58d0e2fb115a09c09d0c823a8773cda1ad44f2640d46ba41370564a05e87\": container with ID starting with 4e6c58d0e2fb115a09c09d0c823a8773cda1ad44f2640d46ba41370564a05e87 not found: ID does not exist" containerID="4e6c58d0e2fb115a09c09d0c823a8773cda1ad44f2640d46ba41370564a05e87"
Sep 15 12:05:21.665079 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.664980    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6c58d0e2fb115a09c09d0c823a8773cda1ad44f2640d46ba41370564a05e87"} err="failed to get container status \"4e6c58d0e2fb115a09c09d0c823a8773cda1ad44f2640d46ba41370564a05e87\": rpc error: code = NotFound desc = could not find container \"4e6c58d0e2fb115a09c09d0c823a8773cda1ad44f2640d46ba41370564a05e87\": container with ID starting with 4e6c58d0e2fb115a09c09d0c823a8773cda1ad44f2640d46ba41370564a05e87 not found: ID does not exist"
Sep 15 12:05:21.686431 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.686387    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"]
Sep 15 12:05:21.686636 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:21.686509    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-42b26e-6fdccdf594-tq66w"]
Sep 15 12:05:22.215061 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:22.215021    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d48a91f1-2a37-4744-8d00-371698d76b0b" path="/var/lib/kubelet/pods/d48a91f1-2a37-4744-8d00-371698d76b0b/volumes"
Sep 15 12:05:24.422252 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:24.422207    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:24.521856 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:24.521821    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:28.184093 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:28.184053    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"]
Sep 15 12:05:28.184544 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:28.184384    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerName="istio-proxy" containerID="cri-o://6d69164dcfc90638ffb21e2666ed06ae9d06f5ad364edee9bcaf70133ba7609c" gracePeriod=30
Sep 15 12:05:30.850309 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:30.850274    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:30.910834 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:30.910800    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:33.450354 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.450276    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 12:05:33.581041 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.580993    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt9zh\" (UniqueName: \"kubernetes.io/projected/385370d3-ef33-4288-b609-b082c2b6d6a0-kube-api-access-wt9zh\") pod \"385370d3-ef33-4288-b609-b082c2b6d6a0\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") "
Sep 15 12:05:33.581252 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581052    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/385370d3-ef33-4288-b609-b082c2b6d6a0-istiod-ca-cert\") pod \"385370d3-ef33-4288-b609-b082c2b6d6a0\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") "
Sep 15 12:05:33.581252 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581212    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-podinfo\") pod \"385370d3-ef33-4288-b609-b082c2b6d6a0\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") "
Sep 15 12:05:33.581405 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581254    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-workload-socket\") pod \"385370d3-ef33-4288-b609-b082c2b6d6a0\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") "
Sep 15 12:05:33.581405 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581308    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-workload-certs\") pod \"385370d3-ef33-4288-b609-b082c2b6d6a0\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") "
Sep 15 12:05:33.581405 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581359    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-envoy\") pod \"385370d3-ef33-4288-b609-b082c2b6d6a0\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") "
Sep 15 12:05:33.581405 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581396    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-data\") pod \"385370d3-ef33-4288-b609-b082c2b6d6a0\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") "
Sep 15 12:05:33.581602 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581427    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-token\") pod \"385370d3-ef33-4288-b609-b082c2b6d6a0\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") "
Sep 15 12:05:33.581602 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581475    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-credential-socket\") pod \"385370d3-ef33-4288-b609-b082c2b6d6a0\" (UID: \"385370d3-ef33-4288-b609-b082c2b6d6a0\") "
Sep 15 12:05:33.581602 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581476    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/385370d3-ef33-4288-b609-b082c2b6d6a0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "385370d3-ef33-4288-b609-b082c2b6d6a0" (UID: "385370d3-ef33-4288-b609-b082c2b6d6a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:05:33.581602 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581566    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "385370d3-ef33-4288-b609-b082c2b6d6a0" (UID: "385370d3-ef33-4288-b609-b082c2b6d6a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:33.581602 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581553    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "385370d3-ef33-4288-b609-b082c2b6d6a0" (UID: "385370d3-ef33-4288-b609-b082c2b6d6a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:33.581882 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581859    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "385370d3-ef33-4288-b609-b082c2b6d6a0" (UID: "385370d3-ef33-4288-b609-b082c2b6d6a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:33.581882 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581871    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-workload-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:33.581987 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581893    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/385370d3-ef33-4288-b609-b082c2b6d6a0-istiod-ca-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:33.581987 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581878    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-data" (OuterVolumeSpecName: "istio-data") pod "385370d3-ef33-4288-b609-b082c2b6d6a0" (UID: "385370d3-ef33-4288-b609-b082c2b6d6a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:33.581987 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.581907    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-workload-socket\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:33.583475 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.583443    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "385370d3-ef33-4288-b609-b082c2b6d6a0" (UID: "385370d3-ef33-4288-b609-b082c2b6d6a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 12:05:33.583582 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.583526    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "385370d3-ef33-4288-b609-b082c2b6d6a0" (UID: "385370d3-ef33-4288-b609-b082c2b6d6a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:05:33.583717 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.583691    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/385370d3-ef33-4288-b609-b082c2b6d6a0-kube-api-access-wt9zh" (OuterVolumeSpecName: "kube-api-access-wt9zh") pod "385370d3-ef33-4288-b609-b082c2b6d6a0" (UID: "385370d3-ef33-4288-b609-b082c2b6d6a0"). InnerVolumeSpecName "kube-api-access-wt9zh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:33.583942 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.583921    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-token" (OuterVolumeSpecName: "istio-token") pod "385370d3-ef33-4288-b609-b082c2b6d6a0" (UID: "385370d3-ef33-4288-b609-b082c2b6d6a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:33.682990 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.682949    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-envoy\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:33.682990 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.682982    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-data\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:33.682990 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.682991    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-token\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:33.682990 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.682999    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/385370d3-ef33-4288-b609-b082c2b6d6a0-credential-socket\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:33.683291 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.683008    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt9zh\" (UniqueName: \"kubernetes.io/projected/385370d3-ef33-4288-b609-b082c2b6d6a0-kube-api-access-wt9zh\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:33.683291 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.683017    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/385370d3-ef33-4288-b609-b082c2b6d6a0-istio-podinfo\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:33.720459 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.720366    2571 generic.go:356] "Generic (PLEG): container finished" podID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerID="6d69164dcfc90638ffb21e2666ed06ae9d06f5ad364edee9bcaf70133ba7609c" exitCode=0
Sep 15 12:05:33.720459 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.720420    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"
Sep 15 12:05:33.720459 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.720444    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" event={"ID":"385370d3-ef33-4288-b609-b082c2b6d6a0","Type":"ContainerDied","Data":"6d69164dcfc90638ffb21e2666ed06ae9d06f5ad364edee9bcaf70133ba7609c"}
Sep 15 12:05:33.720705 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.720530    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897" event={"ID":"385370d3-ef33-4288-b609-b082c2b6d6a0","Type":"ContainerDied","Data":"31eebbf904faa64a6fdc27e356bfb0df3b46d13f177f0527fcfc49b4e9a11f85"}
Sep 15 12:05:33.720705 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.720554    2571 scope.go:117] "RemoveContainer" containerID="6d69164dcfc90638ffb21e2666ed06ae9d06f5ad364edee9bcaf70133ba7609c"
Sep 15 12:05:33.730677 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.730658    2571 scope.go:117] "RemoveContainer" containerID="5e88240d59af254db0f79c9355235cd1e019e733dac458a44807896fbe9733ab"
Sep 15 12:05:33.739935 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.739913    2571 scope.go:117] "RemoveContainer" containerID="6d69164dcfc90638ffb21e2666ed06ae9d06f5ad364edee9bcaf70133ba7609c"
Sep 15 12:05:33.740310 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:05:33.740286    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d69164dcfc90638ffb21e2666ed06ae9d06f5ad364edee9bcaf70133ba7609c\": container with ID starting with 6d69164dcfc90638ffb21e2666ed06ae9d06f5ad364edee9bcaf70133ba7609c not found: ID does not exist" containerID="6d69164dcfc90638ffb21e2666ed06ae9d06f5ad364edee9bcaf70133ba7609c"
Sep 15 12:05:33.740420 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.740319    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d69164dcfc90638ffb21e2666ed06ae9d06f5ad364edee9bcaf70133ba7609c"} err="failed to get container status \"6d69164dcfc90638ffb21e2666ed06ae9d06f5ad364edee9bcaf70133ba7609c\": rpc error: code = NotFound desc = could not find container \"6d69164dcfc90638ffb21e2666ed06ae9d06f5ad364edee9bcaf70133ba7609c\": container with ID starting with 6d69164dcfc90638ffb21e2666ed06ae9d06f5ad364edee9bcaf70133ba7609c not found: ID does not exist"
Sep 15 12:05:33.740420 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.740340    2571 scope.go:117] "RemoveContainer" containerID="5e88240d59af254db0f79c9355235cd1e019e733dac458a44807896fbe9733ab"
Sep 15 12:05:33.740642 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:05:33.740625    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e88240d59af254db0f79c9355235cd1e019e733dac458a44807896fbe9733ab\": container with ID starting with 5e88240d59af254db0f79c9355235cd1e019e733dac458a44807896fbe9733ab not found: ID does not exist" containerID="5e88240d59af254db0f79c9355235cd1e019e733dac458a44807896fbe9733ab"
Sep 15 12:05:33.740693 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.740646    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e88240d59af254db0f79c9355235cd1e019e733dac458a44807896fbe9733ab"} err="failed to get container status \"5e88240d59af254db0f79c9355235cd1e019e733dac458a44807896fbe9733ab\": rpc error: code = NotFound desc = could not find container \"5e88240d59af254db0f79c9355235cd1e019e733dac458a44807896fbe9733ab\": container with ID starting with 5e88240d59af254db0f79c9355235cd1e019e733dac458a44807896fbe9733ab not found: ID does not exist"
Sep 15 12:05:33.744833 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.744807    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"]
Sep 15 12:05:33.749403 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:33.749379    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-42b26e-openshift-default-55cd788bc6-k5897"]
Sep 15 12:05:34.215195 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:34.215134    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" path="/var/lib/kubelet/pods/385370d3-ef33-4288-b609-b082c2b6d6a0/volumes"
Sep 15 12:05:37.827504 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:37.827467    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:37.927955 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:37.927921    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:39.275603 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.275570    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"]
Sep 15 12:05:39.276046 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.275830    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj" podUID="882a3df3-f9b1-46a1-a103-ecaf1d61693e" containerName="maas-api" containerID="cri-o://3e837195813cea45e3465675f28c8774a97cb410a880c03f474e200b82ec2a37" gracePeriod=30
Sep 15 12:05:39.330320 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.330286    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:39.377030 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.376996    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"]
Sep 15 12:05:39.377252 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.377225    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx" podUID="b69fd742-5be7-4da2-b9bf-84884fa72229" containerName="payload-processing" containerID="cri-o://deef65dcb6f625573f42dcce043e3f0d3aa98493804ae6e04271f1d300e4f788" gracePeriod=30
Sep 15 12:05:39.444684 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.444650    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:39.544416 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.544360    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:39.548241 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.548215    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 12:05:39.636214 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.636145    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:39.639075 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.639058    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"
Sep 15 12:05:39.645309 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.645286    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48j9j\" (UniqueName: \"kubernetes.io/projected/882a3df3-f9b1-46a1-a103-ecaf1d61693e-kube-api-access-48j9j\") pod \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") "
Sep 15 12:05:39.645455 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.645377    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-maas-api-tls\") pod \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") "
Sep 15 12:05:39.645455 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.645425    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/882a3df3-f9b1-46a1-a103-ecaf1d61693e-openshift-service-ca\") pod \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") "
Sep 15 12:05:39.645573 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.645497    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-metrics-certs\") pod \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\" (UID: \"882a3df3-f9b1-46a1-a103-ecaf1d61693e\") "
Sep 15 12:05:39.645800 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.645775    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/882a3df3-f9b1-46a1-a103-ecaf1d61693e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "882a3df3-f9b1-46a1-a103-ecaf1d61693e" (UID: "882a3df3-f9b1-46a1-a103-ecaf1d61693e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:05:39.647507 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.647474    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/882a3df3-f9b1-46a1-a103-ecaf1d61693e-kube-api-access-48j9j" (OuterVolumeSpecName: "kube-api-access-48j9j") pod "882a3df3-f9b1-46a1-a103-ecaf1d61693e" (UID: "882a3df3-f9b1-46a1-a103-ecaf1d61693e"). InnerVolumeSpecName "kube-api-access-48j9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:39.647507 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.647488    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "882a3df3-f9b1-46a1-a103-ecaf1d61693e" (UID: "882a3df3-f9b1-46a1-a103-ecaf1d61693e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:05:39.647639 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.647512    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "882a3df3-f9b1-46a1-a103-ecaf1d61693e" (UID: "882a3df3-f9b1-46a1-a103-ecaf1d61693e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:05:39.714447 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.714412    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:39.746609 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.746573    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6pxp\" (UniqueName: \"kubernetes.io/projected/b69fd742-5be7-4da2-b9bf-84884fa72229-kube-api-access-g6pxp\") pod \"b69fd742-5be7-4da2-b9bf-84884fa72229\" (UID: \"b69fd742-5be7-4da2-b9bf-84884fa72229\") "
Sep 15 12:05:39.746824 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.746632    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b69fd742-5be7-4da2-b9bf-84884fa72229-plugins-config-volume\") pod \"b69fd742-5be7-4da2-b9bf-84884fa72229\" (UID: \"b69fd742-5be7-4da2-b9bf-84884fa72229\") "
Sep 15 12:05:39.746983 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.746967    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-maas-api-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:39.747049 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.746990    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/882a3df3-f9b1-46a1-a103-ecaf1d61693e-openshift-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:39.747049 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.747006    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/882a3df3-f9b1-46a1-a103-ecaf1d61693e-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:39.747049 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.747020    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48j9j\" (UniqueName: \"kubernetes.io/projected/882a3df3-f9b1-46a1-a103-ecaf1d61693e-kube-api-access-48j9j\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:39.747145 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.747056    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69fd742-5be7-4da2-b9bf-84884fa72229-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b69fd742-5be7-4da2-b9bf-84884fa72229" (UID: "b69fd742-5be7-4da2-b9bf-84884fa72229"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:05:39.748783 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.748763    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b69fd742-5be7-4da2-b9bf-84884fa72229-kube-api-access-g6pxp" (OuterVolumeSpecName: "kube-api-access-g6pxp") pod "b69fd742-5be7-4da2-b9bf-84884fa72229" (UID: "b69fd742-5be7-4da2-b9bf-84884fa72229"). InnerVolumeSpecName "kube-api-access-g6pxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:39.757663 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.757626    2571 generic.go:356] "Generic (PLEG): container finished" podID="882a3df3-f9b1-46a1-a103-ecaf1d61693e" containerID="3e837195813cea45e3465675f28c8774a97cb410a880c03f474e200b82ec2a37" exitCode=0
Sep 15 12:05:39.757825 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.757671    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"
Sep 15 12:05:39.757825 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.757703    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj" event={"ID":"882a3df3-f9b1-46a1-a103-ecaf1d61693e","Type":"ContainerDied","Data":"3e837195813cea45e3465675f28c8774a97cb410a880c03f474e200b82ec2a37"}
Sep 15 12:05:39.757825 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.757795    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj" event={"ID":"882a3df3-f9b1-46a1-a103-ecaf1d61693e","Type":"ContainerDied","Data":"15d0d2b7ed59356e51761401bf1e87785f2ea9cc678efe7c25dd13734ecf8605"}
Sep 15 12:05:39.757980 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.757831    2571 scope.go:117] "RemoveContainer" containerID="3e837195813cea45e3465675f28c8774a97cb410a880c03f474e200b82ec2a37"
Sep 15 12:05:39.760421 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.760395    2571 generic.go:356] "Generic (PLEG): container finished" podID="b69fd742-5be7-4da2-b9bf-84884fa72229" containerID="deef65dcb6f625573f42dcce043e3f0d3aa98493804ae6e04271f1d300e4f788" exitCode=0
Sep 15 12:05:39.760563 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.760444    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"
Sep 15 12:05:39.760563 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.760480    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx" event={"ID":"b69fd742-5be7-4da2-b9bf-84884fa72229","Type":"ContainerDied","Data":"deef65dcb6f625573f42dcce043e3f0d3aa98493804ae6e04271f1d300e4f788"}
Sep 15 12:05:39.760563 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.760545    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx" event={"ID":"b69fd742-5be7-4da2-b9bf-84884fa72229","Type":"ContainerDied","Data":"9ec26151c343416c762e5d9626c64c7c7fd107aa3ab7e42bfa46d3aea07657e7"}
Sep 15 12:05:39.770566 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.770544    2571 scope.go:117] "RemoveContainer" containerID="3e837195813cea45e3465675f28c8774a97cb410a880c03f474e200b82ec2a37"
Sep 15 12:05:39.770925 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:05:39.770904    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e837195813cea45e3465675f28c8774a97cb410a880c03f474e200b82ec2a37\": container with ID starting with 3e837195813cea45e3465675f28c8774a97cb410a880c03f474e200b82ec2a37 not found: ID does not exist" containerID="3e837195813cea45e3465675f28c8774a97cb410a880c03f474e200b82ec2a37"
Sep 15 12:05:39.771001 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.770931    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e837195813cea45e3465675f28c8774a97cb410a880c03f474e200b82ec2a37"} err="failed to get container status \"3e837195813cea45e3465675f28c8774a97cb410a880c03f474e200b82ec2a37\": rpc error: code = NotFound desc = could not find container \"3e837195813cea45e3465675f28c8774a97cb410a880c03f474e200b82ec2a37\": container with ID starting with 3e837195813cea45e3465675f28c8774a97cb410a880c03f474e200b82ec2a37 not found: ID does not exist"
Sep 15 12:05:39.771001 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.770948    2571 scope.go:117] "RemoveContainer" containerID="deef65dcb6f625573f42dcce043e3f0d3aa98493804ae6e04271f1d300e4f788"
Sep 15 12:05:39.779775 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.779754    2571 scope.go:117] "RemoveContainer" containerID="deef65dcb6f625573f42dcce043e3f0d3aa98493804ae6e04271f1d300e4f788"
Sep 15 12:05:39.780103 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:05:39.780082    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deef65dcb6f625573f42dcce043e3f0d3aa98493804ae6e04271f1d300e4f788\": container with ID starting with deef65dcb6f625573f42dcce043e3f0d3aa98493804ae6e04271f1d300e4f788 not found: ID does not exist" containerID="deef65dcb6f625573f42dcce043e3f0d3aa98493804ae6e04271f1d300e4f788"
Sep 15 12:05:39.780232 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.780111    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deef65dcb6f625573f42dcce043e3f0d3aa98493804ae6e04271f1d300e4f788"} err="failed to get container status \"deef65dcb6f625573f42dcce043e3f0d3aa98493804ae6e04271f1d300e4f788\": rpc error: code = NotFound desc = could not find container \"deef65dcb6f625573f42dcce043e3f0d3aa98493804ae6e04271f1d300e4f788\": container with ID starting with deef65dcb6f625573f42dcce043e3f0d3aa98493804ae6e04271f1d300e4f788 not found: ID does not exist"
Sep 15 12:05:39.788128 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.788102    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"]
Sep 15 12:05:39.793442 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.793417    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-7b7b3c-bdd64844b-ztldj"]
Sep 15 12:05:39.806853 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.806824    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"]
Sep 15 12:05:39.811588 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.811561    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7b7b3c-77c7d8dc79-9cfxx"]
Sep 15 12:05:39.847911 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.847872    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6pxp\" (UniqueName: \"kubernetes.io/projected/b69fd742-5be7-4da2-b9bf-84884fa72229-kube-api-access-g6pxp\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:39.847911 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:39.847902    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b69fd742-5be7-4da2-b9bf-84884fa72229-plugins-config-volume\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:40.029398 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:40.029356    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:40.132497 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:40.132403    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:40.214407 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:40.214369    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="882a3df3-f9b1-46a1-a103-ecaf1d61693e" path="/var/lib/kubelet/pods/882a3df3-f9b1-46a1-a103-ecaf1d61693e/volumes"
Sep 15 12:05:40.214762 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:40.214749    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b69fd742-5be7-4da2-b9bf-84884fa72229" path="/var/lib/kubelet/pods/b69fd742-5be7-4da2-b9bf-84884fa72229/volumes"
Sep 15 12:05:46.441220 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:46.441187    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:49.053092 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.053041    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-nnxk7"]
Sep 15 12:05:49.053574 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.053284    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b6994fc67-nnxk7" podUID="d56b85be-ecf8-404c-b484-232e772f6f57" containerName="manager" containerID="cri-o://5f3d8b72507cda7d9716b2cf7aa143fefb17abd20d2b807fb07f8e7eaa3f3ce0" gracePeriod=30
Sep 15 12:05:49.304704 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.304642    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 12:05:49.452385 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.452344    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b85be-ecf8-404c-b484-232e772f6f57-metrics-certs\") pod \"d56b85be-ecf8-404c-b484-232e772f6f57\" (UID: \"d56b85be-ecf8-404c-b484-232e772f6f57\") "
Sep 15 12:05:49.452385 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.452392    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hccs\" (UniqueName: \"kubernetes.io/projected/d56b85be-ecf8-404c-b484-232e772f6f57-kube-api-access-4hccs\") pod \"d56b85be-ecf8-404c-b484-232e772f6f57\" (UID: \"d56b85be-ecf8-404c-b484-232e772f6f57\") "
Sep 15 12:05:49.452668 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.452417    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d56b85be-ecf8-404c-b484-232e772f6f57-webhook-cert\") pod \"d56b85be-ecf8-404c-b484-232e772f6f57\" (UID: \"d56b85be-ecf8-404c-b484-232e772f6f57\") "
Sep 15 12:05:49.454640 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.454608    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d56b85be-ecf8-404c-b484-232e772f6f57-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d56b85be-ecf8-404c-b484-232e772f6f57" (UID: "d56b85be-ecf8-404c-b484-232e772f6f57"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:05:49.454640 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.454624    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d56b85be-ecf8-404c-b484-232e772f6f57-kube-api-access-4hccs" (OuterVolumeSpecName: "kube-api-access-4hccs") pod "d56b85be-ecf8-404c-b484-232e772f6f57" (UID: "d56b85be-ecf8-404c-b484-232e772f6f57"). InnerVolumeSpecName "kube-api-access-4hccs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:05:49.454816 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.454623    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d56b85be-ecf8-404c-b484-232e772f6f57-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d56b85be-ecf8-404c-b484-232e772f6f57" (UID: "d56b85be-ecf8-404c-b484-232e772f6f57"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:05:49.553357 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.553316    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b85be-ecf8-404c-b484-232e772f6f57-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:49.553357 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.553350    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hccs\" (UniqueName: \"kubernetes.io/projected/d56b85be-ecf8-404c-b484-232e772f6f57-kube-api-access-4hccs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:49.553357 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.553362    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d56b85be-ecf8-404c-b484-232e772f6f57-webhook-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:05:49.590546 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.590468    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:49.690473 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.690432    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:05:49.816963 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.816927    2571 generic.go:356] "Generic (PLEG): container finished" podID="d56b85be-ecf8-404c-b484-232e772f6f57" containerID="5f3d8b72507cda7d9716b2cf7aa143fefb17abd20d2b807fb07f8e7eaa3f3ce0" exitCode=0
Sep 15 12:05:49.817141 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.816975    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-nnxk7"
Sep 15 12:05:49.817141 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.817015    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-nnxk7" event={"ID":"d56b85be-ecf8-404c-b484-232e772f6f57","Type":"ContainerDied","Data":"5f3d8b72507cda7d9716b2cf7aa143fefb17abd20d2b807fb07f8e7eaa3f3ce0"}
Sep 15 12:05:49.817141 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.817074    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-nnxk7" event={"ID":"d56b85be-ecf8-404c-b484-232e772f6f57","Type":"ContainerDied","Data":"d472cc5bc72cbe5c9017ee9894d9ccab8918abb1afbf2083a4d2d5eb38e985f4"}
Sep 15 12:05:49.817141 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.817103    2571 scope.go:117] "RemoveContainer" containerID="5f3d8b72507cda7d9716b2cf7aa143fefb17abd20d2b807fb07f8e7eaa3f3ce0"
Sep 15 12:05:49.833221 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.833187    2571 scope.go:117] "RemoveContainer" containerID="5f3d8b72507cda7d9716b2cf7aa143fefb17abd20d2b807fb07f8e7eaa3f3ce0"
Sep 15 12:05:49.833569 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:05:49.833549    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f3d8b72507cda7d9716b2cf7aa143fefb17abd20d2b807fb07f8e7eaa3f3ce0\": container with ID starting with 5f3d8b72507cda7d9716b2cf7aa143fefb17abd20d2b807fb07f8e7eaa3f3ce0 not found: ID does not exist" containerID="5f3d8b72507cda7d9716b2cf7aa143fefb17abd20d2b807fb07f8e7eaa3f3ce0"
Sep 15 12:05:49.833628 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.833578    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f3d8b72507cda7d9716b2cf7aa143fefb17abd20d2b807fb07f8e7eaa3f3ce0"} err="failed to get container status \"5f3d8b72507cda7d9716b2cf7aa143fefb17abd20d2b807fb07f8e7eaa3f3ce0\": rpc error: code = NotFound desc = could not find container \"5f3d8b72507cda7d9716b2cf7aa143fefb17abd20d2b807fb07f8e7eaa3f3ce0\": container with ID starting with 5f3d8b72507cda7d9716b2cf7aa143fefb17abd20d2b807fb07f8e7eaa3f3ce0 not found: ID does not exist"
Sep 15 12:05:49.846563 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.846487    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-nnxk7"]
Sep 15 12:05:49.850692 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:49.850664    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-nnxk7"]
Sep 15 12:05:50.214463 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:05:50.214427    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d56b85be-ecf8-404c-b484-232e772f6f57" path="/var/lib/kubelet/pods/d56b85be-ecf8-404c-b484-232e772f6f57/volumes"
Sep 15 12:06:19.655398 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:19.655361    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:06:50.699752 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.699715    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b6994fc67-9z8wp"]
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700130    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d48a91f1-2a37-4744-8d00-371698d76b0b" containerName="maas-api"
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700145    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d48a91f1-2a37-4744-8d00-371698d76b0b" containerName="maas-api"
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700174    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69fd742-5be7-4da2-b9bf-84884fa72229" containerName="payload-processing"
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700184    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69fd742-5be7-4da2-b9bf-84884fa72229" containerName="payload-processing"
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700195    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="882a3df3-f9b1-46a1-a103-ecaf1d61693e" containerName="maas-api"
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700204    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="882a3df3-f9b1-46a1-a103-ecaf1d61693e" containerName="maas-api"
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700216    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46701af-ecd2-468e-b7e3-6b30a6524f18" containerName="maas-api"
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700224    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46701af-ecd2-468e-b7e3-6b30a6524f18" containerName="maas-api"
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700239    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a83c2f7-fa7c-477d-a471-5b52c481636b" containerName="maas-api"
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700247    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a83c2f7-fa7c-477d-a471-5b52c481636b" containerName="maas-api"
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700262    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db39eef7-97f9-4651-955c-c07e9a6fc5e0" containerName="payload-processing"
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700269    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="db39eef7-97f9-4651-955c-c07e9a6fc5e0" containerName="payload-processing"
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700292    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerName="istio-proxy"
Sep 15 12:06:50.700290 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700300    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerName="istio-proxy"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700309    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="633ce068-6c48-4d73-a90c-2488b10edde8" containerName="payload-pre-processing"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700318    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="633ce068-6c48-4d73-a90c-2488b10edde8" containerName="payload-pre-processing"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700335    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5b876cb-22d3-48d8-9445-01999cdc8573" containerName="maas-api"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700343    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5b876cb-22d3-48d8-9445-01999cdc8573" containerName="maas-api"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700355    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afcc333c-6c8c-426c-b195-f4e85854dbac" containerName="payload-processing"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700364    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="afcc333c-6c8c-426c-b195-f4e85854dbac" containerName="payload-processing"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700376    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56b85be-ecf8-404c-b484-232e772f6f57" containerName="manager"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700387    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56b85be-ecf8-404c-b484-232e772f6f57" containerName="manager"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700398    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerName="istio-proxy"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700406    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerName="istio-proxy"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700505    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a83c2f7-fa7c-477d-a471-5b52c481636b" containerName="maas-api"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700514    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46701af-ecd2-468e-b7e3-6b30a6524f18" containerName="maas-api"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700522    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5b876cb-22d3-48d8-9445-01999cdc8573" containerName="maas-api"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700528    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69fd742-5be7-4da2-b9bf-84884fa72229" containerName="payload-processing"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700533    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerName="istio-proxy"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700540    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d56b85be-ecf8-404c-b484-232e772f6f57" containerName="manager"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700545    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d48a91f1-2a37-4744-8d00-371698d76b0b" containerName="maas-api"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700554    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="882a3df3-f9b1-46a1-a103-ecaf1d61693e" containerName="maas-api"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700559    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="633ce068-6c48-4d73-a90c-2488b10edde8" containerName="payload-pre-processing"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700565    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="db39eef7-97f9-4651-955c-c07e9a6fc5e0" containerName="payload-processing"
Sep 15 12:06:50.700840 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.700571    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="afcc333c-6c8c-426c-b195-f4e85854dbac" containerName="payload-processing"
Sep 15 12:06:50.703547 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.703531    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:06:50.707121 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.707087    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 12:06:50.707121 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.707114    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 12:06:50.707303 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.707185    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 12:06:50.707303 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.707234    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4gvps\""
Sep 15 12:06:50.715973 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.715938    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-9z8wp"]
Sep 15 12:06:50.888032 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.887986    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a0db39e-72a9-4458-8814-ac9563eb5659-webhook-cert\") pod \"maas-controller-6b6994fc67-9z8wp\" (UID: \"5a0db39e-72a9-4458-8814-ac9563eb5659\") " pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:06:50.888244 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.888053    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a0db39e-72a9-4458-8814-ac9563eb5659-metrics-certs\") pod \"maas-controller-6b6994fc67-9z8wp\" (UID: \"5a0db39e-72a9-4458-8814-ac9563eb5659\") " pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:06:50.888244 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.888071    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvs2t\" (UniqueName: \"kubernetes.io/projected/5a0db39e-72a9-4458-8814-ac9563eb5659-kube-api-access-vvs2t\") pod \"maas-controller-6b6994fc67-9z8wp\" (UID: \"5a0db39e-72a9-4458-8814-ac9563eb5659\") " pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:06:50.988953 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.988871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a0db39e-72a9-4458-8814-ac9563eb5659-webhook-cert\") pod \"maas-controller-6b6994fc67-9z8wp\" (UID: \"5a0db39e-72a9-4458-8814-ac9563eb5659\") " pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:06:50.988953 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.988930    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a0db39e-72a9-4458-8814-ac9563eb5659-metrics-certs\") pod \"maas-controller-6b6994fc67-9z8wp\" (UID: \"5a0db39e-72a9-4458-8814-ac9563eb5659\") " pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:06:50.988953 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.988951    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvs2t\" (UniqueName: \"kubernetes.io/projected/5a0db39e-72a9-4458-8814-ac9563eb5659-kube-api-access-vvs2t\") pod \"maas-controller-6b6994fc67-9z8wp\" (UID: \"5a0db39e-72a9-4458-8814-ac9563eb5659\") " pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:06:50.991436 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.991410    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a0db39e-72a9-4458-8814-ac9563eb5659-webhook-cert\") pod \"maas-controller-6b6994fc67-9z8wp\" (UID: \"5a0db39e-72a9-4458-8814-ac9563eb5659\") " pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:06:50.991558 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:50.991439    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a0db39e-72a9-4458-8814-ac9563eb5659-metrics-certs\") pod \"maas-controller-6b6994fc67-9z8wp\" (UID: \"5a0db39e-72a9-4458-8814-ac9563eb5659\") " pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:06:51.004389 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:51.004359    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvs2t\" (UniqueName: \"kubernetes.io/projected/5a0db39e-72a9-4458-8814-ac9563eb5659-kube-api-access-vvs2t\") pod \"maas-controller-6b6994fc67-9z8wp\" (UID: \"5a0db39e-72a9-4458-8814-ac9563eb5659\") " pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:06:51.015852 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:51.015825    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:06:51.288689 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:51.288661    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-9z8wp"]
Sep 15 12:06:51.290570 ip-10-0-141-110 kubenswrapper[2571]: W0915 12:06:51.290543    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0db39e_72a9_4458_8814_ac9563eb5659.slice/crio-d27f2ed20e51345011ec0ed71401ac9dfd73fd202b3bdaf42383db7ec50667d3 WatchSource:0}: Error finding container d27f2ed20e51345011ec0ed71401ac9dfd73fd202b3bdaf42383db7ec50667d3: Status 404 returned error can't find the container with id d27f2ed20e51345011ec0ed71401ac9dfd73fd202b3bdaf42383db7ec50667d3
Sep 15 12:06:51.292058 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:51.292039    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 12:06:52.148198 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:52.148088    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-9z8wp" event={"ID":"5a0db39e-72a9-4458-8814-ac9563eb5659","Type":"ContainerStarted","Data":"674a2afd311a398d7e1d48a4be5125b0fa6103bc3c2d3977550e273c764e8a3f"}
Sep 15 12:06:52.148198 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:52.148164    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-9z8wp" event={"ID":"5a0db39e-72a9-4458-8814-ac9563eb5659","Type":"ContainerStarted","Data":"d27f2ed20e51345011ec0ed71401ac9dfd73fd202b3bdaf42383db7ec50667d3"}
Sep 15 12:06:52.148198 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:52.148197    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:06:52.166336 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:06:52.166272    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b6994fc67-9z8wp" podStartSLOduration=1.713218919 podStartE2EDuration="2.166245997s" totalImagesPullingTime="453.027078ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:06:52.16544153 +0000 UTC m=+1774.416998611" watchObservedRunningTime="2026-09-15 12:06:52.166245997 +0000 UTC m=+1774.417803055"
Sep 15 12:07:03.155494 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:03.155457    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:07:10.442740 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:10.442661    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:10.561737 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:10.561702    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-9z8wp"]
Sep 15 12:07:10.561965 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:10.561920    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b6994fc67-9z8wp" podUID="5a0db39e-72a9-4458-8814-ac9563eb5659" containerName="manager" containerID="cri-o://674a2afd311a398d7e1d48a4be5125b0fa6103bc3c2d3977550e273c764e8a3f" gracePeriod=30
Sep 15 12:07:10.809087 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:10.809064    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:07:10.882398 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:10.882368    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvs2t\" (UniqueName: \"kubernetes.io/projected/5a0db39e-72a9-4458-8814-ac9563eb5659-kube-api-access-vvs2t\") pod \"5a0db39e-72a9-4458-8814-ac9563eb5659\" (UID: \"5a0db39e-72a9-4458-8814-ac9563eb5659\") "
Sep 15 12:07:10.882543 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:10.882448    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a0db39e-72a9-4458-8814-ac9563eb5659-webhook-cert\") pod \"5a0db39e-72a9-4458-8814-ac9563eb5659\" (UID: \"5a0db39e-72a9-4458-8814-ac9563eb5659\") "
Sep 15 12:07:10.882609 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:10.882545    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a0db39e-72a9-4458-8814-ac9563eb5659-metrics-certs\") pod \"5a0db39e-72a9-4458-8814-ac9563eb5659\" (UID: \"5a0db39e-72a9-4458-8814-ac9563eb5659\") "
Sep 15 12:07:10.884539 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:10.884512    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a0db39e-72a9-4458-8814-ac9563eb5659-kube-api-access-vvs2t" (OuterVolumeSpecName: "kube-api-access-vvs2t") pod "5a0db39e-72a9-4458-8814-ac9563eb5659" (UID: "5a0db39e-72a9-4458-8814-ac9563eb5659"). InnerVolumeSpecName "kube-api-access-vvs2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:07:10.884858 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:10.884837    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a0db39e-72a9-4458-8814-ac9563eb5659-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5a0db39e-72a9-4458-8814-ac9563eb5659" (UID: "5a0db39e-72a9-4458-8814-ac9563eb5659"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:07:10.884992 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:10.884898    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a0db39e-72a9-4458-8814-ac9563eb5659-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5a0db39e-72a9-4458-8814-ac9563eb5659" (UID: "5a0db39e-72a9-4458-8814-ac9563eb5659"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:07:10.983697 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:10.983599    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvs2t\" (UniqueName: \"kubernetes.io/projected/5a0db39e-72a9-4458-8814-ac9563eb5659-kube-api-access-vvs2t\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:07:10.983697 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:10.983640    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a0db39e-72a9-4458-8814-ac9563eb5659-webhook-cert\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:07:10.983697 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:10.983654    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a0db39e-72a9-4458-8814-ac9563eb5659-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:07:11.252945 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:11.252841    2571 generic.go:356] "Generic (PLEG): container finished" podID="5a0db39e-72a9-4458-8814-ac9563eb5659" containerID="674a2afd311a398d7e1d48a4be5125b0fa6103bc3c2d3977550e273c764e8a3f" exitCode=0
Sep 15 12:07:11.252945 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:11.252905    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-9z8wp"
Sep 15 12:07:11.253184 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:11.252896    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-9z8wp" event={"ID":"5a0db39e-72a9-4458-8814-ac9563eb5659","Type":"ContainerDied","Data":"674a2afd311a398d7e1d48a4be5125b0fa6103bc3c2d3977550e273c764e8a3f"}
Sep 15 12:07:11.253184 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:11.253050    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-9z8wp" event={"ID":"5a0db39e-72a9-4458-8814-ac9563eb5659","Type":"ContainerDied","Data":"d27f2ed20e51345011ec0ed71401ac9dfd73fd202b3bdaf42383db7ec50667d3"}
Sep 15 12:07:11.253184 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:11.253085    2571 scope.go:117] "RemoveContainer" containerID="674a2afd311a398d7e1d48a4be5125b0fa6103bc3c2d3977550e273c764e8a3f"
Sep 15 12:07:11.264920 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:11.264904    2571 scope.go:117] "RemoveContainer" containerID="674a2afd311a398d7e1d48a4be5125b0fa6103bc3c2d3977550e273c764e8a3f"
Sep 15 12:07:11.265275 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:07:11.265254    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"674a2afd311a398d7e1d48a4be5125b0fa6103bc3c2d3977550e273c764e8a3f\": container with ID starting with 674a2afd311a398d7e1d48a4be5125b0fa6103bc3c2d3977550e273c764e8a3f not found: ID does not exist" containerID="674a2afd311a398d7e1d48a4be5125b0fa6103bc3c2d3977550e273c764e8a3f"
Sep 15 12:07:11.265379 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:11.265279    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674a2afd311a398d7e1d48a4be5125b0fa6103bc3c2d3977550e273c764e8a3f"} err="failed to get container status \"674a2afd311a398d7e1d48a4be5125b0fa6103bc3c2d3977550e273c764e8a3f\": rpc error: code = NotFound desc = could not find container \"674a2afd311a398d7e1d48a4be5125b0fa6103bc3c2d3977550e273c764e8a3f\": container with ID starting with 674a2afd311a398d7e1d48a4be5125b0fa6103bc3c2d3977550e273c764e8a3f not found: ID does not exist"
Sep 15 12:07:11.278622 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:11.278599    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-9z8wp"]
Sep 15 12:07:11.282268 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:11.282247    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-9z8wp"]
Sep 15 12:07:12.032820 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.032781    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:12.163255 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.163219    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b6994fc67-zq9zx"]
Sep 15 12:07:12.163665 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.163644    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a0db39e-72a9-4458-8814-ac9563eb5659" containerName="manager"
Sep 15 12:07:12.163665 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.163660    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a0db39e-72a9-4458-8814-ac9563eb5659" containerName="manager"
Sep 15 12:07:12.163859 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.163763    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a0db39e-72a9-4458-8814-ac9563eb5659" containerName="manager"
Sep 15 12:07:12.163859 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.163774    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="385370d3-ef33-4288-b609-b082c2b6d6a0" containerName="istio-proxy"
Sep 15 12:07:12.168268 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.168248    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-zq9zx"
Sep 15 12:07:12.171651 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.171628    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 12:07:12.171769 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.171703    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4gvps\""
Sep 15 12:07:12.171868 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.171846    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 12:07:12.171927 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.171855    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 12:07:12.177323 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.177303    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-zq9zx"]
Sep 15 12:07:12.213518 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.213485    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a0db39e-72a9-4458-8814-ac9563eb5659" path="/var/lib/kubelet/pods/5a0db39e-72a9-4458-8814-ac9563eb5659/volumes"
Sep 15 12:07:12.295571 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.295480    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58a9de6b-85ac-4fa5-8e6e-34cb459e43dc-metrics-certs\") pod \"maas-controller-6b6994fc67-zq9zx\" (UID: \"58a9de6b-85ac-4fa5-8e6e-34cb459e43dc\") " pod="opendatahub/maas-controller-6b6994fc67-zq9zx"
Sep 15 12:07:12.295571 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.295527    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-784m4\" (UniqueName: \"kubernetes.io/projected/58a9de6b-85ac-4fa5-8e6e-34cb459e43dc-kube-api-access-784m4\") pod \"maas-controller-6b6994fc67-zq9zx\" (UID: \"58a9de6b-85ac-4fa5-8e6e-34cb459e43dc\") " pod="opendatahub/maas-controller-6b6994fc67-zq9zx"
Sep 15 12:07:12.295571 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.295557    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58a9de6b-85ac-4fa5-8e6e-34cb459e43dc-webhook-cert\") pod \"maas-controller-6b6994fc67-zq9zx\" (UID: \"58a9de6b-85ac-4fa5-8e6e-34cb459e43dc\") " pod="opendatahub/maas-controller-6b6994fc67-zq9zx"
Sep 15 12:07:12.396273 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.396231    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58a9de6b-85ac-4fa5-8e6e-34cb459e43dc-metrics-certs\") pod \"maas-controller-6b6994fc67-zq9zx\" (UID: \"58a9de6b-85ac-4fa5-8e6e-34cb459e43dc\") " pod="opendatahub/maas-controller-6b6994fc67-zq9zx"
Sep 15 12:07:12.396475 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.396294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-784m4\" (UniqueName: \"kubernetes.io/projected/58a9de6b-85ac-4fa5-8e6e-34cb459e43dc-kube-api-access-784m4\") pod \"maas-controller-6b6994fc67-zq9zx\" (UID: \"58a9de6b-85ac-4fa5-8e6e-34cb459e43dc\") " pod="opendatahub/maas-controller-6b6994fc67-zq9zx"
Sep 15 12:07:12.396475 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.396333    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58a9de6b-85ac-4fa5-8e6e-34cb459e43dc-webhook-cert\") pod \"maas-controller-6b6994fc67-zq9zx\" (UID: \"58a9de6b-85ac-4fa5-8e6e-34cb459e43dc\") " pod="opendatahub/maas-controller-6b6994fc67-zq9zx"
Sep 15 12:07:12.398688 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.398663    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58a9de6b-85ac-4fa5-8e6e-34cb459e43dc-webhook-cert\") pod \"maas-controller-6b6994fc67-zq9zx\" (UID: \"58a9de6b-85ac-4fa5-8e6e-34cb459e43dc\") " pod="opendatahub/maas-controller-6b6994fc67-zq9zx"
Sep 15 12:07:12.398822 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.398800    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58a9de6b-85ac-4fa5-8e6e-34cb459e43dc-metrics-certs\") pod \"maas-controller-6b6994fc67-zq9zx\" (UID: \"58a9de6b-85ac-4fa5-8e6e-34cb459e43dc\") " pod="opendatahub/maas-controller-6b6994fc67-zq9zx"
Sep 15 12:07:12.405105 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.405084    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-784m4\" (UniqueName: \"kubernetes.io/projected/58a9de6b-85ac-4fa5-8e6e-34cb459e43dc-kube-api-access-784m4\") pod \"maas-controller-6b6994fc67-zq9zx\" (UID: \"58a9de6b-85ac-4fa5-8e6e-34cb459e43dc\") " pod="opendatahub/maas-controller-6b6994fc67-zq9zx"
Sep 15 12:07:12.479322 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.479284    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b6994fc67-zq9zx"
Sep 15 12:07:12.751576 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:12.751544    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b6994fc67-zq9zx"]
Sep 15 12:07:12.753373 ip-10-0-141-110 kubenswrapper[2571]: W0915 12:07:12.753339    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a9de6b_85ac_4fa5_8e6e_34cb459e43dc.slice/crio-367a91f30f7fbdcfad415d31a783e0a2d5c14c494644d6bdb203a1f084e861ec WatchSource:0}: Error finding container 367a91f30f7fbdcfad415d31a783e0a2d5c14c494644d6bdb203a1f084e861ec: Status 404 returned error can't find the container with id 367a91f30f7fbdcfad415d31a783e0a2d5c14c494644d6bdb203a1f084e861ec
Sep 15 12:07:13.267056 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:13.267022    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-zq9zx" event={"ID":"58a9de6b-85ac-4fa5-8e6e-34cb459e43dc","Type":"ContainerStarted","Data":"615a579bea0f20d05607644b067fad34c0b8d66d0ef172a4134160ebc6c4175a"}
Sep 15 12:07:13.267505 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:13.267072    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b6994fc67-zq9zx" event={"ID":"58a9de6b-85ac-4fa5-8e6e-34cb459e43dc","Type":"ContainerStarted","Data":"367a91f30f7fbdcfad415d31a783e0a2d5c14c494644d6bdb203a1f084e861ec"}
Sep 15 12:07:13.267505 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:13.267287    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b6994fc67-zq9zx"
Sep 15 12:07:13.285216 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:13.285136    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b6994fc67-zq9zx" podStartSLOduration=0.917931542 podStartE2EDuration="1.28511602s" totalImagesPullingTime="367.184478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:07:13.283385217 +0000 UTC m=+1795.534942277" watchObservedRunningTime="2026-09-15 12:07:13.28511602 +0000 UTC m=+1795.536673078"
Sep 15 12:07:18.318793 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:18.318763    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 12:07:18.322883 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:18.322862    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 12:07:24.274770 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:24.274727    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b6994fc67-zq9zx"
Sep 15 12:07:25.861002 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:25.860971    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:28.601841 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:28.601807    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:07:48.003753 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:07:48.003713    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:04.257764 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:08:04.257726    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:04.357651 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:08:04.357615    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:19.944809 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:08:19.944768    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:08:20.049601 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:08:20.049560    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:10:02.592601 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:02.592562    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:10:14.281676 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:14.281581    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:10:34.922638 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:34.922597    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:10:36.004791 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:36.004756    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:10:53.108679 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.108637    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"]
Sep 15 12:10:53.114912 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.114877    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.123849 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.123799    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"]
Sep 15 12:10:53.186889 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.186851    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c88fed9-803f-4b5e-be51-0c8b88704d44-metrics-certs\") pod \"maas-api-86d9ddc875-87km4\" (UID: \"3c88fed9-803f-4b5e-be51-0c8b88704d44\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.187113 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.186919    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfsk5\" (UniqueName: \"kubernetes.io/projected/3c88fed9-803f-4b5e-be51-0c8b88704d44-kube-api-access-mfsk5\") pod \"maas-api-86d9ddc875-87km4\" (UID: \"3c88fed9-803f-4b5e-be51-0c8b88704d44\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.187113 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.187033    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c88fed9-803f-4b5e-be51-0c8b88704d44-openshift-service-ca\") pod \"maas-api-86d9ddc875-87km4\" (UID: \"3c88fed9-803f-4b5e-be51-0c8b88704d44\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.187113 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.187048    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c88fed9-803f-4b5e-be51-0c8b88704d44-maas-api-tls\") pod \"maas-api-86d9ddc875-87km4\" (UID: \"3c88fed9-803f-4b5e-be51-0c8b88704d44\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.288458 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.288421    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfsk5\" (UniqueName: \"kubernetes.io/projected/3c88fed9-803f-4b5e-be51-0c8b88704d44-kube-api-access-mfsk5\") pod \"maas-api-86d9ddc875-87km4\" (UID: \"3c88fed9-803f-4b5e-be51-0c8b88704d44\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.288665 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.288508    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c88fed9-803f-4b5e-be51-0c8b88704d44-openshift-service-ca\") pod \"maas-api-86d9ddc875-87km4\" (UID: \"3c88fed9-803f-4b5e-be51-0c8b88704d44\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.288665 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.288526    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c88fed9-803f-4b5e-be51-0c8b88704d44-maas-api-tls\") pod \"maas-api-86d9ddc875-87km4\" (UID: \"3c88fed9-803f-4b5e-be51-0c8b88704d44\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.288665 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.288554    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c88fed9-803f-4b5e-be51-0c8b88704d44-metrics-certs\") pod \"maas-api-86d9ddc875-87km4\" (UID: \"3c88fed9-803f-4b5e-be51-0c8b88704d44\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.289217 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.289190    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c88fed9-803f-4b5e-be51-0c8b88704d44-openshift-service-ca\") pod \"maas-api-86d9ddc875-87km4\" (UID: \"3c88fed9-803f-4b5e-be51-0c8b88704d44\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.291174 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.291136    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c88fed9-803f-4b5e-be51-0c8b88704d44-maas-api-tls\") pod \"maas-api-86d9ddc875-87km4\" (UID: \"3c88fed9-803f-4b5e-be51-0c8b88704d44\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.291295 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.291191    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c88fed9-803f-4b5e-be51-0c8b88704d44-metrics-certs\") pod \"maas-api-86d9ddc875-87km4\" (UID: \"3c88fed9-803f-4b5e-be51-0c8b88704d44\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.296058 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.296037    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfsk5\" (UniqueName: \"kubernetes.io/projected/3c88fed9-803f-4b5e-be51-0c8b88704d44-kube-api-access-mfsk5\") pod \"maas-api-86d9ddc875-87km4\" (UID: \"3c88fed9-803f-4b5e-be51-0c8b88704d44\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.432345 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.432256    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:53.707577 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:53.707548    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"]
Sep 15 12:10:53.708677 ip-10-0-141-110 kubenswrapper[2571]: W0915 12:10:53.708646    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c88fed9_803f_4b5e_be51_0c8b88704d44.slice/crio-0131da96a738db33f148b60869f230bfc341f3054c4361ec4e5301ca06cb96c5 WatchSource:0}: Error finding container 0131da96a738db33f148b60869f230bfc341f3054c4361ec4e5301ca06cb96c5: Status 404 returned error can't find the container with id 0131da96a738db33f148b60869f230bfc341f3054c4361ec4e5301ca06cb96c5
Sep 15 12:10:54.435512 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:54.435418    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4" event={"ID":"3c88fed9-803f-4b5e-be51-0c8b88704d44","Type":"ContainerStarted","Data":"9f848177961dd7e6c96e9acc56de2307a40b319ee869dfc87bbd6bfff9ec6b60"}
Sep 15 12:10:54.435512 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:54.435471    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4" event={"ID":"3c88fed9-803f-4b5e-be51-0c8b88704d44","Type":"ContainerStarted","Data":"0131da96a738db33f148b60869f230bfc341f3054c4361ec4e5301ca06cb96c5"}
Sep 15 12:10:54.435512 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:54.435493    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:10:54.454106 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:10:54.454047    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4" podStartSLOduration=1.152071844 podStartE2EDuration="1.454026637s" totalImagesPullingTime="301.954793ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:10:54.452973303 +0000 UTC m=+2016.704530385" watchObservedRunningTime="2026-09-15 12:10:54.454026637 +0000 UTC m=+2016.705583696"
Sep 15 12:11:00.446674 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:00.446641    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-87km4"
Sep 15 12:11:07.861263 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:07.861224    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"]
Sep 15 12:11:07.861721 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:07.861487    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq" podUID="4094408e-5d49-45eb-8ac2-3f6b48f352ba" containerName="maas-api" containerID="cri-o://c7f56edefeff8fe65448d41dc4efb5f0377c272f696a0e47530fcebfe9cc2f26" gracePeriod=30
Sep 15 12:11:09.110624 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.110598    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 12:11:09.139218 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.139183    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4094408e-5d49-45eb-8ac2-3f6b48f352ba-openshift-service-ca\") pod \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") "
Sep 15 12:11:09.139401 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.139251    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4094408e-5d49-45eb-8ac2-3f6b48f352ba-metrics-certs\") pod \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") "
Sep 15 12:11:09.139401 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.139309    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cp7z\" (UniqueName: \"kubernetes.io/projected/4094408e-5d49-45eb-8ac2-3f6b48f352ba-kube-api-access-7cp7z\") pod \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") "
Sep 15 12:11:09.139401 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.139332    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4094408e-5d49-45eb-8ac2-3f6b48f352ba-maas-api-tls\") pod \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\" (UID: \"4094408e-5d49-45eb-8ac2-3f6b48f352ba\") "
Sep 15 12:11:09.139602 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.139572    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4094408e-5d49-45eb-8ac2-3f6b48f352ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4094408e-5d49-45eb-8ac2-3f6b48f352ba" (UID: "4094408e-5d49-45eb-8ac2-3f6b48f352ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:11:09.139756 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.139738    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4094408e-5d49-45eb-8ac2-3f6b48f352ba-openshift-service-ca\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:11:09.142058 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.142027    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4094408e-5d49-45eb-8ac2-3f6b48f352ba-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4094408e-5d49-45eb-8ac2-3f6b48f352ba" (UID: "4094408e-5d49-45eb-8ac2-3f6b48f352ba"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:11:09.142198 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.142112    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4094408e-5d49-45eb-8ac2-3f6b48f352ba-kube-api-access-7cp7z" (OuterVolumeSpecName: "kube-api-access-7cp7z") pod "4094408e-5d49-45eb-8ac2-3f6b48f352ba" (UID: "4094408e-5d49-45eb-8ac2-3f6b48f352ba"). InnerVolumeSpecName "kube-api-access-7cp7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:11:09.142275 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.142213    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4094408e-5d49-45eb-8ac2-3f6b48f352ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4094408e-5d49-45eb-8ac2-3f6b48f352ba" (UID: "4094408e-5d49-45eb-8ac2-3f6b48f352ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:11:09.240233 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.240192    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4094408e-5d49-45eb-8ac2-3f6b48f352ba-metrics-certs\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:11:09.240233 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.240232    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cp7z\" (UniqueName: \"kubernetes.io/projected/4094408e-5d49-45eb-8ac2-3f6b48f352ba-kube-api-access-7cp7z\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:11:09.240441 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.240247    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4094408e-5d49-45eb-8ac2-3f6b48f352ba-maas-api-tls\") on node \"ip-10-0-141-110.ec2.internal\" DevicePath \"\""
Sep 15 12:11:09.526068 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.526031    2571 generic.go:356] "Generic (PLEG): container finished" podID="4094408e-5d49-45eb-8ac2-3f6b48f352ba" containerID="c7f56edefeff8fe65448d41dc4efb5f0377c272f696a0e47530fcebfe9cc2f26" exitCode=0
Sep 15 12:11:09.526261 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.526074    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"
Sep 15 12:11:09.526261 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.526114    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq" event={"ID":"4094408e-5d49-45eb-8ac2-3f6b48f352ba","Type":"ContainerDied","Data":"c7f56edefeff8fe65448d41dc4efb5f0377c272f696a0e47530fcebfe9cc2f26"}
Sep 15 12:11:09.526261 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.526193    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq" event={"ID":"4094408e-5d49-45eb-8ac2-3f6b48f352ba","Type":"ContainerDied","Data":"1895ff5f8f3440f6db9231b6b4c019161be46551c6e4385ccfef7de5d2c43ba6"}
Sep 15 12:11:09.526261 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.526222    2571 scope.go:117] "RemoveContainer" containerID="c7f56edefeff8fe65448d41dc4efb5f0377c272f696a0e47530fcebfe9cc2f26"
Sep 15 12:11:09.538348 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.538328    2571 scope.go:117] "RemoveContainer" containerID="c7f56edefeff8fe65448d41dc4efb5f0377c272f696a0e47530fcebfe9cc2f26"
Sep 15 12:11:09.538809 ip-10-0-141-110 kubenswrapper[2571]: E0915 12:11:09.538787    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7f56edefeff8fe65448d41dc4efb5f0377c272f696a0e47530fcebfe9cc2f26\": container with ID starting with c7f56edefeff8fe65448d41dc4efb5f0377c272f696a0e47530fcebfe9cc2f26 not found: ID does not exist" containerID="c7f56edefeff8fe65448d41dc4efb5f0377c272f696a0e47530fcebfe9cc2f26"
Sep 15 12:11:09.538915 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.538815    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7f56edefeff8fe65448d41dc4efb5f0377c272f696a0e47530fcebfe9cc2f26"} err="failed to get container status \"c7f56edefeff8fe65448d41dc4efb5f0377c272f696a0e47530fcebfe9cc2f26\": rpc error: code = NotFound desc = could not find container \"c7f56edefeff8fe65448d41dc4efb5f0377c272f696a0e47530fcebfe9cc2f26\": container with ID starting with c7f56edefeff8fe65448d41dc4efb5f0377c272f696a0e47530fcebfe9cc2f26 not found: ID does not exist"
Sep 15 12:11:09.548524 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.548503    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"]
Sep 15 12:11:09.554231 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:09.554211    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-xv5pq"]
Sep 15 12:11:10.213642 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:10.213611    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4094408e-5d49-45eb-8ac2-3f6b48f352ba" path="/var/lib/kubelet/pods/4094408e-5d49-45eb-8ac2-3f6b48f352ba/volumes"
Sep 15 12:11:21.930342 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:21.930307    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5wxhw/must-gather-dnph4"]
Sep 15 12:11:21.930760 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:21.930747    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4094408e-5d49-45eb-8ac2-3f6b48f352ba" containerName="maas-api"
Sep 15 12:11:21.930760 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:21.930761    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4094408e-5d49-45eb-8ac2-3f6b48f352ba" containerName="maas-api"
Sep 15 12:11:21.930869 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:21.930859    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4094408e-5d49-45eb-8ac2-3f6b48f352ba" containerName="maas-api"
Sep 15 12:11:21.935630 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:21.935608    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wxhw/must-gather-dnph4"
Sep 15 12:11:21.938225 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:21.938195    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5wxhw\"/\"default-dockercfg-lkh2z\""
Sep 15 12:11:21.938383 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:21.938317    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5wxhw\"/\"kube-root-ca.crt\""
Sep 15 12:11:21.938452 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:21.938444    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5wxhw\"/\"openshift-service-ca.crt\""
Sep 15 12:11:21.947561 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:21.947537    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wxhw/must-gather-dnph4"]
Sep 15 12:11:21.950414 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:21.950389    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:11:22.019266 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:22.019235    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:11:22.059692 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:22.059658    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b200a8cb-10d1-47b2-a5db-074079bdb88a-must-gather-output\") pod \"must-gather-dnph4\" (UID: \"b200a8cb-10d1-47b2-a5db-074079bdb88a\") " pod="openshift-must-gather-5wxhw/must-gather-dnph4"
Sep 15 12:11:22.059864 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:22.059698    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8gl4\" (UniqueName: \"kubernetes.io/projected/b200a8cb-10d1-47b2-a5db-074079bdb88a-kube-api-access-p8gl4\") pod \"must-gather-dnph4\" (UID: \"b200a8cb-10d1-47b2-a5db-074079bdb88a\") " pod="openshift-must-gather-5wxhw/must-gather-dnph4"
Sep 15 12:11:22.161049 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:22.160998    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b200a8cb-10d1-47b2-a5db-074079bdb88a-must-gather-output\") pod \"must-gather-dnph4\" (UID: \"b200a8cb-10d1-47b2-a5db-074079bdb88a\") " pod="openshift-must-gather-5wxhw/must-gather-dnph4"
Sep 15 12:11:22.161049 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:22.161056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8gl4\" (UniqueName: \"kubernetes.io/projected/b200a8cb-10d1-47b2-a5db-074079bdb88a-kube-api-access-p8gl4\") pod \"must-gather-dnph4\" (UID: \"b200a8cb-10d1-47b2-a5db-074079bdb88a\") " pod="openshift-must-gather-5wxhw/must-gather-dnph4"
Sep 15 12:11:22.161427 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:22.161401    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b200a8cb-10d1-47b2-a5db-074079bdb88a-must-gather-output\") pod \"must-gather-dnph4\" (UID: \"b200a8cb-10d1-47b2-a5db-074079bdb88a\") " pod="openshift-must-gather-5wxhw/must-gather-dnph4"
Sep 15 12:11:22.175771 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:22.175747    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8gl4\" (UniqueName: \"kubernetes.io/projected/b200a8cb-10d1-47b2-a5db-074079bdb88a-kube-api-access-p8gl4\") pod \"must-gather-dnph4\" (UID: \"b200a8cb-10d1-47b2-a5db-074079bdb88a\") " pod="openshift-must-gather-5wxhw/must-gather-dnph4"
Sep 15 12:11:22.245297 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:22.245264    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wxhw/must-gather-dnph4"
Sep 15 12:11:22.525272 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:22.525243    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wxhw/must-gather-dnph4"]
Sep 15 12:11:22.527069 ip-10-0-141-110 kubenswrapper[2571]: W0915 12:11:22.527042    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb200a8cb_10d1_47b2_a5db_074079bdb88a.slice/crio-c95feb82e9069cfbc36005877768aff1d32e61ac7b9594a09be5f38d4fc75f65 WatchSource:0}: Error finding container c95feb82e9069cfbc36005877768aff1d32e61ac7b9594a09be5f38d4fc75f65: Status 404 returned error can't find the container with id c95feb82e9069cfbc36005877768aff1d32e61ac7b9594a09be5f38d4fc75f65
Sep 15 12:11:22.592953 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:22.592920    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wxhw/must-gather-dnph4" event={"ID":"b200a8cb-10d1-47b2-a5db-074079bdb88a","Type":"ContainerStarted","Data":"c95feb82e9069cfbc36005877768aff1d32e61ac7b9594a09be5f38d4fc75f65"}
Sep 15 12:11:24.608695 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:24.608649    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wxhw/must-gather-dnph4" event={"ID":"b200a8cb-10d1-47b2-a5db-074079bdb88a","Type":"ContainerStarted","Data":"06e4a204ae7be7d1cce1978759d0e619690f6e8fb78f4d12eceedc8a4961476a"}
Sep 15 12:11:24.608695 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:24.608699    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wxhw/must-gather-dnph4" event={"ID":"b200a8cb-10d1-47b2-a5db-074079bdb88a","Type":"ContainerStarted","Data":"6dae696cd161c1fcce9a781c3ceda45c3a451f4c1b0a194a763469116d459177"}
Sep 15 12:11:24.628616 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:24.628560    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5wxhw/must-gather-dnph4" podStartSLOduration=2.354866195 podStartE2EDuration="3.628544161s" totalImagesPullingTime="1.273677966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:11:24.626595482 +0000 UTC m=+2046.878152541" watchObservedRunningTime="2026-09-15 12:11:24.628544161 +0000 UTC m=+2046.880101218"
Sep 15 12:11:25.389647 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:25.389613    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-25rqj_e7423e8a-7332-4124-82ce-92db8066e036/global-pull-secret-syncer/0.log"
Sep 15 12:11:25.568584 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:25.568553    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log"
Sep 15 12:11:25.730855 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:25.730821    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-110.ec2.internal_4e352b0800062f7f3412fe21ece1ede3/haproxy/0.log"
Sep 15 12:11:30.503622 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:30.503493    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d84ccdd4d-dl2dt_77b5f4a4-432c-4f95-93e6-bc94948f0cea/authorino/0.log"
Sep 15 12:11:30.781524 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:30.781440    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-fvrzw_90aa8415-82a0-4844-9b93-d66557389f65/manager/0.log"
Sep 15 12:11:31.234846 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:31.234800    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:11:31.298911 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:31.298871    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4mkd_7e9ba56b-3290-489b-980d-e8706e503dd6/konnectivity-agent/0.log" limit=1024
Sep 15 12:11:32.370088 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.370059    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b/alertmanager/0.log"
Sep 15 12:11:32.397690 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.397649    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b/config-reloader/0.log"
Sep 15 12:11:32.441138 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.441109    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b/kube-rbac-proxy-web/0.log"
Sep 15 12:11:32.465079 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.465053    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b/kube-rbac-proxy/0.log"
Sep 15 12:11:32.499640 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.499530    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b/kube-rbac-proxy-metric/0.log"
Sep 15 12:11:32.531352 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.531321    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b/prom-label-proxy/0.log"
Sep 15 12:11:32.559688 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.559612    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6aedcf2a-efdf-4008-8fb4-c47fb0e2a84b/init-config-reloader/0.log"
Sep 15 12:11:32.630742 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.630655    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-jhstw_de026d1d-2b60-499d-b723-b194b2053e6a/kube-state-metrics/0.log"
Sep 15 12:11:32.647949 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.647922    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-jhstw_de026d1d-2b60-499d-b723-b194b2053e6a/kube-rbac-proxy-main/0.log"
Sep 15 12:11:32.668745 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.668708    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-jhstw_de026d1d-2b60-499d-b723-b194b2053e6a/kube-rbac-proxy-self/0.log"
Sep 15 12:11:32.706522 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.706494    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6cb8d757ff-fb94k_91dda7c6-9576-4326-b9ff-ae70437dfe0f/metrics-server/0.log"
Sep 15 12:11:32.732983 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.732958    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-drxr6_4b2997e6-4546-4050-ba96-8412f38ccee1/monitoring-plugin/0.log"
Sep 15 12:11:32.944117 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.944086    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vtsf4_7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9/node-exporter/0.log"
Sep 15 12:11:32.967557 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.967519    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vtsf4_7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9/kube-rbac-proxy/0.log"
Sep 15 12:11:32.990709 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:32.990674    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vtsf4_7ddf3bbe-79ac-43bc-b3c4-9d869615d0a9/init-textfile/0.log"
Sep 15 12:11:33.030477 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.030436    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-ctqmr_4cdbb6f7-510b-43d0-90d0-f974bf353f02/kube-rbac-proxy-main/0.log"
Sep 15 12:11:33.055473 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.055433    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-ctqmr_4cdbb6f7-510b-43d0-90d0-f974bf353f02/kube-rbac-proxy-self/0.log"
Sep 15 12:11:33.093707 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.093673    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-ctqmr_4cdbb6f7-510b-43d0-90d0-f974bf353f02/openshift-state-metrics/0.log"
Sep 15 12:11:33.135003 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.134965    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2/prometheus/0.log"
Sep 15 12:11:33.158174 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.158134    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2/config-reloader/0.log"
Sep 15 12:11:33.183585 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.183550    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2/thanos-sidecar/0.log"
Sep 15 12:11:33.207768 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.207681    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2/kube-rbac-proxy-web/0.log"
Sep 15 12:11:33.241700 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.241559    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2/kube-rbac-proxy/0.log"
Sep 15 12:11:33.265023 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.264993    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2/kube-rbac-proxy-thanos/0.log"
Sep 15 12:11:33.288736 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.288711    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0f46f0d-c21a-4ecb-a6ed-7e147ad516c2/init-config-reloader/0.log"
Sep 15 12:11:33.315771 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.315741    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-44jxl_8cb82822-44d0-4ab9-80a2-adb72aefe66a/prometheus-operator/0.log"
Sep 15 12:11:33.343000 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.342966    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-44jxl_8cb82822-44d0-4ab9-80a2-adb72aefe66a/kube-rbac-proxy/0.log"
Sep 15 12:11:33.398523 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.398485    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f4f899dc-txt4g_e0bbd6bf-4d12-4e0d-b99e-9de526307cfd/telemeter-client/0.log"
Sep 15 12:11:33.420859 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.420827    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f4f899dc-txt4g_e0bbd6bf-4d12-4e0d-b99e-9de526307cfd/reload/0.log"
Sep 15 12:11:33.443986 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.443927    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f4f899dc-txt4g_e0bbd6bf-4d12-4e0d-b99e-9de526307cfd/kube-rbac-proxy/0.log"
Sep 15 12:11:33.476015 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.475938    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-548d966f65-4n9lm_0a42c349-5157-4e0c-a851-c6013a82d765/thanos-query/0.log"
Sep 15 12:11:33.512276 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.512113    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-548d966f65-4n9lm_0a42c349-5157-4e0c-a851-c6013a82d765/kube-rbac-proxy-web/0.log"
Sep 15 12:11:33.558764 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.558733    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-548d966f65-4n9lm_0a42c349-5157-4e0c-a851-c6013a82d765/kube-rbac-proxy/0.log"
Sep 15 12:11:33.591908 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.591873    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-548d966f65-4n9lm_0a42c349-5157-4e0c-a851-c6013a82d765/prom-label-proxy/0.log"
Sep 15 12:11:33.627797 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.627762    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-548d966f65-4n9lm_0a42c349-5157-4e0c-a851-c6013a82d765/kube-rbac-proxy-rules/0.log"
Sep 15 12:11:33.651738 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:33.651696    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-548d966f65-4n9lm_0a42c349-5157-4e0c-a851-c6013a82d765/kube-rbac-proxy-metrics/0.log"
Sep 15 12:11:36.096794 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:36.096762    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78df58ddcd-xz5jl_98891bad-2a60-4b45-99cc-ebf2915a0589/console/0.log"
Sep 15 12:11:37.102515 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.102477    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"]
Sep 15 12:11:37.108304 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.108272    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.115938 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.115904    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"]
Sep 15 12:11:37.153325 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.152001    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-lib-modules\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.153325 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.152067    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54nz7\" (UniqueName: \"kubernetes.io/projected/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-kube-api-access-54nz7\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.153325 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.152098    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-sys\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.153325 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.152175    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-podres\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.153325 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.152240    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-proc\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.253650 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.253617    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-podres\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.253860 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.253674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-proc\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.253860 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.253748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-lib-modules\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.253860 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.253783    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54nz7\" (UniqueName: \"kubernetes.io/projected/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-kube-api-access-54nz7\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.253860 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.253799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-podres\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.253860 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.253798    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-proc\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.253860 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.253812    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-sys\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.254239 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.253869    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-sys\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.254239 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.253886    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-lib-modules\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.263283 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.263255    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54nz7\" (UniqueName: \"kubernetes.io/projected/220c00e8-b4c5-4427-a9fd-a0403afb8c7a-kube-api-access-54nz7\") pod \"perf-node-gather-daemonset-rxcg4\" (UID: \"220c00e8-b4c5-4427-a9fd-a0403afb8c7a\") " pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.427124 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.426835    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:37.730471 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:37.728689    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"]
Sep 15 12:11:37.731031 ip-10-0-141-110 kubenswrapper[2571]: W0915 12:11:37.731001    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod220c00e8_b4c5_4427_a9fd_a0403afb8c7a.slice/crio-94fdf4ac2b0db95c0a3c2358bdce617f1a26cf854f06e3a2bf27ab5cc9437ca6 WatchSource:0}: Error finding container 94fdf4ac2b0db95c0a3c2358bdce617f1a26cf854f06e3a2bf27ab5cc9437ca6: Status 404 returned error can't find the container with id 94fdf4ac2b0db95c0a3c2358bdce617f1a26cf854f06e3a2bf27ab5cc9437ca6
Sep 15 12:11:38.105429 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:38.105340    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7t2f7_171badf9-573d-4b76-9da9-538229c17db6/dns/0.log"
Sep 15 12:11:38.123358 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:38.123321    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7t2f7_171badf9-573d-4b76-9da9-538229c17db6/kube-rbac-proxy/0.log"
Sep 15 12:11:38.214678 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:38.214648    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vmg9v_0c1c09d2-5782-4c07-b6da-d8211ecc6bf4/dns-node-resolver/0.log"
Sep 15 12:11:38.724474 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:38.724336    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4" event={"ID":"220c00e8-b4c5-4427-a9fd-a0403afb8c7a","Type":"ContainerStarted","Data":"1c1998ccec1390e5384865c750a3f7d02eca64713580bba0041542312b4baeda"}
Sep 15 12:11:38.724684 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:38.724606    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4" event={"ID":"220c00e8-b4c5-4427-a9fd-a0403afb8c7a","Type":"ContainerStarted","Data":"94fdf4ac2b0db95c0a3c2358bdce617f1a26cf854f06e3a2bf27ab5cc9437ca6"}
Sep 15 12:11:38.725030 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:38.724659    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:38.742214 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:38.742128    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4" podStartSLOduration=1.742107901 podStartE2EDuration="1.742107901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:11:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:11:38.741878001 +0000 UTC m=+2060.993435060" watchObservedRunningTime="2026-09-15 12:11:38.742107901 +0000 UTC m=+2060.993664961"
Sep 15 12:11:38.857179 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:38.857126    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kgp8h_719ac105-ddf6-4f1a-937c-d86ec063d9ec/node-ca/0.log"
Sep 15 12:11:40.368632 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:40.368598    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cg52h_5d238557-cfcf-4620-9aed-9b5f1a59268e/istio-proxy/0.log"
Sep 15 12:11:40.383041 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:40.382097    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cg52h_5d238557-cfcf-4620-9aed-9b5f1a59268e/istio-proxy/1.log"
Sep 15 12:11:40.403932 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:40.403901    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-558d9b8847-2nr6n_fe167c50-85f2-42e8-b925-c2c76acbc19e/payload-pre-processing/0.log"
Sep 15 12:11:40.428325 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:40.428284    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-jjnsc_ba184fb9-5c6e-4777-98de-9b779cb5ac0c/payload-processing/0.log"
Sep 15 12:11:41.355361 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:41.355327    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p8tnd_08b25302-a7c8-4567-a3c3-329af1bfe5d6/serve-healthcheck-canary/0.log"
Sep 15 12:11:41.940174 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:41.940116    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lv6nb_71f382d5-253d-437e-83c9-5ba6ad99f4d2/kube-rbac-proxy/0.log"
Sep 15 12:11:41.959091 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:41.959059    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lv6nb_71f382d5-253d-437e-83c9-5ba6ad99f4d2/exporter/0.log"
Sep 15 12:11:41.980108 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:41.980080    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lv6nb_71f382d5-253d-437e-83c9-5ba6ad99f4d2/extractor/0.log"
Sep 15 12:11:44.245431 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:44.245401    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6786f98586-cfjf7_17859261-4122-4cf7-b3a0-e7f6a5419839/manager/0.log"
Sep 15 12:11:44.269643 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:44.269611    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hkqwh_33474fed-9ab0-4243-abba-3ae3d6681775/manager/0.log"
Sep 15 12:11:44.553690 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:44.553610    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8kc67_57b2d4c4-f890-40f3-bdfd-ed567f80feef/manager/0.log"
Sep 15 12:11:44.621266 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:44.621231    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b6994fc67-zq9zx_58a9de6b-85ac-4fa5-8e6e-34cb459e43dc/manager/0.log"
Sep 15 12:11:44.742581 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:44.742552    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5wxhw/perf-node-gather-daemonset-rxcg4"
Sep 15 12:11:44.875518 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:44.875430    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74bdb8b799-cpm86_8add857a-def7-4587-bbb8-c0c83d7fde44/manager/0.log"
Sep 15 12:11:44.899220 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:44.899190    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74bdb8b799-cpm86_8add857a-def7-4587-bbb8-c0c83d7fde44/copy-manifests/0.log"
Sep 15 12:11:46.364797 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:46.364693    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8487688d7-pp82m_881ada2f-3925-4732-b350-1ed87f428c92/manager/0.log"
Sep 15 12:11:46.701806 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:46.701770    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cg52h_5d238557-cfcf-4620-9aed-9b5f1a59268e/istio-proxy/0.log"
Sep 15 12:11:46.712717 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:46.712682    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cg52h_5d238557-cfcf-4620-9aed-9b5f1a59268e/istio-proxy/1.log"
Sep 15 12:11:46.724880 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:46.724847    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-558d9b8847-2nr6n_fe167c50-85f2-42e8-b925-c2c76acbc19e/payload-pre-processing/0.log"
Sep 15 12:11:46.750848 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:46.750818    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-jjnsc_ba184fb9-5c6e-4777-98de-9b779cb5ac0c/payload-processing/0.log"
Sep 15 12:11:48.947910 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:48.947884    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cg52h_5d238557-cfcf-4620-9aed-9b5f1a59268e/istio-proxy/0.log"
Sep 15 12:11:48.963379 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:48.963357    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-cg52h_5d238557-cfcf-4620-9aed-9b5f1a59268e/istio-proxy/1.log"
Sep 15 12:11:48.984892 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:48.984863    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-558d9b8847-2nr6n_fe167c50-85f2-42e8-b925-c2c76acbc19e/payload-pre-processing/0.log"
Sep 15 12:11:49.004987 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:49.004948    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-74969cc5f8-jjnsc_ba184fb9-5c6e-4777-98de-9b779cb5ac0c/payload-processing/0.log"
Sep 15 12:11:53.477584 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:53.477553    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpffd_b257fc07-966b-43b6-a6fd-e4f922c9e907/kube-multus-additional-cni-plugins/0.log"
Sep 15 12:11:53.498137 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:53.498097    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpffd_b257fc07-966b-43b6-a6fd-e4f922c9e907/egress-router-binary-copy/0.log"
Sep 15 12:11:53.520146 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:53.520114    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpffd_b257fc07-966b-43b6-a6fd-e4f922c9e907/cni-plugins/0.log"
Sep 15 12:11:53.539688 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:53.539659    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpffd_b257fc07-966b-43b6-a6fd-e4f922c9e907/bond-cni-plugin/0.log"
Sep 15 12:11:53.559080 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:53.559049    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpffd_b257fc07-966b-43b6-a6fd-e4f922c9e907/routeoverride-cni/0.log"
Sep 15 12:11:53.580603 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:53.580567    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpffd_b257fc07-966b-43b6-a6fd-e4f922c9e907/whereabouts-cni-bincopy/0.log"
Sep 15 12:11:53.600446 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:53.600419    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpffd_b257fc07-966b-43b6-a6fd-e4f922c9e907/whereabouts-cni/0.log"
Sep 15 12:11:53.752529 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:53.752445    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-x4p8m_2cb28757-2d9d-47a8-9d7c-8ad2d3802eb6/kube-multus/0.log"
Sep 15 12:11:53.827558 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:53.827530    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-959p9_52c718e0-4bf0-406b-9c49-1a5e120fcd43/network-metrics-daemon/0.log"
Sep 15 12:11:53.846623 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:53.846595    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-959p9_52c718e0-4bf0-406b-9c49-1a5e120fcd43/kube-rbac-proxy/0.log"
Sep 15 12:11:54.731686 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:54.731655    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-controller/0.log"
Sep 15 12:11:54.747689 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:54.747659    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/1.log"
Sep 15 12:11:54.747689 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:54.747675    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovn-acl-logging/0.log"
Sep 15 12:11:54.765780 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:54.765756    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/kube-rbac-proxy-node/0.log"
Sep 15 12:11:54.784758 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:54.784733    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/kube-rbac-proxy-ovn-metrics/0.log"
Sep 15 12:11:54.806318 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:54.806280    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/northd/0.log"
Sep 15 12:11:54.826013 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:54.825973    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/nbdb/0.log"
Sep 15 12:11:54.849363 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:54.849338    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/sbdb/0.log"
Sep 15 12:11:54.964897 ip-10-0-141-110 kubenswrapper[2571]: I0915 12:11:54.964670    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4n9x6_6f223f9c-27a1-4c1e-9d40-8d6a557d90b7/ovnkube-controller/0.log"