Jul 20 19:15:11.835418 ip-10-0-141-43 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 19:15:12.227169 ip-10-0-141-43 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:15:12.227169 ip-10-0-141-43 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 19:15:12.227169 ip-10-0-141-43 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:15:12.227169 ip-10-0-141-43 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 19:15:12.227169 ip-10-0-141-43 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:15:12.228899 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.228778    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 19:15:12.237539 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237509    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:15:12.237539 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237532    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:15:12.237539 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237537    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:15:12.237539 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237540    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:15:12.237539 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237543    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:15:12.237539 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237546    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:15:12.237539 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237549    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237553    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237556    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237559    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237562    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237565    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237568    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237570    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237572    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237575    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237577    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237581    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237583    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237591    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237594    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237597    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237600    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237602    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237604    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237607    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:15:12.237825 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237609    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237612    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237614    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237616    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237625    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237628    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237630    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237633    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237635    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237638    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237640    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237642    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237645    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237647    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237650    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237653    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237656    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237658    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237660    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:15:12.238319 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237663    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237666    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237668    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237671    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237673    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237676    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237678    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237681    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237683    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237685    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237688    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237690    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237692    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237695    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237697    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237700    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237704    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237707    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237710    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:15:12.238806 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237713    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237716    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237718    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237721    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237723    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237725    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237728    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237731    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237735    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237738    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237740    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237742    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237745    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237748    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237750    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237753    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237755    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237757    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237760    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237763    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:15:12.239282 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237765    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237768    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237770    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237773    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237777    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237781    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237784    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237787    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237790    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237792    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237795    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237797    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237799    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237802    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.237804    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238511    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238518    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238522    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238525    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:15:12.239752 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238527    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238531    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238534    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238537    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238539    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238542    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238545    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238548    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238550    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238552    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238555    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238557    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238560    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238563    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238568    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238572    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238575    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238577    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238580    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238582    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:15:12.240258 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238584    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238587    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238589    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238592    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238594    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238598    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238600    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238603    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238606    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238608    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238611    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238614    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238616    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238619    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238621    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238624    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238626    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238629    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238631    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238633    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:15:12.240782 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238636    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238638    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238641    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238643    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238646    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238648    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238651    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238654    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238656    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238659    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238661    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238663    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238666    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238668    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238670    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238673    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238675    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238678    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238680    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:15:12.241289 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238682    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238685    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238688    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238690    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238692    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238696    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238700    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238703    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238706    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238708    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238711    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238714    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238716    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238718    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238721    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238724    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238726    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238729    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238731    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:15:12.241766 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238733    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238736    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238739    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238741    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238744    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238746    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238748    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238751    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238753    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238757    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238760    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238763    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238766    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238769    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238771    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238774    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.238776    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239180    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239186    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:15:12.242242 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239192    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239195    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239197    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239200    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239203    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239206    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239208    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239211    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239214    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239217    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239219    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239221    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239224    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239226    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239229    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239232    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239236    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239240    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239243    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:15:12.242700 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239246    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239250    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239253    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239256    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239259    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239261    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239264    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239267    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239270    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239273    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239275    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239278    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239280    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239284    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239287    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239289    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239292    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239294    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239297    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239299    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:15:12.243184 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239302    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239304    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239307    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239310    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239312    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239314    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239317    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239320    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239323    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239326    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239328    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239330    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239333    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239335    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239338    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239340    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239343    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239346    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239350    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239352    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:15:12.243656 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239355    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239357    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239359    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239362    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239364    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239367    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239369    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239372    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239374    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239376    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239379    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239381    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239385    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239388    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239391    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239394    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239397    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239399    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239402    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:15:12.244143 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239404    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239406    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239410    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239412    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239414    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239417    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239419    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239421    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239424    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239426    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239430    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239432    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239435    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239437    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239439    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239442    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239444    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239447    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.239450    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239529    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239540    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 19:15:12.244686 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239550    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239556    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239562    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239567    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239573    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239579    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239582    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239585    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239589    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239592    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239595    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239598    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239600    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239603    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239607    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239609    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239614    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239616    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239619    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239622    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239626    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239631    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239634    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 19:15:12.245205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239637    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239640    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239643    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239646    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239649    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239652    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239655    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239659    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239662    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239665    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239668    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239671    2581 flags.go:64] FLAG: --enable-server="true"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239674    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239678    2581 flags.go:64] FLAG: --event-burst="100"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239681    2581 flags.go:64] FLAG: --event-qps="50"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239684    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239687    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239690    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239693    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239696    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239699    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239701    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239704    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239707    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239710    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 19:15:12.245762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239713    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239716    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239719    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239721    2581 flags.go:64] FLAG: --feature-gates=""
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239725    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239731    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239734    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239737    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239740    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239742    2581 flags.go:64] FLAG: --help="false"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239745    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239748    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239751    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239754    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239757    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239760    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239763    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239766    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239769    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239772    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239774    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239777    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239780    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239782    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 19:15:12.246423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239785    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239788    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239790    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239793    2581 flags.go:64] FLAG: --lock-file=""
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239796    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239798    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239801    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239807    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239810    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239813    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239815    2581 flags.go:64] FLAG: --logging-format="text"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239818    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239821    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239826    2581 flags.go:64] FLAG: --manifest-url=""
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239829    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239833    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239836    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239840    2581 flags.go:64] FLAG: --max-pods="110"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239843    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239846    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239849    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239852    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239855    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239857    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239861    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 19:15:12.247092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239868    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239871    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239874    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239877    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239880    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239884    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239887    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239890    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239893    2581 flags.go:64] FLAG: --port="10250"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239896    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239898    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04b824a014fcbfdb5"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239902    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239904    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239907    2581 flags.go:64] FLAG: --register-node="true"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239910    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239913    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239917    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239919    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239922    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239926    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239929    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239933    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239936    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239939    2581 flags.go:64] FLAG: --runonce="false"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239942    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 19:15:12.247814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239944    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239947    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239951    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239953    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239956    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239959    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239962    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239965    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239968    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239970    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239973    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239976    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239979    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239982    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239987    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239989    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239992    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239996    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.239999    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.240002    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.240004    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.240007    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.240010    2581 flags.go:64] FLAG: --v="2"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.240014    2581 flags.go:64] FLAG: --version="false"
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.240018    2581 flags.go:64] FLAG: --vmodule=""
Jul 20 19:15:12.248509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.240021    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.240024    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240156    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240162    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240165    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240168    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240171    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240173    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240176    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240178    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240181    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240183    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240186    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240188    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240191    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240194    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240196    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240198    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240201    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240204    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:15:12.249226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240206    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240210    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240214    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240216    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240219    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240222    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240225    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240228    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240230    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240233    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240235    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240238    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240241    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240244    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240246    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240250    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240253    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240255    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240258    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:15:12.249793 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240260    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240263    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240265    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240268    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240270    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240273    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240276    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240278    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240280    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240282    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240285    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240287    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240290    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240293    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240295    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240298    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240300    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240303    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240305    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240308    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:15:12.250365 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240311    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240313    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240316    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240319    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240321    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240323    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240326    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240330    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240334    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240337    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240339    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240341    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240344    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240348    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240351    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240354    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240357    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240360    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240364    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240367    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:15:12.250905 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240369    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240372    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240374    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240377    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240380    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240382    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240385    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240387    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240389    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240392    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240394    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240397    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240399    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240402    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240404    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240407    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240409    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240411    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240414    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240418    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:15:12.251421 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240421    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.240424    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.241378    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.248363    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.248380    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.248401    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.248411    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248466    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248471    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248474    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248477    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248480    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248483    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248486    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:15:12.251931 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248489    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248492    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248494    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248497    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248499    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248503    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248507    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248510    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248512    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248515    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248518    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248520    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248523    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248526    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248528    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248531    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248533    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248536    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248538    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248541    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:15:12.252310 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248543    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248546    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248549    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248552    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248555    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248557    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248560    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248562    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248564    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248567    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248569    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248572    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248574    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248577    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248579    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248581    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248583    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248586    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248589    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248591    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:15:12.252799 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248594    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248596    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248598    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248601    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248603    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248605    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248608    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248610    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248612    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248617    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248621    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248624    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248627    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248630    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248633    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248636    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248639    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248641    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248645    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:15:12.253297 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248648    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248651    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248653    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248656    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248659    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248661    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248663    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248666    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248668    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248671    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248673    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248676    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248678    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248680    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248683    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248685    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248687    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248690    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248693    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:15:12.253798 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248696    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248698    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248701    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248703    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248706    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248708    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248711    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248714    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248716    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248718    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248721    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248724    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248727    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248729    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.248734    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:15:12.254273 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248843    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248848    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248851    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248854    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248856    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248859    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248861    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248864    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248866    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248869    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248871    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248874    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248877    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248879    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248881    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248884    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248886    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248889    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248891    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248894    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:15:12.254637 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248896    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248899    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248901    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248904    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248906    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248910    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248913    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248916    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248919    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248922    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248925    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248927    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248930    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248932    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248935    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248937    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248940    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248942    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248944    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:15:12.255162 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248947    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248949    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248951    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248954    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248956    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248958    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248961    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248963    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248965    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248968    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248970    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248974    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248977    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248979    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248983    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248985    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248988    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248990    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248993    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:15:12.255611 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248996    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.248998    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249001    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249003    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249006    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249008    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249011    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249013    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249015    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249018    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249020    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249023    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249025    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249027    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249030    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249032    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249034    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249036    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249039    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249041    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:15:12.256061 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249043    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249046    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249048    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249050    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249052    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249055    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249057    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249060    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249062    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249064    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249067    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249069    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249071    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249074    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249076    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249079    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249082    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249084    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249087    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249089    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:15:12.256563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:12.249092    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:15:12.257040 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.249096    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:15:12.257040 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.249215    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 19:15:12.257040 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.251218    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 19:15:12.257040 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.252610    2581 server.go:1019] "Starting client certificate rotation"
Jul 20 19:15:12.257040 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.252705    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 19:15:12.257040 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.253337    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 19:15:12.257040 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.254887    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 19:15:12.258677 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.258659    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 19:15:12.269770 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.269749    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 20 19:15:12.271814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.271796    2581 log.go:25] "Validated CRI v1 image API"
Jul 20 19:15:12.272681 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.272665    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 19:15:12.274932 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.274911    2581 fs.go:135] Filesystem UUIDs: map[11ea4649-a634-415e-9742-9e664490707d:/dev/nvme0n1p3 575564eb-6a84-485a-876c-a64266452e16:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 20 19:15:12.274993 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.274930    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 19:15:12.279718 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.279559    2581 manager.go:216] Machine: {Timestamp:2026-07-20 19:15:12.2790566 +0000 UTC m=+0.313761475 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100969 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec207247bcf3150596bee9f5d623dc8b SystemUUID:ec207247-bcf3-1505-96be-e9f5d623dc8b BootID:c95e32ca-24b1-4b3b-a201-1514e8432023 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6b:10:a8:06:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6b:10:a8:06:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:6b:6e:b4:02:20 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 19:15:12.279718 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.279714    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 19:15:12.279830 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.279794    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 19:15:12.282559 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.282534    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 19:15:12.282702 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.282561    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-43.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 19:15:12.283292 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.283280    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 19:15:12.283331 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.283295    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 19:15:12.283331 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.283306    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 19:15:12.283331 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.283320    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 19:15:12.284489 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.284478    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 19:15:12.285480 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.285464    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 19:15:12.287191 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.287179    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 19:15:12.287328 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.287318    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 19:15:12.287369 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.287350    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 19:15:12.287369 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.287363    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 19:15:12.287449 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.287381    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 19:15:12.287449 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.287393    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 20 19:15:12.287449 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.287402    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 19:15:12.287771 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.287760    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 19:15:12.287822 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.287778    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 19:15:12.290006 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.289987    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 19:15:12.291383 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.291367    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 19:15:12.291467 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.291405    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 19:15:12.292085 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292073    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 19:15:12.292176 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292093    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 19:15:12.292176 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292102    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 19:15:12.292176 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292130    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 19:15:12.292176 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292142    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 19:15:12.292176 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292150    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 19:15:12.292176 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292161    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 19:15:12.292176 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292169    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 19:15:12.292176 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292179    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 19:15:12.292532 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292187    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 19:15:12.292532 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292212    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 19:15:12.292532 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292221    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 19:15:12.292532 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292259    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 19:15:12.292532 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.292267    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 19:15:12.295498 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.295484    2581 server.go:1268] "Started kubelet"
Jul 20 19:15:12.295623 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.295591    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 19:15:12.295736 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.295571    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 19:15:12.295736 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.295722    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 19:15:12.296318 ip-10-0-141-43 systemd[1]: Started Kubernetes Kubelet.
Jul 20 19:15:12.296863 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.296844    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 19:15:12.297988 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.297971    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 19:15:12.301237 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.301214    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-43.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 19:15:12.301508 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.301449    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 19:15:12.301592 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.301449    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-43.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 19:15:12.302168 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.302149    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 19:15:12.305220 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.305199    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 19:15:12.305220 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.305207    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 19:15:12.305363 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.301344    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-43.ec2.internal.18c4156d7a71d562  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-43.ec2.internal,UID:ip-10-0-141-43.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-43.ec2.internal,},FirstTimestamp:2026-07-20 19:15:12.295458146 +0000 UTC m=+0.330163021,LastTimestamp:2026-07-20 19:15:12.295458146 +0000 UTC m=+0.330163021,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-43.ec2.internal,}"
Jul 20 19:15:12.305363 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.305307    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:12.305869 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.305856    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 19:15:12.305950 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.305918    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 19:15:12.306003 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.305859    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 19:15:12.306059 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.306036    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 19:15:12.306059 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.306047    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 19:15:12.306059 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.306037    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 19:15:12.306260 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.306065    2581 factory.go:55] Registering systemd factory
Jul 20 19:15:12.306260 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.306074    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 20 19:15:12.306347 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.306323    2581 factory.go:153] Registering CRI-O factory
Jul 20 19:15:12.306347 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.306337    2581 factory.go:223] Registration of the crio container factory successfully
Jul 20 19:15:12.306436 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.306359    2581 factory.go:103] Registering Raw factory
Jul 20 19:15:12.306436 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.306374    2581 manager.go:1196] Started watching for new ooms in manager
Jul 20 19:15:12.306751 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.306738    2581 manager.go:349] Starting recovery of all containers
Jul 20 19:15:12.309784 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.309757    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-43.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 19:15:12.309880 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.309866    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 19:15:12.310994 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.310971    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bvjjl"
Jul 20 19:15:12.316452 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.316436    2581 manager.go:354] Recovery completed
Jul 20 19:15:12.317987 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.317965    2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 20 19:15:12.318704 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.318685    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bvjjl"
Jul 20 19:15:12.322251 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.322237    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:15:12.324029 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.324007    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:15:12.324137 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.324044    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:15:12.324137 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.324055    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:15:12.324571 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.324555    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 19:15:12.324571 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.324566    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 19:15:12.324681 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.324585    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 19:15:12.324718 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.324568    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:15:12.325377 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.325363    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:15:12.325447 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.325389    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:15:12.325447 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.325398    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:15:12.325565 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.325553    2581 policy_none.go:49] "None policy: Start"
Jul 20 19:15:12.325606 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.325573    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 19:15:12.325606 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.325588    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 19:15:12.326126 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.326046    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-43.ec2.internal.18c4156d7c25cabb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-43.ec2.internal,UID:ip-10-0-141-43.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-43.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-43.ec2.internal,},FirstTimestamp:2026-07-20 19:15:12.324029115 +0000 UTC m=+0.358733992,LastTimestamp:2026-07-20 19:15:12.324029115 +0000 UTC m=+0.358733992,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-43.ec2.internal,}"
Jul 20 19:15:12.326666 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.326653    2581 policy_none.go:47] "Start"
Jul 20 19:15:12.363789 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.363767    2581 manager.go:337] "Starting Device Plugin manager"
Jul 20 19:15:12.363895 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.363810    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 19:15:12.363895 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.363824    2581 server.go:87] "Starting device plugin registration server"
Jul 20 19:15:12.364122 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.364095    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 19:15:12.364201 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.364126    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 19:15:12.364267 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.364247    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 19:15:12.364674 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.364582    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 19:15:12.364674 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.364599    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 19:15:12.366961 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.366940    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 19:15:12.367043 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.366996    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:12.447169 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.447128    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 19:15:12.448449 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.448432    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 19:15:12.448518 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.448480    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 19:15:12.448518 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.448513    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 19:15:12.448617 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.448560    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 19:15:12.451137 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.451099    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:15:12.464429 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.464410    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:15:12.465290 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.465269    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:15:12.465376 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.465303    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:15:12.465376 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.465321    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:15:12.465376 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.465348    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.474063 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.474047    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.474141 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.474070    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-43.ec2.internal\": node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:12.497921 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.497854    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:12.549127 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.549081    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-43.ec2.internal"]
Jul 20 19:15:12.549253 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.549190    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:15:12.550125 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.550096    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:15:12.550186 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.550150    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:15:12.550186 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.550164    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:15:12.551495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.551483    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:15:12.551656 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.551643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.551704 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.551695    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:15:12.552277 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.552264    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:15:12.552334 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.552287    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:15:12.552334 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.552297    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:15:12.552690 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.552672    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:15:12.552739 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.552700    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:15:12.552739 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.552709    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:15:12.553909 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.553894    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.553972 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.553921    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:15:12.554548 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.554524    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:15:12.554645 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.554557    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:15:12.554645 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.554567    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:15:12.581891 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.581871    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-43.ec2.internal\" not found" node="ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.586259 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.586242    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-43.ec2.internal\" not found" node="ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.598083 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.598064    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:12.698902 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.698872    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:12.707263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.707237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8926c1f84f412523854d845afc08afa5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal\" (UID: \"8926c1f84f412523854d845afc08afa5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.707353 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.707266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8926c1f84f412523854d845afc08afa5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal\" (UID: \"8926c1f84f412523854d845afc08afa5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.707353 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.707318    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de8985a0299f61e88b78af4c7e64a175-config\") pod \"kube-apiserver-proxy-ip-10-0-141-43.ec2.internal\" (UID: \"de8985a0299f61e88b78af4c7e64a175\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.799686 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.799615    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:12.807991 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.807964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8926c1f84f412523854d845afc08afa5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal\" (UID: \"8926c1f84f412523854d845afc08afa5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.808083 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.808002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8926c1f84f412523854d845afc08afa5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal\" (UID: \"8926c1f84f412523854d845afc08afa5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.808083 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.808029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de8985a0299f61e88b78af4c7e64a175-config\") pod \"kube-apiserver-proxy-ip-10-0-141-43.ec2.internal\" (UID: \"de8985a0299f61e88b78af4c7e64a175\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.808083 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.808070    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8926c1f84f412523854d845afc08afa5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal\" (UID: \"8926c1f84f412523854d845afc08afa5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.808215 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.808087    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8926c1f84f412523854d845afc08afa5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal\" (UID: \"8926c1f84f412523854d845afc08afa5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.808215 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.808071    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de8985a0299f61e88b78af4c7e64a175-config\") pod \"kube-apiserver-proxy-ip-10-0-141-43.ec2.internal\" (UID: \"de8985a0299f61e88b78af4c7e64a175\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.884186 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.884147    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.890034 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:12.890014    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:12.900618 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:12.900595    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:14.812287 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:14.812257    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:14.912844 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:14.912766    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:14.975887 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:14.975852    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:15:15.013181 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:15.013144    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:15.063623 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.063597    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 19:15:15.064031 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.063730    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 19:15:15.064031 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.063775    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 19:15:15.113382 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:15.113345    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:15.134032 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.133997    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 19:10:14 +0000 UTC" deadline="2027-12-18 07:45:51.055633843 +0000 UTC"
Jul 20 19:15:15.134032 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.134027    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12372h30m35.92161018s"
Jul 20 19:15:15.191568 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:15.191532    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8926c1f84f412523854d845afc08afa5.slice/crio-a36760f88e0db152478ac028fc1f44a2ad43059ba478f73aa8d36ca6b60f9ade WatchSource:0}: Error finding container a36760f88e0db152478ac028fc1f44a2ad43059ba478f73aa8d36ca6b60f9ade: Status 404 returned error can't find the container with id a36760f88e0db152478ac028fc1f44a2ad43059ba478f73aa8d36ca6b60f9ade
Jul 20 19:15:15.191813 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:15.191784    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8985a0299f61e88b78af4c7e64a175.slice/crio-d062e0cb08e1d6293df63cf21f86d7b5a5836acaa88f3c6530fb19eaa7d6cff3 WatchSource:0}: Error finding container d062e0cb08e1d6293df63cf21f86d7b5a5836acaa88f3c6530fb19eaa7d6cff3: Status 404 returned error can't find the container with id d062e0cb08e1d6293df63cf21f86d7b5a5836acaa88f3c6530fb19eaa7d6cff3
Jul 20 19:15:15.196731 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.196716    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:15:15.214155 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:15.214135    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:15.263728 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.263677    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal" event={"ID":"8926c1f84f412523854d845afc08afa5","Type":"ContainerStarted","Data":"a36760f88e0db152478ac028fc1f44a2ad43059ba478f73aa8d36ca6b60f9ade"}
Jul 20 19:15:15.264752 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.264728    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-43.ec2.internal" event={"ID":"de8985a0299f61e88b78af4c7e64a175","Type":"ContainerStarted","Data":"d062e0cb08e1d6293df63cf21f86d7b5a5836acaa88f3c6530fb19eaa7d6cff3"}
Jul 20 19:15:15.314942 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:15.314910    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-43.ec2.internal\" not found"
Jul 20 19:15:15.328231 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.328209    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:15:15.416507 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.416477    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:15.425001 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.424983    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 19:15:15.426816 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.426803    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal"
Jul 20 19:15:15.437289 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.437242    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 19:15:15.673469 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:15.673438    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:15:16.099904 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.099637    2581 apiserver.go:52] "Watching apiserver"
Jul 20 19:15:16.108811 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.108783    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 19:15:16.109814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.109784    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-xcfmn","openshift-network-operator/iptables-alerter-hfqtf","openshift-ovn-kubernetes/ovnkube-node-njbnv","kube-system/konnectivity-agent-gwcjd","kube-system/kube-apiserver-proxy-ip-10-0-141-43.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q","openshift-cluster-node-tuning-operator/tuned-7djgf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal","openshift-multus/multus-additional-cni-plugins-h5vjc","openshift-multus/multus-m4mdf","openshift-multus/network-metrics-daemon-knd47","kube-system/global-pull-secret-syncer-l67tj","openshift-dns/node-resolver-tl872","openshift-image-registry/node-ca-mb7g9"]
Jul 20 19:15:16.111688 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.111638    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.113174 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.113154    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:16.113287 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.113238    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:16.114308 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.114270    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7lgp8\""
Jul 20 19:15:16.114508 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.114480    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 19:15:16.114605 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.114564    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:15:16.117498 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.117472    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 19:15:16.119357 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.118905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.121142 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.121103    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 19:15:16.121397 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.121378    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 19:15:16.121479 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.121441    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gwcjd"
Jul 20 19:15:16.122123 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.122104    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 19:15:16.122611 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.122590    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 19:15:16.122705 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.122623    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 19:15:16.122848 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.122830    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g6nd5\""
Jul 20 19:15:16.123092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.123077    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 19:15:16.123262 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.123239    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mb7g9"
Jul 20 19:15:16.124675 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.123931    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 19:15:16.124675 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.123942    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 19:15:16.124675 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.124020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.124675 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.124055    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xwzgw\""
Jul 20 19:15:16.125927 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.125362    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.125927 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.125797    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b6g26\""
Jul 20 19:15:16.125927 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.125850    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 19:15:16.126236 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.126220    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 19:15:16.126318 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.126265    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 19:15:16.126464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.126446    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 19:15:16.126653 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.126637    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 19:15:16.126747 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.126728    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 19:15:16.126814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.126643    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j44k9\""
Jul 20 19:15:16.127027 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.127013    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tl872"
Jul 20 19:15:16.127524 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.127490    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 19:15:16.127524 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.127504    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 19:15:16.128023 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.128008    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hfqtf"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129332    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-run-openvswitch\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4430254-3957-4d90-a9be-9b4760c44565-ovnkube-config\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129455    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4430254-3957-4d90-a9be-9b4760c44565-ovnkube-script-lib\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129477    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-sys\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-lib-modules\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs\") pod \"network-metrics-daemon-knd47\" (UID: \"4bb1eb6f-7037-4418-8854-0eb07dc60dd2\") " pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129528    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-systemd-units\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-run-netns\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-run-ovn\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129575    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-run-ovn-kubernetes\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129600    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-systemd\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129622    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-run\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxjv2\" (UniqueName: \"kubernetes.io/projected/b4430254-3957-4d90-a9be-9b4760c44565-kube-api-access-rxjv2\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129662    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-kubelet\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.131495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-run-systemd\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129696    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-log-socket\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-sysctl-conf\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-sysconfig\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-kubernetes\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-sysctl-d\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5sgn\" (UniqueName: \"kubernetes.io/projected/e9de1d53-1854-48e7-b3b9-5610365644df-kube-api-access-j5sgn\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khnwp\" (UniqueName: \"kubernetes.io/projected/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-kube-api-access-khnwp\") pod \"network-metrics-daemon-knd47\" (UID: \"4bb1eb6f-7037-4418-8854-0eb07dc60dd2\") " pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4430254-3957-4d90-a9be-9b4760c44565-ovn-node-metrics-cert\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9de1d53-1854-48e7-b3b9-5610365644df-etc-tuned\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-modprobe-d\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-var-lib-openvswitch\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129975    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-node-log\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.129998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-host\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.130026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-slash\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.130047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-etc-openvswitch\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.132336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.130069    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-cni-bin\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.130090    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-cni-netd\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.130119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4430254-3957-4d90-a9be-9b4760c44565-env-overrides\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.130156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-var-lib-kubelet\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.130171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9de1d53-1854-48e7-b3b9-5610365644df-tmp\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.130736    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.130744    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rdvmd\""
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.130764    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.130914    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.130987    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.130995    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.131218    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xvgs2\""
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.131267    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.131306    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.131338    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.131403    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.131678    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.131687    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xpkjt\""
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.132357    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.132641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:16.132963 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.132695    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:16.135442 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.135423    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-czf9f\""
Jul 20 19:15:16.140109 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.140093    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 19:15:16.177053 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.177031    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x2s5f"
Jul 20 19:15:16.190386 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.190361    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x2s5f"
Jul 20 19:15:16.218662 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.218627    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 19:15:16.230993 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.230959    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5ddb13d-dae2-4202-91fe-90cafe691110-cnibin\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.230993 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.230998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-run-k8s-cni-cncf-io\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.231232 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231024    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1d98b95-11d0-422d-bccf-6284f813cd9b-kubelet-config\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:16.231232 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231051    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.231232 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-cni-bin\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231232 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-cni-netd\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231232 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4430254-3957-4d90-a9be-9b4760c44565-env-overrides\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231232 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231162    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-cni-bin\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231232 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231158    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-cni-netd\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231232 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-cnibin\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.231490 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b874fd5-c689-4333-8dec-c1501ff9086d-tmp-dir\") pod \"node-resolver-tl872\" (UID: \"7b874fd5-c689-4333-8dec-c1501ff9086d\") " pod="openshift-dns/node-resolver-tl872"
Jul 20 19:15:16.231490 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-var-lib-kubelet\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.231490 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231341    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-var-lib-kubelet\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.231490 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-system-cni-dir\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.231490 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82r2z\" (UniqueName: \"kubernetes.io/projected/7b874fd5-c689-4333-8dec-c1501ff9086d-kube-api-access-82r2z\") pod \"node-resolver-tl872\" (UID: \"7b874fd5-c689-4333-8dec-c1501ff9086d\") " pod="openshift-dns/node-resolver-tl872"
Jul 20 19:15:16.231490 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231433    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-etc-selinux\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.231490 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231490 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4430254-3957-4d90-a9be-9b4760c44565-ovnkube-config\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4430254-3957-4d90-a9be-9b4760c44565-ovnkube-script-lib\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231559    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4430254-3957-4d90-a9be-9b4760c44565-env-overrides\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231571    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-sys\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231600    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4ef943e-f706-436b-95fc-82b7bb4cc154-iptables-alerter-script\") pod \"iptables-alerter-hfqtf\" (UID: \"d4ef943e-f706-436b-95fc-82b7bb4cc154\") " pod="openshift-network-operator/iptables-alerter-hfqtf"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-run-netns\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231635    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-sys\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-run-ovn-kubernetes\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231667    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-run-netns\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-systemd\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5ddb13d-dae2-4202-91fe-90cafe691110-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231715    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-os-release\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231710    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-run-ovn-kubernetes\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-systemd\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4ef943e-f706-436b-95fc-82b7bb4cc154-host-slash\") pod \"iptables-alerter-hfqtf\" (UID: \"d4ef943e-f706-436b-95fc-82b7bb4cc154\") " pod="openshift-network-operator/iptables-alerter-hfqtf"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-kubelet\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.231839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-run-systemd\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231797    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-sysctl-conf\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4n2f\" (UniqueName: \"kubernetes.io/projected/c5ddb13d-dae2-4202-91fe-90cafe691110-kube-api-access-n4n2f\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231835    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8-host\") pod \"node-ca-mb7g9\" (UID: \"b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8\") " pod="openshift-image-registry/node-ca-mb7g9"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231843    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-run-systemd\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-kubernetes\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5sgn\" (UniqueName: \"kubernetes.io/projected/e9de1d53-1854-48e7-b3b9-5610365644df-kube-api-access-j5sgn\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231894    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1781dbad-3d0b-49da-bac6-368ad5e817f9-konnectivity-ca\") pod \"konnectivity-agent-gwcjd\" (UID: \"1781dbad-3d0b-49da-bac6-368ad5e817f9\") " pod="kube-system/konnectivity-agent-gwcjd"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-kubernetes\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khnwp\" (UniqueName: \"kubernetes.io/projected/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-kube-api-access-khnwp\") pod \"network-metrics-daemon-knd47\" (UID: \"4bb1eb6f-7037-4418-8854-0eb07dc60dd2\") " pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4430254-3957-4d90-a9be-9b4760c44565-ovn-node-metrics-cert\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-sysctl-conf\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5ddb13d-dae2-4202-91fe-90cafe691110-system-cni-dir\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231974    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4430254-3957-4d90-a9be-9b4760c44565-ovnkube-script-lib\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.231989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz52l\" (UniqueName: \"kubernetes.io/projected/e3e011d5-6791-49a1-9e9f-16610dc15d63-kube-api-access-vz52l\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1d98b95-11d0-422d-bccf-6284f813cd9b-dbus\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:16.232669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232057    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4430254-3957-4d90-a9be-9b4760c44565-ovnkube-config\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llfm9\" (UniqueName: \"kubernetes.io/projected/b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8-kube-api-access-llfm9\") pod \"node-ca-mb7g9\" (UID: \"b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8\") " pod="openshift-image-registry/node-ca-mb7g9"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-sys-fs\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-node-log\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232162    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-kubelet\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232208    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-node-log\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232228    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-multus-conf-dir\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232258    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6np4\" (UniqueName: \"kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4\") pod \"network-check-target-xcfmn\" (UID: \"2c47c789-0902-479a-9713-a46677075564\") " pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232274    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232281    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-slash\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232319    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-host-slash\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-etc-openvswitch\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b874fd5-c689-4333-8dec-c1501ff9086d-hosts-file\") pod \"node-resolver-tl872\" (UID: \"7b874fd5-c689-4333-8dec-c1501ff9086d\") " pod="openshift-dns/node-resolver-tl872"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232388    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-etc-openvswitch\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232399    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-device-dir\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9de1d53-1854-48e7-b3b9-5610365644df-tmp\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-multus-socket-dir-parent\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.233311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-socket-dir\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-multus-cni-dir\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-run-openvswitch\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-run-openvswitch\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-lib-modules\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232646    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5ddb13d-dae2-4202-91fe-90cafe691110-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-var-lib-cni-multus\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232703    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-var-lib-kubelet\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232724    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3e011d5-6791-49a1-9e9f-16610dc15d63-multus-daemon-config\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232743    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wv8j\" (UniqueName: \"kubernetes.io/projected/2d2dfed5-adb8-400c-bfe1-93788fee4c41-kube-api-access-7wv8j\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-var-lib-cni-bin\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232771    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-lib-modules\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs\") pod \"network-metrics-daemon-knd47\" (UID: \"4bb1eb6f-7037-4418-8854-0eb07dc60dd2\") " pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-systemd-units\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-run-ovn\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-run\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3e011d5-6791-49a1-9e9f-16610dc15d63-cni-binary-copy\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.234022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8-serviceca\") pod \"node-ca-mb7g9\" (UID: \"b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8\") " pod="openshift-image-registry/node-ca-mb7g9"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232919    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-run-netns\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.232934    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxjv2\" (UniqueName: \"kubernetes.io/projected/b4430254-3957-4d90-a9be-9b4760c44565-kube-api-access-rxjv2\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-log-socket\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.232994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-run-multus-certs\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.233013    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs podName:4bb1eb6f-7037-4418-8854-0eb07dc60dd2 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:16.732994494 +0000 UTC m=+2.956621677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs") pod "network-metrics-daemon-knd47" (UID: "4bb1eb6f-7037-4418-8854-0eb07dc60dd2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233032    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-systemd-units\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1781dbad-3d0b-49da-bac6-368ad5e817f9-agent-certs\") pod \"konnectivity-agent-gwcjd\" (UID: \"1781dbad-3d0b-49da-bac6-368ad5e817f9\") " pod="kube-system/konnectivity-agent-gwcjd"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233073    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-run-ovn\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-registration-dir\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-log-socket\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-sysconfig\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233150    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-run\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-sysconfig\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-sysctl-d\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-sysctl-d\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.234709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233387    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5ddb13d-dae2-4202-91fe-90cafe691110-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.235415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l748p\" (UniqueName: \"kubernetes.io/projected/d4ef943e-f706-436b-95fc-82b7bb4cc154-kube-api-access-l748p\") pod \"iptables-alerter-hfqtf\" (UID: \"d4ef943e-f706-436b-95fc-82b7bb4cc154\") " pod="openshift-network-operator/iptables-alerter-hfqtf"
Jul 20 19:15:16.235415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9de1d53-1854-48e7-b3b9-5610365644df-etc-tuned\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.235415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5ddb13d-dae2-4202-91fe-90cafe691110-os-release\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.235415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5ddb13d-dae2-4202-91fe-90cafe691110-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.235415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233599    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-hostroot\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.235415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233618    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-etc-kubernetes\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.235415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-modprobe-d\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.235415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-var-lib-openvswitch\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.235415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233687    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-host\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.235415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233768    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-host\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.235415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9de1d53-1854-48e7-b3b9-5610365644df-etc-modprobe-d\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.235415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.233870    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4430254-3957-4d90-a9be-9b4760c44565-var-lib-openvswitch\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.236089 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.236058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4430254-3957-4d90-a9be-9b4760c44565-ovn-node-metrics-cert\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.236328 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.236309    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9de1d53-1854-48e7-b3b9-5610365644df-tmp\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.236409 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.236336    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9de1d53-1854-48e7-b3b9-5610365644df-etc-tuned\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.244263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.244240    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khnwp\" (UniqueName: \"kubernetes.io/projected/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-kube-api-access-khnwp\") pod \"network-metrics-daemon-knd47\" (UID: \"4bb1eb6f-7037-4418-8854-0eb07dc60dd2\") " pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:16.245097 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.245073    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5sgn\" (UniqueName: \"kubernetes.io/projected/e9de1d53-1854-48e7-b3b9-5610365644df-kube-api-access-j5sgn\") pod \"tuned-7djgf\" (UID: \"e9de1d53-1854-48e7-b3b9-5610365644df\") " pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.245673 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.245659    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxjv2\" (UniqueName: \"kubernetes.io/projected/b4430254-3957-4d90-a9be-9b4760c44565-kube-api-access-rxjv2\") pod \"ovnkube-node-njbnv\" (UID: \"b4430254-3957-4d90-a9be-9b4760c44565\") " pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.266807 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.266780    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.333946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5ddb13d-dae2-4202-91fe-90cafe691110-system-cni-dir\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.333984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz52l\" (UniqueName: \"kubernetes.io/projected/e3e011d5-6791-49a1-9e9f-16610dc15d63-kube-api-access-vz52l\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1d98b95-11d0-422d-bccf-6284f813cd9b-dbus\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334010    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5ddb13d-dae2-4202-91fe-90cafe691110-system-cni-dir\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llfm9\" (UniqueName: \"kubernetes.io/projected/b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8-kube-api-access-llfm9\") pod \"node-ca-mb7g9\" (UID: \"b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8\") " pod="openshift-image-registry/node-ca-mb7g9"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-sys-fs\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-multus-conf-dir\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6np4\" (UniqueName: \"kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4\") pod \"network-check-target-xcfmn\" (UID: \"2c47c789-0902-479a-9713-a46677075564\") " pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b874fd5-c689-4333-8dec-c1501ff9086d-hosts-file\") pod \"node-resolver-tl872\" (UID: \"7b874fd5-c689-4333-8dec-c1501ff9086d\") " pod="openshift-dns/node-resolver-tl872"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-device-dir\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.334168    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-multus-socket-dir-parent\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334220    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1d98b95-11d0-422d-bccf-6284f813cd9b-dbus\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334228    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-socket-dir\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.334246    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret podName:b1d98b95-11d0-422d-bccf-6284f813cd9b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:16.834227696 +0000 UTC m=+3.057854855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret") pod "global-pull-secret-syncer-l67tj" (UID: "b1d98b95-11d0-422d-bccf-6284f813cd9b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:16.335755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-sys-fs\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-socket-dir\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-multus-conf-dir\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b874fd5-c689-4333-8dec-c1501ff9086d-hosts-file\") pod \"node-resolver-tl872\" (UID: \"7b874fd5-c689-4333-8dec-c1501ff9086d\") " pod="openshift-dns/node-resolver-tl872"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-device-dir\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-multus-cni-dir\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334502    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5ddb13d-dae2-4202-91fe-90cafe691110-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-multus-cni-dir\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-var-lib-cni-multus\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334465    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-multus-socket-dir-parent\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-var-lib-kubelet\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334567    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3e011d5-6791-49a1-9e9f-16610dc15d63-multus-daemon-config\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wv8j\" (UniqueName: \"kubernetes.io/projected/2d2dfed5-adb8-400c-bfe1-93788fee4c41-kube-api-access-7wv8j\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-var-lib-cni-multus\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-var-lib-cni-bin\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3e011d5-6791-49a1-9e9f-16610dc15d63-cni-binary-copy\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8-serviceca\") pod \"node-ca-mb7g9\" (UID: \"b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8\") " pod="openshift-image-registry/node-ca-mb7g9"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-run-netns\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.336695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-var-lib-kubelet\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-run-multus-certs\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1781dbad-3d0b-49da-bac6-368ad5e817f9-agent-certs\") pod \"konnectivity-agent-gwcjd\" (UID: \"1781dbad-3d0b-49da-bac6-368ad5e817f9\") " pod="kube-system/konnectivity-agent-gwcjd"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-registration-dir\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5ddb13d-dae2-4202-91fe-90cafe691110-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l748p\" (UniqueName: \"kubernetes.io/projected/d4ef943e-f706-436b-95fc-82b7bb4cc154-kube-api-access-l748p\") pod \"iptables-alerter-hfqtf\" (UID: \"d4ef943e-f706-436b-95fc-82b7bb4cc154\") " pod="openshift-network-operator/iptables-alerter-hfqtf"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5ddb13d-dae2-4202-91fe-90cafe691110-os-release\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5ddb13d-dae2-4202-91fe-90cafe691110-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-hostroot\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-etc-kubernetes\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5ddb13d-dae2-4202-91fe-90cafe691110-cnibin\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-run-k8s-cni-cncf-io\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1d98b95-11d0-422d-bccf-6284f813cd9b-kubelet-config\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334956    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-cnibin\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.334991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b874fd5-c689-4333-8dec-c1501ff9086d-tmp-dir\") pod \"node-resolver-tl872\" (UID: \"7b874fd5-c689-4333-8dec-c1501ff9086d\") " pod="openshift-dns/node-resolver-tl872"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335008    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-system-cni-dir\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.337567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82r2z\" (UniqueName: \"kubernetes.io/projected/7b874fd5-c689-4333-8dec-c1501ff9086d-kube-api-access-82r2z\") pod \"node-resolver-tl872\" (UID: \"7b874fd5-c689-4333-8dec-c1501ff9086d\") " pod="openshift-dns/node-resolver-tl872"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335215    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5ddb13d-dae2-4202-91fe-90cafe691110-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335220    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5ddb13d-dae2-4202-91fe-90cafe691110-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335230    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-hostroot\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335215    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3e011d5-6791-49a1-9e9f-16610dc15d63-multus-daemon-config\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-etc-selinux\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3e011d5-6791-49a1-9e9f-16610dc15d63-cni-binary-copy\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335268    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-etc-kubernetes\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4ef943e-f706-436b-95fc-82b7bb4cc154-iptables-alerter-script\") pod \"iptables-alerter-hfqtf\" (UID: \"d4ef943e-f706-436b-95fc-82b7bb4cc154\") " pod="openshift-network-operator/iptables-alerter-hfqtf"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335301    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-run-k8s-cni-cncf-io\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5ddb13d-dae2-4202-91fe-90cafe691110-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335335    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-var-lib-cni-bin\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-os-release\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335381    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1d98b95-11d0-422d-bccf-6284f813cd9b-kubelet-config\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4ef943e-f706-436b-95fc-82b7bb4cc154-host-slash\") pod \"iptables-alerter-hfqtf\" (UID: \"d4ef943e-f706-436b-95fc-82b7bb4cc154\") " pod="openshift-network-operator/iptables-alerter-hfqtf"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4ef943e-f706-436b-95fc-82b7bb4cc154-host-slash\") pod \"iptables-alerter-hfqtf\" (UID: \"d4ef943e-f706-436b-95fc-82b7bb4cc154\") " pod="openshift-network-operator/iptables-alerter-hfqtf"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4n2f\" (UniqueName: \"kubernetes.io/projected/c5ddb13d-dae2-4202-91fe-90cafe691110-kube-api-access-n4n2f\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.338441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-registration-dir\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335550    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b874fd5-c689-4333-8dec-c1501ff9086d-tmp-dir\") pod \"node-resolver-tl872\" (UID: \"7b874fd5-c689-4333-8dec-c1501ff9086d\") " pod="openshift-dns/node-resolver-tl872"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335614    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-system-cni-dir\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335645    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8-host\") pod \"node-ca-mb7g9\" (UID: \"b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8\") " pod="openshift-image-registry/node-ca-mb7g9"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8-serviceca\") pod \"node-ca-mb7g9\" (UID: \"b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8\") " pod="openshift-image-registry/node-ca-mb7g9"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335685    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-run-multus-certs\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335709    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335734    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5ddb13d-dae2-4202-91fe-90cafe691110-os-release\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8-host\") pod \"node-ca-mb7g9\" (UID: \"b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8\") " pod="openshift-image-registry/node-ca-mb7g9"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335780    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-os-release\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1781dbad-3d0b-49da-bac6-368ad5e817f9-konnectivity-ca\") pod \"konnectivity-agent-gwcjd\" (UID: \"1781dbad-3d0b-49da-bac6-368ad5e817f9\") " pod="kube-system/konnectivity-agent-gwcjd"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335752    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-cnibin\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5ddb13d-dae2-4202-91fe-90cafe691110-cnibin\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335933    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d2dfed5-adb8-400c-bfe1-93788fee4c41-etc-selinux\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.336085    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5ddb13d-dae2-4202-91fe-90cafe691110-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.335295    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3e011d5-6791-49a1-9e9f-16610dc15d63-host-run-netns\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.336238    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5ddb13d-dae2-4202-91fe-90cafe691110-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.336319    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1781dbad-3d0b-49da-bac6-368ad5e817f9-konnectivity-ca\") pod \"konnectivity-agent-gwcjd\" (UID: \"1781dbad-3d0b-49da-bac6-368ad5e817f9\") " pod="kube-system/konnectivity-agent-gwcjd"
Jul 20 19:15:16.339263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.336350    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4ef943e-f706-436b-95fc-82b7bb4cc154-iptables-alerter-script\") pod \"iptables-alerter-hfqtf\" (UID: \"d4ef943e-f706-436b-95fc-82b7bb4cc154\") " pod="openshift-network-operator/iptables-alerter-hfqtf"
Jul 20 19:15:16.340120 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.337773    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1781dbad-3d0b-49da-bac6-368ad5e817f9-agent-certs\") pod \"konnectivity-agent-gwcjd\" (UID: \"1781dbad-3d0b-49da-bac6-368ad5e817f9\") " pod="kube-system/konnectivity-agent-gwcjd"
Jul 20 19:15:16.341353 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.341331    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:15:16.341462 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.341359    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:15:16.341462 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.341373    2581 projected.go:196] Error preparing data for projected volume kube-api-access-b6np4 for pod openshift-network-diagnostics/network-check-target-xcfmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:16.341462 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.341433    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4 podName:2c47c789-0902-479a-9713-a46677075564 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:16.841413896 +0000 UTC m=+3.065041059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b6np4" (UniqueName: "kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4") pod "network-check-target-xcfmn" (UID: "2c47c789-0902-479a-9713-a46677075564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:16.343839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.343797    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llfm9\" (UniqueName: \"kubernetes.io/projected/b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8-kube-api-access-llfm9\") pod \"node-ca-mb7g9\" (UID: \"b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8\") " pod="openshift-image-registry/node-ca-mb7g9"
Jul 20 19:15:16.344310 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.344285    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz52l\" (UniqueName: \"kubernetes.io/projected/e3e011d5-6791-49a1-9e9f-16610dc15d63-kube-api-access-vz52l\") pod \"multus-m4mdf\" (UID: \"e3e011d5-6791-49a1-9e9f-16610dc15d63\") " pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.344956 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.344937    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l748p\" (UniqueName: \"kubernetes.io/projected/d4ef943e-f706-436b-95fc-82b7bb4cc154-kube-api-access-l748p\") pod \"iptables-alerter-hfqtf\" (UID: \"d4ef943e-f706-436b-95fc-82b7bb4cc154\") " pod="openshift-network-operator/iptables-alerter-hfqtf"
Jul 20 19:15:16.345053 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.344974    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wv8j\" (UniqueName: \"kubernetes.io/projected/2d2dfed5-adb8-400c-bfe1-93788fee4c41-kube-api-access-7wv8j\") pod \"aws-ebs-csi-driver-node-2bf2q\" (UID: \"2d2dfed5-adb8-400c-bfe1-93788fee4c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.346237 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.346208    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82r2z\" (UniqueName: \"kubernetes.io/projected/7b874fd5-c689-4333-8dec-c1501ff9086d-kube-api-access-82r2z\") pod \"node-resolver-tl872\" (UID: \"7b874fd5-c689-4333-8dec-c1501ff9086d\") " pod="openshift-dns/node-resolver-tl872"
Jul 20 19:15:16.346318 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.346305    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4n2f\" (UniqueName: \"kubernetes.io/projected/c5ddb13d-dae2-4202-91fe-90cafe691110-kube-api-access-n4n2f\") pod \"multus-additional-cni-plugins-h5vjc\" (UID: \"c5ddb13d-dae2-4202-91fe-90cafe691110\") " pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.425713 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.425634    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7djgf"
Jul 20 19:15:16.433733 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.433709    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:16.444076 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.444054    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gwcjd"
Jul 20 19:15:16.448864 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.448842    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mb7g9"
Jul 20 19:15:16.457409 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.457391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q"
Jul 20 19:15:16.463015 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.462995    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h5vjc"
Jul 20 19:15:16.469658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.469638    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tl872"
Jul 20 19:15:16.477269 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.477243    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hfqtf"
Jul 20 19:15:16.486926 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.486905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m4mdf"
Jul 20 19:15:16.738272 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.738171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs\") pod \"network-metrics-daemon-knd47\" (UID: \"4bb1eb6f-7037-4418-8854-0eb07dc60dd2\") " pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:16.738416 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.738356    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:16.738466 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.738438    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs podName:4bb1eb6f-7037-4418-8854-0eb07dc60dd2 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:17.738418624 +0000 UTC m=+3.962045786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs") pod "network-metrics-daemon-knd47" (UID: "4bb1eb6f-7037-4418-8854-0eb07dc60dd2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:16.839414 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.839379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:16.839599 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.839540    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:16.839691 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.839632    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret podName:b1d98b95-11d0-422d-bccf-6284f813cd9b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:17.839610393 +0000 UTC m=+4.063237556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret") pod "global-pull-secret-syncer-l67tj" (UID: "b1d98b95-11d0-422d-bccf-6284f813cd9b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:16.940359 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:16.940310    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6np4\" (UniqueName: \"kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4\") pod \"network-check-target-xcfmn\" (UID: \"2c47c789-0902-479a-9713-a46677075564\") " pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:16.940489 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.940478    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:15:16.940557 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.940497    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:15:16.940557 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.940509    2581 projected.go:196] Error preparing data for projected volume kube-api-access-b6np4 for pod openshift-network-diagnostics/network-check-target-xcfmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:16.940636 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:16.940567    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4 podName:2c47c789-0902-479a-9713-a46677075564 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:17.940548901 +0000 UTC m=+4.164176065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6np4" (UniqueName: "kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4") pod "network-check-target-xcfmn" (UID: "2c47c789-0902-479a-9713-a46677075564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:17.110897 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:17.110870    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b874fd5_c689_4333_8dec_c1501ff9086d.slice/crio-16ae9647db7475384e35e564b07a6c0eb74c8d0718b9dc73a7dc94d7223772b9 WatchSource:0}: Error finding container 16ae9647db7475384e35e564b07a6c0eb74c8d0718b9dc73a7dc94d7223772b9: Status 404 returned error can't find the container with id 16ae9647db7475384e35e564b07a6c0eb74c8d0718b9dc73a7dc94d7223772b9
Jul 20 19:15:17.113226 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:17.113165    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e011d5_6791_49a1_9e9f_16610dc15d63.slice/crio-2742ea2a676037b14aef1dfa2161ba8ca4c7db54b73027e121dae9de0ad63c2b WatchSource:0}: Error finding container 2742ea2a676037b14aef1dfa2161ba8ca4c7db54b73027e121dae9de0ad63c2b: Status 404 returned error can't find the container with id 2742ea2a676037b14aef1dfa2161ba8ca4c7db54b73027e121dae9de0ad63c2b
Jul 20 19:15:17.116974 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:17.116902    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b0b496_eaaa_4d90_8aac_a3c5fa796ac8.slice/crio-e29b9af824a231c3209176d5e1f8269e51eef72e3ffe13cdc9607b0f41f745bc WatchSource:0}: Error finding container e29b9af824a231c3209176d5e1f8269e51eef72e3ffe13cdc9607b0f41f745bc: Status 404 returned error can't find the container with id e29b9af824a231c3209176d5e1f8269e51eef72e3ffe13cdc9607b0f41f745bc
Jul 20 19:15:17.117657 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:17.117592    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4430254_3957_4d90_a9be_9b4760c44565.slice/crio-d8deb22618fe4d399fb97a4028ddc202a3c94889b33ff99090b790585d7aa398 WatchSource:0}: Error finding container d8deb22618fe4d399fb97a4028ddc202a3c94889b33ff99090b790585d7aa398: Status 404 returned error can't find the container with id d8deb22618fe4d399fb97a4028ddc202a3c94889b33ff99090b790585d7aa398
Jul 20 19:15:17.118594 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:17.118575    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ef943e_f706_436b_95fc_82b7bb4cc154.slice/crio-105a2187402eb1a29704b6af16b91d595d580fb31f5ffd388097a28b00da6d5b WatchSource:0}: Error finding container 105a2187402eb1a29704b6af16b91d595d580fb31f5ffd388097a28b00da6d5b: Status 404 returned error can't find the container with id 105a2187402eb1a29704b6af16b91d595d580fb31f5ffd388097a28b00da6d5b
Jul 20 19:15:17.120767 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:17.120258    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2dfed5_adb8_400c_bfe1_93788fee4c41.slice/crio-a8daeb5a2515d45e5425a8fd7cf5835efb387be76cbe67084891ee9125b7a3d5 WatchSource:0}: Error finding container a8daeb5a2515d45e5425a8fd7cf5835efb387be76cbe67084891ee9125b7a3d5: Status 404 returned error can't find the container with id a8daeb5a2515d45e5425a8fd7cf5835efb387be76cbe67084891ee9125b7a3d5
Jul 20 19:15:17.121410 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:17.121387    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1781dbad_3d0b_49da_bac6_368ad5e817f9.slice/crio-0526c2562710a126866a34dbd518ffa211feb948f430b91412e2a192c9312068 WatchSource:0}: Error finding container 0526c2562710a126866a34dbd518ffa211feb948f430b91412e2a192c9312068: Status 404 returned error can't find the container with id 0526c2562710a126866a34dbd518ffa211feb948f430b91412e2a192c9312068
Jul 20 19:15:17.122387 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:17.122366    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ddb13d_dae2_4202_91fe_90cafe691110.slice/crio-a89db35f18d0a46268c90e70939a8a6066b257a0389641ec90960c8905ff74f0 WatchSource:0}: Error finding container a89db35f18d0a46268c90e70939a8a6066b257a0389641ec90960c8905ff74f0: Status 404 returned error can't find the container with id a89db35f18d0a46268c90e70939a8a6066b257a0389641ec90960c8905ff74f0
Jul 20 19:15:17.122786 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:15:17.122725    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9de1d53_1854_48e7_b3b9_5610365644df.slice/crio-fdd879327f0d2995e80c70201ea99b8646354a0e3fce637a5acf7cc48b3be1d9 WatchSource:0}: Error finding container fdd879327f0d2995e80c70201ea99b8646354a0e3fce637a5acf7cc48b3be1d9: Status 404 returned error can't find the container with id fdd879327f0d2995e80c70201ea99b8646354a0e3fce637a5acf7cc48b3be1d9
Jul 20 19:15:17.192954 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.192811    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:10:16 +0000 UTC" deadline="2028-04-14 13:30:49.66887024 +0000 UTC"
Jul 20 19:15:17.193040 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.192962    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15210h15m32.475916447s"
Jul 20 19:15:17.268246 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.268177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5vjc" event={"ID":"c5ddb13d-dae2-4202-91fe-90cafe691110","Type":"ContainerStarted","Data":"a89db35f18d0a46268c90e70939a8a6066b257a0389641ec90960c8905ff74f0"}
Jul 20 19:15:17.269256 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.269223    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q" event={"ID":"2d2dfed5-adb8-400c-bfe1-93788fee4c41","Type":"ContainerStarted","Data":"a8daeb5a2515d45e5425a8fd7cf5835efb387be76cbe67084891ee9125b7a3d5"}
Jul 20 19:15:17.270748 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.270720    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv" event={"ID":"b4430254-3957-4d90-a9be-9b4760c44565","Type":"ContainerStarted","Data":"d8deb22618fe4d399fb97a4028ddc202a3c94889b33ff99090b790585d7aa398"}
Jul 20 19:15:17.272150 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.272126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mb7g9" event={"ID":"b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8","Type":"ContainerStarted","Data":"e29b9af824a231c3209176d5e1f8269e51eef72e3ffe13cdc9607b0f41f745bc"}
Jul 20 19:15:17.273832 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.273805    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m4mdf" event={"ID":"e3e011d5-6791-49a1-9e9f-16610dc15d63","Type":"ContainerStarted","Data":"2742ea2a676037b14aef1dfa2161ba8ca4c7db54b73027e121dae9de0ad63c2b"}
Jul 20 19:15:17.274918 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.274894    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tl872" event={"ID":"7b874fd5-c689-4333-8dec-c1501ff9086d","Type":"ContainerStarted","Data":"16ae9647db7475384e35e564b07a6c0eb74c8d0718b9dc73a7dc94d7223772b9"}
Jul 20 19:15:17.276522 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.276501    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:15:17.277011 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.276985    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-43.ec2.internal" event={"ID":"de8985a0299f61e88b78af4c7e64a175","Type":"ContainerStarted","Data":"9c5af65da4a4758db4299ad4f5c3d1973ec2456d106fa03099a3b51084cbb5aa"}
Jul 20 19:15:17.278132 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.278105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7djgf" event={"ID":"e9de1d53-1854-48e7-b3b9-5610365644df","Type":"ContainerStarted","Data":"fdd879327f0d2995e80c70201ea99b8646354a0e3fce637a5acf7cc48b3be1d9"}
Jul 20 19:15:17.279388 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.279368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gwcjd" event={"ID":"1781dbad-3d0b-49da-bac6-368ad5e817f9","Type":"ContainerStarted","Data":"0526c2562710a126866a34dbd518ffa211feb948f430b91412e2a192c9312068"}
Jul 20 19:15:17.281000 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.280982    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hfqtf" event={"ID":"d4ef943e-f706-436b-95fc-82b7bb4cc154","Type":"ContainerStarted","Data":"105a2187402eb1a29704b6af16b91d595d580fb31f5ffd388097a28b00da6d5b"}
Jul 20 19:15:17.290968 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.290930    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-43.ec2.internal" podStartSLOduration=2.290915189 podStartE2EDuration="2.290915189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:17.290474249 +0000 UTC m=+3.514101443" watchObservedRunningTime="2026-07-20 19:15:17.290915189 +0000 UTC m=+3.514542370"
Jul 20 19:15:17.747128 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.746550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs\") pod \"network-metrics-daemon-knd47\" (UID: \"4bb1eb6f-7037-4418-8854-0eb07dc60dd2\") " pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:17.747128 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:17.746710    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:17.747128 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:17.746773    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs podName:4bb1eb6f-7037-4418-8854-0eb07dc60dd2 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:19.746754341 +0000 UTC m=+5.970381503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs") pod "network-metrics-daemon-knd47" (UID: "4bb1eb6f-7037-4418-8854-0eb07dc60dd2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:17.848029 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.847459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:17.848029 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:17.847623    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:17.848029 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:17.847690    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret podName:b1d98b95-11d0-422d-bccf-6284f813cd9b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:19.847670533 +0000 UTC m=+6.071297723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret") pod "global-pull-secret-syncer-l67tj" (UID: "b1d98b95-11d0-422d-bccf-6284f813cd9b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:17.948641 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:17.947998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6np4\" (UniqueName: \"kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4\") pod \"network-check-target-xcfmn\" (UID: \"2c47c789-0902-479a-9713-a46677075564\") " pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:17.948641 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:17.948180    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:15:17.948641 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:17.948215    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:15:17.948641 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:17.948230    2581 projected.go:196] Error preparing data for projected volume kube-api-access-b6np4 for pod openshift-network-diagnostics/network-check-target-xcfmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:17.948641 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:17.948289    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4 podName:2c47c789-0902-479a-9713-a46677075564 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:19.948272191 +0000 UTC m=+6.171899351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6np4" (UniqueName: "kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4") pod "network-check-target-xcfmn" (UID: "2c47c789-0902-479a-9713-a46677075564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:18.193907 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:18.193794    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 19:10:16 +0000 UTC" deadline="2028-03-15 13:45:07.297263491 +0000 UTC"
Jul 20 19:15:18.193907 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:18.193858    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14490h29m49.103409714s"
Jul 20 19:15:18.263142 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:18.263109    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:18.263362 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:18.263272    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:18.263693 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:18.263673    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:18.263791 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:18.263770    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:18.263842 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:18.263835    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:18.263928 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:18.263904    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:18.299291 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:18.299250    2581 generic.go:356] "Generic (PLEG): container finished" podID="8926c1f84f412523854d845afc08afa5" containerID="a74ebc497dd9d0bc830ec04f5ef11e360528e808cdc385bcbb30c20199e41865" exitCode=0
Jul 20 19:15:18.300288 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:18.300221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal" event={"ID":"8926c1f84f412523854d845afc08afa5","Type":"ContainerDied","Data":"a74ebc497dd9d0bc830ec04f5ef11e360528e808cdc385bcbb30c20199e41865"}
Jul 20 19:15:19.323169 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:19.323131    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal" event={"ID":"8926c1f84f412523854d845afc08afa5","Type":"ContainerStarted","Data":"071cf5356b4a6c36ac3bcd81fe38179b0e80d72e020e0ee869262e698236fc25"}
Jul 20 19:15:19.338003 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:19.337949    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-43.ec2.internal" podStartSLOduration=4.337928424 podStartE2EDuration="4.337928424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:19.337599652 +0000 UTC m=+5.561226834" watchObservedRunningTime="2026-07-20 19:15:19.337928424 +0000 UTC m=+5.561555611"
Jul 20 19:15:19.764149 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:19.764063    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs\") pod \"network-metrics-daemon-knd47\" (UID: \"4bb1eb6f-7037-4418-8854-0eb07dc60dd2\") " pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:19.764343 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:19.764266    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:19.764343 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:19.764323    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs podName:4bb1eb6f-7037-4418-8854-0eb07dc60dd2 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:23.764303352 +0000 UTC m=+9.987930525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs") pod "network-metrics-daemon-knd47" (UID: "4bb1eb6f-7037-4418-8854-0eb07dc60dd2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:19.865201 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:19.865143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:19.865428 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:19.865373    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:19.865501 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:19.865441    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret podName:b1d98b95-11d0-422d-bccf-6284f813cd9b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:23.86542069 +0000 UTC m=+10.089047854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret") pod "global-pull-secret-syncer-l67tj" (UID: "b1d98b95-11d0-422d-bccf-6284f813cd9b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:19.965971 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:19.965930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6np4\" (UniqueName: \"kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4\") pod \"network-check-target-xcfmn\" (UID: \"2c47c789-0902-479a-9713-a46677075564\") " pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:19.966161 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:19.966098    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:15:19.966161 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:19.966119    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:15:19.966161 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:19.966132    2581 projected.go:196] Error preparing data for projected volume kube-api-access-b6np4 for pod openshift-network-diagnostics/network-check-target-xcfmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:19.966364 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:19.966207    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4 podName:2c47c789-0902-479a-9713-a46677075564 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:23.966170516 +0000 UTC m=+10.189797680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6np4" (UniqueName: "kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4") pod "network-check-target-xcfmn" (UID: "2c47c789-0902-479a-9713-a46677075564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:20.260327 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:20.260238    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:20.260327 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:20.260239    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:20.260571 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:20.260380    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:20.260571 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:20.260424    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:20.260571 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:20.260539    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:20.260804 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:20.260648    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:22.261261 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:22.260675    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:22.261261 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:22.260792    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:22.261261 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:22.261208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:22.261679 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:22.261303    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:22.261679 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:22.261397    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:22.261679 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:22.261489    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:23.810081 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:23.810049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs\") pod \"network-metrics-daemon-knd47\" (UID: \"4bb1eb6f-7037-4418-8854-0eb07dc60dd2\") " pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:23.810550 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:23.810171    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:23.810550 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:23.810243    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs podName:4bb1eb6f-7037-4418-8854-0eb07dc60dd2 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:31.81022745 +0000 UTC m=+18.033854628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs") pod "network-metrics-daemon-knd47" (UID: "4bb1eb6f-7037-4418-8854-0eb07dc60dd2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:23.910942 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:23.910904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:23.911122 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:23.911077    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:23.911178 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:23.911142    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret podName:b1d98b95-11d0-422d-bccf-6284f813cd9b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:31.911122107 +0000 UTC m=+18.134749271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret") pod "global-pull-secret-syncer-l67tj" (UID: "b1d98b95-11d0-422d-bccf-6284f813cd9b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:24.012294 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:24.012257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6np4\" (UniqueName: \"kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4\") pod \"network-check-target-xcfmn\" (UID: \"2c47c789-0902-479a-9713-a46677075564\") " pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:24.012506 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:24.012424    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:15:24.012506 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:24.012448    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:15:24.012506 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:24.012462    2581 projected.go:196] Error preparing data for projected volume kube-api-access-b6np4 for pod openshift-network-diagnostics/network-check-target-xcfmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:24.012665 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:24.012524    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4 podName:2c47c789-0902-479a-9713-a46677075564 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:32.012502476 +0000 UTC m=+18.236129650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6np4" (UniqueName: "kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4") pod "network-check-target-xcfmn" (UID: "2c47c789-0902-479a-9713-a46677075564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:24.262339 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:24.261587    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:24.262339 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:24.261692    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:24.262339 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:24.262061    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:24.262339 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:24.262155    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:24.262339 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:24.262161    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:24.262339 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:24.262255    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:26.260523 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:26.260486    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:26.260953 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:26.260610    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:26.261175 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:26.261037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:26.261175 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:26.261138    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:26.261369 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:26.261256    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:26.261369 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:26.261350    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:28.260899 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:28.260818    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:28.261345 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:28.260817    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:28.261345 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:28.260939    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:28.261345 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:28.260951    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:28.261345 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:28.261065    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:28.261345 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:28.261133    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:30.260604 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:30.260566    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:30.260604 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:30.260603    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:30.261086 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:30.260566    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:30.261086 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:30.260692    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:30.261086 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:30.260804    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:30.261086 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:30.260873    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:31.871371 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:31.871323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs\") pod \"network-metrics-daemon-knd47\" (UID: \"4bb1eb6f-7037-4418-8854-0eb07dc60dd2\") " pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:31.871918 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:31.871489    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:31.871918 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:31.871577    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs podName:4bb1eb6f-7037-4418-8854-0eb07dc60dd2 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:47.871553868 +0000 UTC m=+34.095181041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs") pod "network-metrics-daemon-knd47" (UID: "4bb1eb6f-7037-4418-8854-0eb07dc60dd2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:31.972089 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:31.972049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:31.972262 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:31.972207    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:31.972326 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:31.972272    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret podName:b1d98b95-11d0-422d-bccf-6284f813cd9b nodeName:}" failed. No retries permitted until 2026-07-20 19:15:47.972254875 +0000 UTC m=+34.195882038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret") pod "global-pull-secret-syncer-l67tj" (UID: "b1d98b95-11d0-422d-bccf-6284f813cd9b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:32.072839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:32.072800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6np4\" (UniqueName: \"kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4\") pod \"network-check-target-xcfmn\" (UID: \"2c47c789-0902-479a-9713-a46677075564\") " pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:32.073019 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:32.072991    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:15:32.073019 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:32.073024    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:15:32.073163 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:32.073034    2581 projected.go:196] Error preparing data for projected volume kube-api-access-b6np4 for pod openshift-network-diagnostics/network-check-target-xcfmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:32.073163 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:32.073086    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4 podName:2c47c789-0902-479a-9713-a46677075564 nodeName:}" failed. No retries permitted until 2026-07-20 19:15:48.07307344 +0000 UTC m=+34.296700599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6np4" (UniqueName: "kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4") pod "network-check-target-xcfmn" (UID: "2c47c789-0902-479a-9713-a46677075564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:32.259982 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:32.259911    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:32.260110 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:32.259900    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:32.260110 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:32.260028    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:32.260110 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:32.260035    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:32.260110 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:32.260090    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:32.260262 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:32.260199    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:34.261175 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:34.261133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:34.261735 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:34.261264    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:34.261735 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:34.261359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:34.261735 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:34.261473    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:34.261735 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:34.261533    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:34.261735 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:34.261621    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:36.259850 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.259822    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:36.260382 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.259822    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:36.260382 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.259937    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:36.260382 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:36.259920    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:36.260382 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:36.260004    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:36.260382 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:36.260078    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:36.358579 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.358362    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gwcjd" event={"ID":"1781dbad-3d0b-49da-bac6-368ad5e817f9","Type":"ContainerStarted","Data":"8dbd40945471889165be9cfce8c07403eafabc53feea24d783cfb678b604ec46"}
Jul 20 19:15:36.360027 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.360001    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5ddb13d-dae2-4202-91fe-90cafe691110" containerID="9b74e1a22c3ac5d66e7cfea983ec395e17621bf53e8a786869846445cc4b7ad9" exitCode=0
Jul 20 19:15:36.360138 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.360083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5vjc" event={"ID":"c5ddb13d-dae2-4202-91fe-90cafe691110","Type":"ContainerDied","Data":"9b74e1a22c3ac5d66e7cfea983ec395e17621bf53e8a786869846445cc4b7ad9"}
Jul 20 19:15:36.366014 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.365985    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q" event={"ID":"2d2dfed5-adb8-400c-bfe1-93788fee4c41","Type":"ContainerStarted","Data":"04811403a2fc381a01be67367b2ec7f5d7530159557e729eaf3fd60b31bccf8e"}
Jul 20 19:15:36.368585 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.368561    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:15:36.368994 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.368970    2581 generic.go:356] "Generic (PLEG): container finished" podID="b4430254-3957-4d90-a9be-9b4760c44565" containerID="6669ebfe324d0dbae5805fe08e3758c06b5409f1cb80b0ebd1b15bf7a6f49eca" exitCode=1
Jul 20 19:15:36.369086 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.369042    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv" event={"ID":"b4430254-3957-4d90-a9be-9b4760c44565","Type":"ContainerStarted","Data":"b6abc881f5bf290ec98d5a096b4599cc9cbbca835ea14826afd00f1b0a70d88c"}
Jul 20 19:15:36.369170 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.369135    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv" event={"ID":"b4430254-3957-4d90-a9be-9b4760c44565","Type":"ContainerDied","Data":"6669ebfe324d0dbae5805fe08e3758c06b5409f1cb80b0ebd1b15bf7a6f49eca"}
Jul 20 19:15:36.369256 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.369210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv" event={"ID":"b4430254-3957-4d90-a9be-9b4760c44565","Type":"ContainerStarted","Data":"78c07bd4a4defc7040d4653f9fea137a20fc7cd271667e2bed4812cffe89312f"}
Jul 20 19:15:36.370834 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.370809    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mb7g9" event={"ID":"b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8","Type":"ContainerStarted","Data":"d92a32f2a18c9c9adcce7f754dfd863b4d88d76c1b7e5b7a22a984ae55de50ac"}
Jul 20 19:15:36.375045 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.375015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m4mdf" event={"ID":"e3e011d5-6791-49a1-9e9f-16610dc15d63","Type":"ContainerStarted","Data":"313fe3e2e5b32f551460774563775dcb49c28d8b8d7ec2cbceb0e92d1d2e9f57"}
Jul 20 19:15:36.376908 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.376883    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tl872" event={"ID":"7b874fd5-c689-4333-8dec-c1501ff9086d","Type":"ContainerStarted","Data":"42a9e2811081689610b5c8c54852cd4cc7f38836a357950912c6bce4f9c4664e"}
Jul 20 19:15:36.379734 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.379708    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7djgf" event={"ID":"e9de1d53-1854-48e7-b3b9-5610365644df","Type":"ContainerStarted","Data":"053719292ac16f1eaf05accf50ddf021c2ee24cb5015ef4ba0d15a3e63d13fed"}
Jul 20 19:15:36.383119 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.383077    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gwcjd" podStartSLOduration=11.556373835 podStartE2EDuration="22.383062753s" totalImagesPullingTime="10.826688918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:36.380890636 +0000 UTC m=+22.604517816" watchObservedRunningTime="2026-07-20 19:15:36.383062753 +0000 UTC m=+22.606689933"
Jul 20 19:15:36.419263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.419220    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tl872" podStartSLOduration=3.547257237 podStartE2EDuration="22.419172837s" totalImagesPullingTime="18.8719156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:36.418835068 +0000 UTC m=+22.642462250" watchObservedRunningTime="2026-07-20 19:15:36.419172837 +0000 UTC m=+22.642800020"
Jul 20 19:15:36.440861 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.440814    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7djgf" podStartSLOduration=3.5772550770000002 podStartE2EDuration="22.440798697s" totalImagesPullingTime="18.86354362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:36.440504142 +0000 UTC m=+22.664131324" watchObservedRunningTime="2026-07-20 19:15:36.440798697 +0000 UTC m=+22.664425899"
Jul 20 19:15:36.457820 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.457777    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m4mdf" podStartSLOduration=3.526633776 podStartE2EDuration="22.457763388s" totalImagesPullingTime="18.931129612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:36.45748581 +0000 UTC m=+22.681112992" watchObservedRunningTime="2026-07-20 19:15:36.457763388 +0000 UTC m=+22.681390569"
Jul 20 19:15:36.616899 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.616863    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:36.711319 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.711285    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:36.748555 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.748469    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gwcjd"
Jul 20 19:15:36.749038 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.749016    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gwcjd"
Jul 20 19:15:36.765451 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:36.765400    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mb7g9" podStartSLOduration=3.898388144 podStartE2EDuration="22.765382521s" totalImagesPullingTime="18.866994377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:36.473230212 +0000 UTC m=+22.696857390" watchObservedRunningTime="2026-07-20 19:15:36.765382521 +0000 UTC m=+22.989009707"
Jul 20 19:15:37.385576 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:37.385547    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:15:37.386319 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:37.385994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv" event={"ID":"b4430254-3957-4d90-a9be-9b4760c44565","Type":"ContainerStarted","Data":"21f10d24538762d39e1c416bab35e645069d4d4f0dc0dcd89d5b703d657d351f"}
Jul 20 19:15:37.386319 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:37.386081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv" event={"ID":"b4430254-3957-4d90-a9be-9b4760c44565","Type":"ContainerStarted","Data":"9f0a20158b47590034d93ec51b9916647bd17da3504fb7a9929ac21062d19ca6"}
Jul 20 19:15:37.386319 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:37.386130    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv" event={"ID":"b4430254-3957-4d90-a9be-9b4760c44565","Type":"ContainerStarted","Data":"7bf3f6fd69dc955ef30d210a9bfe11dacd0c04718145e2f91b5da4b5fc021482"}
Jul 20 19:15:37.387684 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:37.387652    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hfqtf" event={"ID":"d4ef943e-f706-436b-95fc-82b7bb4cc154","Type":"ContainerStarted","Data":"2e9b61b7eb5e2c52898a6fe3935e5f30eb29280e81c15e455cf9fce2088c8e36"}
Jul 20 19:15:37.523531 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:37.523487    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:37.571934 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:37.571904    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 19:15:37.624097 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:37.624043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:38.187596 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:38.187478    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T19:15:37.571929015Z","UUID":"904bb0fa-0f91-4c9d-b76c-c6acbb0fa798","Handler":null,"Name":"","Endpoint":""}
Jul 20 19:15:38.189200 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:38.189157    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 19:15:38.189324 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:38.189226    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 19:15:38.260281 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:38.260254    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:38.260281 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:38.260283    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:38.260537 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:38.260371    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:38.260537 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:38.260404    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:38.260537 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:38.260482    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:38.260688 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:38.260593    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:38.393267 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:38.393230    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q" event={"ID":"2d2dfed5-adb8-400c-bfe1-93788fee4c41","Type":"ContainerStarted","Data":"a34206c02645219b17f53d18e663c9a83df03fe2e2c497c3b4e2ad9bff8ab1d8"}
Jul 20 19:15:38.393267 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:38.393273    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 19:15:38.759981 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:38.759955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:38.861302 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:38.861255    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:39.398226 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:39.398174    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q" event={"ID":"2d2dfed5-adb8-400c-bfe1-93788fee4c41","Type":"ContainerStarted","Data":"f35e86bfb529589e0c8152d78b0110975fe0ca4ce81cc8871ff32f38caa5f2bb"}
Jul 20 19:15:39.401724 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:39.401698    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:15:39.402092 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:39.402072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv" event={"ID":"b4430254-3957-4d90-a9be-9b4760c44565","Type":"ContainerStarted","Data":"f4c20168762d7228da2dbebf6dfc96b60496f4baae0d642f785af580a425d763"}
Jul 20 19:15:39.424304 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:39.424244    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hfqtf" podStartSLOduration=6.559070349 podStartE2EDuration="25.424225996s" totalImagesPullingTime="18.865155647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:37.402104551 +0000 UTC m=+23.625731732" watchObservedRunningTime="2026-07-20 19:15:39.424225996 +0000 UTC m=+25.647853179"
Jul 20 19:15:39.424524 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:39.424497    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bf2q" podStartSLOduration=3.9258457399999998 podStartE2EDuration="25.424485203s" totalImagesPullingTime="21.498639463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:39.424132801 +0000 UTC m=+25.647759982" watchObservedRunningTime="2026-07-20 19:15:39.424485203 +0000 UTC m=+25.648112383"
Jul 20 19:15:39.456966 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:39.456919    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:39.524261 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:39.524231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:40.053164 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:40.053125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:40.146162 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:40.146130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:40.248215 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:40.248166    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:40.260336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:40.260303    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:40.260336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:40.260340    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:40.260555 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:40.260309    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:40.260555 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:40.260432    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:40.260555 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:40.260499    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:40.260672 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:40.260576    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:41.089893 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:41.089851    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:41.190663 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:41.190334    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:41.410308 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:41.410100    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:15:41.410674 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:41.410643    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv" event={"ID":"b4430254-3957-4d90-a9be-9b4760c44565","Type":"ContainerStarted","Data":"f61a993b722c3e5c88fa8d6cf93618f0f6d383f718e9dcb122a53b45df56f136"}
Jul 20 19:15:41.410905 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:41.410890    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:41.411152 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:41.411133    2581 scope.go:117] "RemoveContainer" containerID="6669ebfe324d0dbae5805fe08e3758c06b5409f1cb80b0ebd1b15bf7a6f49eca"
Jul 20 19:15:41.412746 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:41.412722    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5ddb13d-dae2-4202-91fe-90cafe691110" containerID="ad51b9b3feef2f4cf28c8d156950cae5163e38c25b5e8f297ea64c1d4af88535" exitCode=0
Jul 20 19:15:41.412826 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:41.412759    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5vjc" event={"ID":"c5ddb13d-dae2-4202-91fe-90cafe691110","Type":"ContainerDied","Data":"ad51b9b3feef2f4cf28c8d156950cae5163e38c25b5e8f297ea64c1d4af88535"}
Jul 20 19:15:41.428135 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:41.428112    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:42.152582 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:42.152487    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gwcjd"
Jul 20 19:15:42.153357 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:42.152666    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 19:15:42.153357 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:42.153157    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gwcjd"
Jul 20 19:15:42.234475 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:42.234442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:42.260573 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:42.260545    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:42.260573 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:42.260570    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:42.260782 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:42.260545    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:42.260782 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:42.260649    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:42.260782 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:42.260734    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:42.260921 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:42.260837    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:42.418323 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:42.418259    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:15:42.418618 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:42.418584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv" event={"ID":"b4430254-3957-4d90-a9be-9b4760c44565","Type":"ContainerStarted","Data":"67d164469d17b4f6d9c17b037bde332d5f7d09112eefc822f4b6db0fe0709c22"}
Jul 20 19:15:42.418906 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:42.418892    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:42.418979 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:42.418968    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:42.433823 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:42.433800    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:15:42.451926 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:42.451884    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv" podStartSLOduration=9.521224683 podStartE2EDuration="28.451871373s" totalImagesPullingTime="18.93064669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:42.450508865 +0000 UTC m=+28.674136045" watchObservedRunningTime="2026-07-20 19:15:42.451871373 +0000 UTC m=+28.675498551"
Jul 20 19:15:43.160730 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:43.160701    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-knd47"]
Jul 20 19:15:43.161206 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:43.160823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:43.161206 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:43.160951    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:43.161916 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:43.161772    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xcfmn"]
Jul 20 19:15:43.162793 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:43.162105    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:43.164970 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:43.162930    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:43.165935 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:43.165711    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l67tj"]
Jul 20 19:15:43.165935 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:43.165805    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:43.165935 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:43.165893    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:43.422919 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:43.422880    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5ddb13d-dae2-4202-91fe-90cafe691110" containerID="df290f4ba69ac090c442ac76e8f0270c1ee6fc7dbe170f4896fcd720e8685e44" exitCode=0
Jul 20 19:15:43.423207 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:43.422971    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5vjc" event={"ID":"c5ddb13d-dae2-4202-91fe-90cafe691110","Type":"ContainerDied","Data":"df290f4ba69ac090c442ac76e8f0270c1ee6fc7dbe170f4896fcd720e8685e44"}
Jul 20 19:15:44.048922 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:44.048887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:44.486693 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:44.486520    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:44.587635 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:44.587586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:44.917149 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:44.917112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:45.005454 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:45.005413    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:45.083696 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:45.083631    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:45.260684 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:45.260652    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:45.260684 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:45.260682    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:45.260887 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:45.260682    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:45.260887 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:45.260786    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:45.260990 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:45.260914    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:45.260990 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:45.260980    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:45.429024 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:45.428976    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5ddb13d-dae2-4202-91fe-90cafe691110" containerID="69a743169a9098cc40486e0d2b4e82ed7c7ac4a029f6c1231480789d8c2d5d14" exitCode=0
Jul 20 19:15:45.429209 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:45.429052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5vjc" event={"ID":"c5ddb13d-dae2-4202-91fe-90cafe691110","Type":"ContainerDied","Data":"69a743169a9098cc40486e0d2b4e82ed7c7ac4a029f6c1231480789d8c2d5d14"}
Jul 20 19:15:45.556219 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:45.556115    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:45.612299 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:45.612258    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:45.980340 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:45.980303    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:46.035901 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:46.035867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:46.263124 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:46.263044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:46.349364 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:46.349332    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:46.986149 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:46.986123    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tl872_7b874fd5-c689-4333-8dec-c1501ff9086d/dns-node-resolver/0.log"
Jul 20 19:15:47.260356 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:47.260266    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:47.260356 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:47.260308    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:47.260356 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:47.260319    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:47.260599 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:47.260412    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-knd47" podUID="4bb1eb6f-7037-4418-8854-0eb07dc60dd2"
Jul 20 19:15:47.260599 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:47.260577    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l67tj" podUID="b1d98b95-11d0-422d-bccf-6284f813cd9b"
Jul 20 19:15:47.260685 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:47.260665    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcfmn" podUID="2c47c789-0902-479a-9713-a46677075564"
Jul 20 19:15:47.900398 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:47.900366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs\") pod \"network-metrics-daemon-knd47\" (UID: \"4bb1eb6f-7037-4418-8854-0eb07dc60dd2\") " pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:47.900633 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:47.900507    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:47.900633 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:47.900582    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs podName:4bb1eb6f-7037-4418-8854-0eb07dc60dd2 nodeName:}" failed. No retries permitted until 2026-07-20 19:16:19.900562059 +0000 UTC m=+66.124189223 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs") pod "network-metrics-daemon-knd47" (UID: "4bb1eb6f-7037-4418-8854-0eb07dc60dd2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:15:47.932542 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:47.932506    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:48.001321 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:48.001293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:48.001779 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:48.001416    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:48.001779 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:48.001468    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret podName:b1d98b95-11d0-422d-bccf-6284f813cd9b nodeName:}" failed. No retries permitted until 2026-07-20 19:16:20.001453271 +0000 UTC m=+66.225080431 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret") pod "global-pull-secret-syncer-l67tj" (UID: "b1d98b95-11d0-422d-bccf-6284f813cd9b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:15:48.035648 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:48.035611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:48.102129 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:48.102035    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6np4\" (UniqueName: \"kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4\") pod \"network-check-target-xcfmn\" (UID: \"2c47c789-0902-479a-9713-a46677075564\") " pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:48.102331 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:48.102232    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:15:48.102331 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:48.102253    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:15:48.102331 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:48.102264    2581 projected.go:196] Error preparing data for projected volume kube-api-access-b6np4 for pod openshift-network-diagnostics/network-check-target-xcfmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:48.102331 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:15:48.102322    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4 podName:2c47c789-0902-479a-9713-a46677075564 nodeName:}" failed. No retries permitted until 2026-07-20 19:16:20.102302615 +0000 UTC m=+66.325929780 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6np4" (UniqueName: "kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4") pod "network-check-target-xcfmn" (UID: "2c47c789-0902-479a-9713-a46677075564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:15:48.186600 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:48.186529    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mb7g9_b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8/node-ca/0.log"
Jul 20 19:15:48.466899 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:48.466808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:48.565445 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:48.565401    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:48.589134 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:48.589093    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-43.ec2.internal" event="NodeReady"
Jul 20 19:15:48.589313 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:48.589274    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 19:15:48.880306 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:48.880240    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:49.162179 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.162078    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:49.260519 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.260484    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:15:49.260667 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.260529    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:15:49.260667 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.260538    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:15:49.265103 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.265084    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 19:15:49.265254 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.265108    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nkhbx\""
Jul 20 19:15:49.265254 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.265142    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vxxp2\""
Jul 20 19:15:49.265254 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.265152    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 19:15:49.265394 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.265297    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 19:15:49.265493 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.265478    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 19:15:49.316227 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.316179    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:49.420802 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.420728    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:49.521804 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.521772    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:49.938393 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:49.938286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:50.097469 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:50.097421    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:50.446265 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:50.446232    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5ddb13d-dae2-4202-91fe-90cafe691110" containerID="e56a226e595c1a48fb17bf0179af28db28bb662d3d675e16bc8d624e99811d25" exitCode=0
Jul 20 19:15:50.446663 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:50.446270    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5vjc" event={"ID":"c5ddb13d-dae2-4202-91fe-90cafe691110","Type":"ContainerDied","Data":"e56a226e595c1a48fb17bf0179af28db28bb662d3d675e16bc8d624e99811d25"}
Jul 20 19:15:50.615842 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:50.615811    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:51.213407 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:51.213373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:51.412998 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:51.412959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:51.451101 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:51.451071    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5ddb13d-dae2-4202-91fe-90cafe691110" containerID="eeaa07ed5b4a245e6122f83c3d52444fb16d55445706dd9c40d3e8ab436c0c67" exitCode=0
Jul 20 19:15:51.451688 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:51.451144    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5vjc" event={"ID":"c5ddb13d-dae2-4202-91fe-90cafe691110","Type":"ContainerDied","Data":"eeaa07ed5b4a245e6122f83c3d52444fb16d55445706dd9c40d3e8ab436c0c67"}
Jul 20 19:15:51.614920 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:51.614752    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:52.011945 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:52.011908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:52.456888 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:52.456859    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5vjc" event={"ID":"c5ddb13d-dae2-4202-91fe-90cafe691110","Type":"ContainerStarted","Data":"ae12d0e4a906750b500fe2cdbaa8581f52f2a2b40e5a0320cb3a42df19dade35"}
Jul 20 19:15:52.483298 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:52.483239    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h5vjc" podStartSLOduration=8.388143284 podStartE2EDuration="38.483217964s" totalImagesPullingTime="30.09507468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:15:52.481906571 +0000 UTC m=+38.705533749" watchObservedRunningTime="2026-07-20 19:15:52.483217964 +0000 UTC m=+38.706845158"
Jul 20 19:15:52.605936 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:52.605908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:52.811417 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:52.811379    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:53.080828 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:53.080797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:53.155697 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:53.155653    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:53.258381 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:53.258346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:53.601285 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:53.601259    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:53.701272 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:53.701239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:54.206582 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:54.206553    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:54.656117 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:54.656080    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:54.757406 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:54.757380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:54.860347 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:54.860321    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:54.958174 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:54.958102    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:55.411675 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:55.411638    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:55.995032 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:55.995003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:56.199202 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:56.199149    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:56.352905 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:56.352874    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:56.503957 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:56.503921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:56.623059 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:56.622971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:56.731757 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:56.731731    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:56.906057 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:56.905974    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:57.057163 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:57.057129    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:57.310404 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:57.310313    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:57.414331 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:57.414290    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:57.513818 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:57.513773    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:57.612234 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:57.612200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:57.888199 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:57.888109    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:58.006815 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:58.006783    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:58.107219 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:58.107163    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:58.207566 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:58.207487    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:58.398992 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:58.398963    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:58.613668 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:58.613642    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:59.279801 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:59.279766    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:59.386079 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:59.386051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:59.481953 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:59.481916    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:59.612104 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:59.612067    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:15:59.808565 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:15:59.808531    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:00.197667 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:00.197632    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:00.467962 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:00.467872    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:01.634081 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:01.634050    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:01.707164 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:01.707130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:09.457100 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.457065    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79dc665d59-2zgtr"]
Jul 20 19:16:09.481447 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.481415    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-2pp2d"]
Jul 20 19:16:09.481612 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.481523    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.484858 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.484821    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f54s5\""
Jul 20 19:16:09.484984 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.484900    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 19:16:09.485118 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.485100    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 19:16:09.485236 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.485218    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 19:16:09.497620 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.497595    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c565c4898-wshpm"]
Jul 20 19:16:09.497752 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.497601    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-2pp2d"
Jul 20 19:16:09.500709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.500685    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 19:16:09.501233 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.501212    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 19:16:09.503560 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.503538    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-plvgs\""
Jul 20 19:16:09.509873 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.509851    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 19:16:09.510936 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.510914    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79dc665d59-2zgtr"]
Jul 20 19:16:09.511045 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.511009    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.514707 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.514690    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 19:16:09.514981 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.514967    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 19:16:09.515052 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.515025    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 19:16:09.515267 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.515251    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 19:16:09.515343 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.515286    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2zkc2\""
Jul 20 19:16:09.515493 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.515479    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 19:16:09.519361 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.519339    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-2pp2d"]
Jul 20 19:16:09.535016 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.534988    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79dc665d59-2zgtr"]
Jul 20 19:16:09.535326 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:16:09.535300    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-pszlr registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-pszlr registry-certificates registry-tls trusted-ca]: context canceled" pod="openshift-image-registry/image-registry-79dc665d59-2zgtr" podUID="afcc8cf3-8afd-44fd-ad7f-455c0838ddbf"
Jul 20 19:16:09.537461 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.537438    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c565c4898-wshpm"]
Jul 20 19:16:09.555061 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-registry-certificates\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.555061 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-bound-sa-token\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.555286 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzkk2\" (UniqueName: \"kubernetes.io/projected/ede9f43b-32a6-4be2-8ce8-33dc87dc1760-kube-api-access-mzkk2\") pod \"downloads-5bc67dcd46-2pp2d\" (UID: \"ede9f43b-32a6-4be2-8ce8-33dc87dc1760\") " pod="openshift-console/downloads-5bc67dcd46-2pp2d"
Jul 20 19:16:09.555286 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-registry-tls\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.555286 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-console-config\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.555286 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555222    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da0f5591-ac78-48ad-b8c7-c09425936da3-console-oauth-config\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.555286 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dbnq\" (UniqueName: \"kubernetes.io/projected/da0f5591-ac78-48ad-b8c7-c09425936da3-kube-api-access-9dbnq\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.555286 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555263    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-service-ca\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.555491 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555294    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-oauth-serving-cert\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.555491 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555378    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-ca-trust-extracted\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.555491 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-trusted-ca\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.555491 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-image-registry-private-configuration\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.555491 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-installation-pull-secrets\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.555491 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555470    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da0f5591-ac78-48ad-b8c7-c09425936da3-console-serving-cert\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.555691 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.555513    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pszlr\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-kube-api-access-pszlr\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.602720 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.602684    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8zss7"]
Jul 20 19:16:09.614224 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.614178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:09.627046 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.627017    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4kbnh"]
Jul 20 19:16:09.627239 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.627111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8zss7"
Jul 20 19:16:09.630544 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.630521    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tf5d7\""
Jul 20 19:16:09.632370 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.632343    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 19:16:09.632476 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.632388    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 19:16:09.632476 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.632437    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 19:16:09.647165 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.647134    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8zss7"]
Jul 20 19:16:09.647320 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.647286    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.651001 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.650979    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 19:16:09.651441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.651417    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 19:16:09.651571 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.651443    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vxtng\""
Jul 20 19:16:09.651750 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.651735    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 19:16:09.652113 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.652093    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 19:16:09.652817 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.652796    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4kbnh"]
Jul 20 19:16:09.656113 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-registry-tls\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.656253 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-console-config\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.656253 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da0f5591-ac78-48ad-b8c7-c09425936da3-console-oauth-config\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.656253 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dbnq\" (UniqueName: \"kubernetes.io/projected/da0f5591-ac78-48ad-b8c7-c09425936da3-kube-api-access-9dbnq\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.656253 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-service-ca\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.656253 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-oauth-serving-cert\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.656253 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656256    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a334e128-8982-4c51-890c-007e171f8c6e-crio-socket\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.656628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dg59\" (UniqueName: \"kubernetes.io/projected/84194694-3e25-4fb9-97f4-39954b7b4467-kube-api-access-6dg59\") pod \"ingress-canary-8zss7\" (UID: \"84194694-3e25-4fb9-97f4-39954b7b4467\") " pod="openshift-ingress-canary/ingress-canary-8zss7"
Jul 20 19:16:09.656628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-ca-trust-extracted\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.656628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-trusted-ca\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.656628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-image-registry-private-configuration\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.656628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a334e128-8982-4c51-890c-007e171f8c6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.656628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-installation-pull-secrets\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.656628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da0f5591-ac78-48ad-b8c7-c09425936da3-console-serving-cert\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.656628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95tkj\" (UniqueName: \"kubernetes.io/projected/a334e128-8982-4c51-890c-007e171f8c6e-kube-api-access-95tkj\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.656628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pszlr\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-kube-api-access-pszlr\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.656628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84194694-3e25-4fb9-97f4-39954b7b4467-cert\") pod \"ingress-canary-8zss7\" (UID: \"84194694-3e25-4fb9-97f4-39954b7b4467\") " pod="openshift-ingress-canary/ingress-canary-8zss7"
Jul 20 19:16:09.656628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-registry-certificates\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.656628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-bound-sa-token\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.657179 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzkk2\" (UniqueName: \"kubernetes.io/projected/ede9f43b-32a6-4be2-8ce8-33dc87dc1760-kube-api-access-mzkk2\") pod \"downloads-5bc67dcd46-2pp2d\" (UID: \"ede9f43b-32a6-4be2-8ce8-33dc87dc1760\") " pod="openshift-console/downloads-5bc67dcd46-2pp2d"
Jul 20 19:16:09.657179 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656664    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a334e128-8982-4c51-890c-007e171f8c6e-data-volume\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.657179 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.656686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a334e128-8982-4c51-890c-007e171f8c6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.657179 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.657047    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-ca-trust-extracted\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.657179 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.657143    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-oauth-serving-cert\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.657179 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.657151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-console-config\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.657179 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.657144    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-service-ca\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.657928 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.657904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-trusted-ca\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.658201 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.658162    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-registry-certificates\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.660866 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.660844    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-installation-pull-secrets\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.660948 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.660852    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da0f5591-ac78-48ad-b8c7-c09425936da3-console-oauth-config\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.660987 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.660946    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-image-registry-private-configuration\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.661024 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.660984    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-registry-tls\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.661154 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.661137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da0f5591-ac78-48ad-b8c7-c09425936da3-console-serving-cert\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.686961 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.686918    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d6c89bd89-nb7qk"]
Jul 20 19:16:09.694815 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.694787    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dbnq\" (UniqueName: \"kubernetes.io/projected/da0f5591-ac78-48ad-b8c7-c09425936da3-kube-api-access-9dbnq\") pod \"console-5c565c4898-wshpm\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") " pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.704339 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.704309    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-bound-sa-token\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.704481 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.704460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pszlr\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-kube-api-access-pszlr\") pod \"image-registry-79dc665d59-2zgtr\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") " pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:09.704558 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.704539    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzkk2\" (UniqueName: \"kubernetes.io/projected/ede9f43b-32a6-4be2-8ce8-33dc87dc1760-kube-api-access-mzkk2\") pod \"downloads-5bc67dcd46-2pp2d\" (UID: \"ede9f43b-32a6-4be2-8ce8-33dc87dc1760\") " pod="openshift-console/downloads-5bc67dcd46-2pp2d"
Jul 20 19:16:09.717648 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.717588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.731380 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.731346    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d6c89bd89-nb7qk"]
Jul 20 19:16:09.757423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19ba474b-7ca5-4f03-a6a6-b763a9921078-ca-trust-extracted\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.757423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757426    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a334e128-8982-4c51-890c-007e171f8c6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.757677 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a334e128-8982-4c51-890c-007e171f8c6e-data-volume\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.757677 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19ba474b-7ca5-4f03-a6a6-b763a9921078-bound-sa-token\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.757677 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19ba474b-7ca5-4f03-a6a6-b763a9921078-trusted-ca\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.757677 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19ba474b-7ca5-4f03-a6a6-b763a9921078-registry-certificates\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.757677 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19ba474b-7ca5-4f03-a6a6-b763a9921078-installation-pull-secrets\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.757677 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a334e128-8982-4c51-890c-007e171f8c6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.757677 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95tkj\" (UniqueName: \"kubernetes.io/projected/a334e128-8982-4c51-890c-007e171f8c6e-kube-api-access-95tkj\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.758004 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kg7d\" (UniqueName: \"kubernetes.io/projected/19ba474b-7ca5-4f03-a6a6-b763a9921078-kube-api-access-6kg7d\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.758004 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dg59\" (UniqueName: \"kubernetes.io/projected/84194694-3e25-4fb9-97f4-39954b7b4467-kube-api-access-6dg59\") pod \"ingress-canary-8zss7\" (UID: \"84194694-3e25-4fb9-97f4-39954b7b4467\") " pod="openshift-ingress-canary/ingress-canary-8zss7"
Jul 20 19:16:09.758004 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a334e128-8982-4c51-890c-007e171f8c6e-crio-socket\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.758004 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19ba474b-7ca5-4f03-a6a6-b763a9921078-registry-tls\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.758004 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a334e128-8982-4c51-890c-007e171f8c6e-crio-socket\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.758004 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19ba474b-7ca5-4f03-a6a6-b763a9921078-image-registry-private-configuration\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.758004 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757912    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a334e128-8982-4c51-890c-007e171f8c6e-data-volume\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.758004 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.757937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84194694-3e25-4fb9-97f4-39954b7b4467-cert\") pod \"ingress-canary-8zss7\" (UID: \"84194694-3e25-4fb9-97f4-39954b7b4467\") " pod="openshift-ingress-canary/ingress-canary-8zss7"
Jul 20 19:16:09.758310 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.758077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a334e128-8982-4c51-890c-007e171f8c6e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.760148 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.760125    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a334e128-8982-4c51-890c-007e171f8c6e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.760282 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.760237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84194694-3e25-4fb9-97f4-39954b7b4467-cert\") pod \"ingress-canary-8zss7\" (UID: \"84194694-3e25-4fb9-97f4-39954b7b4467\") " pod="openshift-ingress-canary/ingress-canary-8zss7"
Jul 20 19:16:09.782480 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.782452    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dg59\" (UniqueName: \"kubernetes.io/projected/84194694-3e25-4fb9-97f4-39954b7b4467-kube-api-access-6dg59\") pod \"ingress-canary-8zss7\" (UID: \"84194694-3e25-4fb9-97f4-39954b7b4467\") " pod="openshift-ingress-canary/ingress-canary-8zss7"
Jul 20 19:16:09.787643 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.787621    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gdb6x"]
Jul 20 19:16:09.790837 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.790814    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95tkj\" (UniqueName: \"kubernetes.io/projected/a334e128-8982-4c51-890c-007e171f8c6e-kube-api-access-95tkj\") pod \"insights-runtime-extractor-4kbnh\" (UID: \"a334e128-8982-4c51-890c-007e171f8c6e\") " pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.800097 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.800071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:09.806494 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.806470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-2pp2d"
Jul 20 19:16:09.812682 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.812652    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gdb6x"]
Jul 20 19:16:09.812838 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.812766    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:09.816430 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.816405    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 19:16:09.816579 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.816524    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bcdr2\""
Jul 20 19:16:09.816963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.816948    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 19:16:09.820025 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.820005    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:09.858779 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.858749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19ba474b-7ca5-4f03-a6a6-b763a9921078-trusted-ca\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.858954 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.858790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19ba474b-7ca5-4f03-a6a6-b763a9921078-registry-certificates\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.858954 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.858818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19ba474b-7ca5-4f03-a6a6-b763a9921078-installation-pull-secrets\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.858954 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.858863    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fhzm\" (UniqueName: \"kubernetes.io/projected/89836d7f-263d-4464-b3dd-adb73febcdb1-kube-api-access-7fhzm\") pod \"dns-default-gdb6x\" (UID: \"89836d7f-263d-4464-b3dd-adb73febcdb1\") " pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:09.858954 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.858890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kg7d\" (UniqueName: \"kubernetes.io/projected/19ba474b-7ca5-4f03-a6a6-b763a9921078-kube-api-access-6kg7d\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.858954 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.858916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89836d7f-263d-4464-b3dd-adb73febcdb1-metrics-tls\") pod \"dns-default-gdb6x\" (UID: \"89836d7f-263d-4464-b3dd-adb73febcdb1\") " pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:09.859252 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.859170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19ba474b-7ca5-4f03-a6a6-b763a9921078-registry-tls\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.859310 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.859262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19ba474b-7ca5-4f03-a6a6-b763a9921078-image-registry-private-configuration\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.859360 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.859327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89836d7f-263d-4464-b3dd-adb73febcdb1-tmp-dir\") pod \"dns-default-gdb6x\" (UID: \"89836d7f-263d-4464-b3dd-adb73febcdb1\") " pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:09.859411 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.859357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19ba474b-7ca5-4f03-a6a6-b763a9921078-ca-trust-extracted\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.859411 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.859392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89836d7f-263d-4464-b3dd-adb73febcdb1-config-volume\") pod \"dns-default-gdb6x\" (UID: \"89836d7f-263d-4464-b3dd-adb73febcdb1\") " pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:09.859512 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.859418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19ba474b-7ca5-4f03-a6a6-b763a9921078-bound-sa-token\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.860211 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.860168    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19ba474b-7ca5-4f03-a6a6-b763a9921078-ca-trust-extracted\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.860340 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.860171    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19ba474b-7ca5-4f03-a6a6-b763a9921078-registry-certificates\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.860340 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.860180    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19ba474b-7ca5-4f03-a6a6-b763a9921078-trusted-ca\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.862430 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.862403    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19ba474b-7ca5-4f03-a6a6-b763a9921078-registry-tls\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.862826 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.862778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19ba474b-7ca5-4f03-a6a6-b763a9921078-image-registry-private-configuration\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.862929 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.862829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19ba474b-7ca5-4f03-a6a6-b763a9921078-installation-pull-secrets\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.873317 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.873289    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19ba474b-7ca5-4f03-a6a6-b763a9921078-bound-sa-token\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.873457 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.873399    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kg7d\" (UniqueName: \"kubernetes.io/projected/19ba474b-7ca5-4f03-a6a6-b763a9921078-kube-api-access-6kg7d\") pod \"image-registry-d6c89bd89-nb7qk\" (UID: \"19ba474b-7ca5-4f03-a6a6-b763a9921078\") " pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:09.906352 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.906306    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:09.935457 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.935419    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8zss7"
Jul 20 19:16:09.956740 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.956704    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4kbnh"
Jul 20 19:16:09.960662 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.960634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89836d7f-263d-4464-b3dd-adb73febcdb1-tmp-dir\") pod \"dns-default-gdb6x\" (UID: \"89836d7f-263d-4464-b3dd-adb73febcdb1\") " pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:09.960789 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.960681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89836d7f-263d-4464-b3dd-adb73febcdb1-config-volume\") pod \"dns-default-gdb6x\" (UID: \"89836d7f-263d-4464-b3dd-adb73febcdb1\") " pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:09.960789 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.960740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fhzm\" (UniqueName: \"kubernetes.io/projected/89836d7f-263d-4464-b3dd-adb73febcdb1-kube-api-access-7fhzm\") pod \"dns-default-gdb6x\" (UID: \"89836d7f-263d-4464-b3dd-adb73febcdb1\") " pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:09.960789 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.960774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89836d7f-263d-4464-b3dd-adb73febcdb1-metrics-tls\") pod \"dns-default-gdb6x\" (UID: \"89836d7f-263d-4464-b3dd-adb73febcdb1\") " pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:09.961021 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.961002    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89836d7f-263d-4464-b3dd-adb73febcdb1-tmp-dir\") pod \"dns-default-gdb6x\" (UID: \"89836d7f-263d-4464-b3dd-adb73febcdb1\") " pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:09.961493 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.961468    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89836d7f-263d-4464-b3dd-adb73febcdb1-config-volume\") pod \"dns-default-gdb6x\" (UID: \"89836d7f-263d-4464-b3dd-adb73febcdb1\") " pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:09.963312 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.963287    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89836d7f-263d-4464-b3dd-adb73febcdb1-metrics-tls\") pod \"dns-default-gdb6x\" (UID: \"89836d7f-263d-4464-b3dd-adb73febcdb1\") " pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:09.972715 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:09.972647    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fhzm\" (UniqueName: \"kubernetes.io/projected/89836d7f-263d-4464-b3dd-adb73febcdb1-kube-api-access-7fhzm\") pod \"dns-default-gdb6x\" (UID: \"89836d7f-263d-4464-b3dd-adb73febcdb1\") " pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:10.002658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.002614    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:10.033352 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.032903    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-2pp2d"]
Jul 20 19:16:10.033352 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.033110    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:10.038077 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.037994    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c565c4898-wshpm"]
Jul 20 19:16:10.059390 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:16:10.059206    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede9f43b_32a6_4be2_8ce8_33dc87dc1760.slice/crio-3d02f614cfa92d15a4612ca924db41eeb95f3343654fb6a724d1085db2ef84be WatchSource:0}: Error finding container 3d02f614cfa92d15a4612ca924db41eeb95f3343654fb6a724d1085db2ef84be: Status 404 returned error can't find the container with id 3d02f614cfa92d15a4612ca924db41eeb95f3343654fb6a724d1085db2ef84be
Jul 20 19:16:10.121405 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.121277    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8zss7"]
Jul 20 19:16:10.121537 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.121520    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:10.164214 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.164154    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4kbnh"]
Jul 20 19:16:10.168542 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:16:10.168509    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda334e128_8982_4c51_890c_007e171f8c6e.slice/crio-403ae9e26d6de09b3c7f09b9221c2789cf339c39043cc6cc9ec1e3b8a7d9bf40 WatchSource:0}: Error finding container 403ae9e26d6de09b3c7f09b9221c2789cf339c39043cc6cc9ec1e3b8a7d9bf40: Status 404 returned error can't find the container with id 403ae9e26d6de09b3c7f09b9221c2789cf339c39043cc6cc9ec1e3b8a7d9bf40
Jul 20 19:16:10.211308 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.211237    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d6c89bd89-nb7qk"]
Jul 20 19:16:10.214843 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:16:10.214804    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ba474b_7ca5_4f03_a6a6_b763a9921078.slice/crio-4564527a876e6ad55d11990ff9ebe3eac97ee2d6a9d1af5a6c51456c9280694e WatchSource:0}: Error finding container 4564527a876e6ad55d11990ff9ebe3eac97ee2d6a9d1af5a6c51456c9280694e: Status 404 returned error can't find the container with id 4564527a876e6ad55d11990ff9ebe3eac97ee2d6a9d1af5a6c51456c9280694e
Jul 20 19:16:10.270555 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.270527    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:10.274327 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.274299    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gdb6x"]
Jul 20 19:16:10.279266 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:16:10.279239    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89836d7f_263d_4464_b3dd_adb73febcdb1.slice/crio-6d93cc68e16a3e84ee395cfe295268bc2f2a763e5759d7966cef64b6a013f417 WatchSource:0}: Error finding container 6d93cc68e16a3e84ee395cfe295268bc2f2a763e5759d7966cef64b6a013f417: Status 404 returned error can't find the container with id 6d93cc68e16a3e84ee395cfe295268bc2f2a763e5759d7966cef64b6a013f417
Jul 20 19:16:10.400256 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.400221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:10.498236 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.498124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8zss7" event={"ID":"84194694-3e25-4fb9-97f4-39954b7b4467","Type":"ContainerStarted","Data":"f301b45cc478fd9687d5908f8d26c459be493458b2faa643f0266772f579f250"}
Jul 20 19:16:10.499420 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.499382    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gdb6x" event={"ID":"89836d7f-263d-4464-b3dd-adb73febcdb1","Type":"ContainerStarted","Data":"6d93cc68e16a3e84ee395cfe295268bc2f2a763e5759d7966cef64b6a013f417"}
Jul 20 19:16:10.500563 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.500537    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kbnh" event={"ID":"a334e128-8982-4c51-890c-007e171f8c6e","Type":"ContainerStarted","Data":"403ae9e26d6de09b3c7f09b9221c2789cf339c39043cc6cc9ec1e3b8a7d9bf40"}
Jul 20 19:16:10.501759 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.501735    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-2pp2d" event={"ID":"ede9f43b-32a6-4be2-8ce8-33dc87dc1760","Type":"ContainerStarted","Data":"3d02f614cfa92d15a4612ca924db41eeb95f3343654fb6a724d1085db2ef84be"}
Jul 20 19:16:10.503010 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.502986    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c565c4898-wshpm" event={"ID":"da0f5591-ac78-48ad-b8c7-c09425936da3","Type":"ContainerStarted","Data":"b44d2cb81f01dc3e91035f70978a122f0bb46158b0292c248e8827651583f623"}
Jul 20 19:16:10.504577 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.504549    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk" event={"ID":"19ba474b-7ca5-4f03-a6a6-b763a9921078","Type":"ContainerStarted","Data":"722e4f6f069ddab6c368467b1bf280be21459f5f9c3697f27c785fdd470196a9"}
Jul 20 19:16:10.504577 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.504569    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:10.504711 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.504586    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk" event={"ID":"19ba474b-7ca5-4f03-a6a6-b763a9921078","Type":"ContainerStarted","Data":"4564527a876e6ad55d11990ff9ebe3eac97ee2d6a9d1af5a6c51456c9280694e"}
Jul 20 19:16:10.512540 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.512512    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:10.567341 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.567305    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-trusted-ca\") pod \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") "
Jul 20 19:16:10.567524 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.567415    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-installation-pull-secrets\") pod \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") "
Jul 20 19:16:10.567588 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.567547    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pszlr\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-kube-api-access-pszlr\") pod \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") "
Jul 20 19:16:10.567588 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.567576    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-bound-sa-token\") pod \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") "
Jul 20 19:16:10.567693 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.567620    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-ca-trust-extracted\") pod \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") "
Jul 20 19:16:10.567693 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.567651    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-registry-certificates\") pod \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") "
Jul 20 19:16:10.567693 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.567679    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-image-registry-private-configuration\") pod \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") "
Jul 20 19:16:10.567819 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.567724    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-registry-tls\") pod \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\" (UID: \"afcc8cf3-8afd-44fd-ad7f-455c0838ddbf\") "
Jul 20 19:16:10.568776 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.568698    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf" (UID: "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:16:10.568928 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.568792    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf" (UID: "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:16:10.569459 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.569433    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf" (UID: "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:16:10.572147 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.572104    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf" (UID: "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:16:10.572147 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.572127    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf" (UID: "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:16:10.574003 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.573962    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk" podStartSLOduration=1.573945944 podStartE2EDuration="1.573945944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:10.573130934 +0000 UTC m=+56.796758145" watchObservedRunningTime="2026-07-20 19:16:10.573945944 +0000 UTC m=+56.797573126"
Jul 20 19:16:10.581469 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.581419    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf" (UID: "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:16:10.582157 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.582120    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-kube-api-access-pszlr" (OuterVolumeSpecName: "kube-api-access-pszlr") pod "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf" (UID: "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf"). InnerVolumeSpecName "kube-api-access-pszlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:16:10.582746 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.582712    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf" (UID: "afcc8cf3-8afd-44fd-ad7f-455c0838ddbf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:16:10.668900 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.668840    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-ca-trust-extracted\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:16:10.668900 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.668881    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-registry-certificates\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:16:10.668900 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.668898    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-image-registry-private-configuration\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:16:10.669276 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.668915    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-registry-tls\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:16:10.669276 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.668929    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-trusted-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:16:10.669276 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.668942    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-installation-pull-secrets\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:16:10.669276 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.668958    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pszlr\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-kube-api-access-pszlr\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:16:10.669276 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:10.668974    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf-bound-sa-token\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:16:11.508820 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:11.508786    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79dc665d59-2zgtr"
Jul 20 19:16:11.512589 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:11.512563    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:11.550980 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:11.550914    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79dc665d59-2zgtr"]
Jul 20 19:16:11.554634 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:11.554538    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79dc665d59-2zgtr"]
Jul 20 19:16:11.902954 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:11.902884    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:11.965917 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:11.965859    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:12.265155 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:12.265077    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afcc8cf3-8afd-44fd-ad7f-455c0838ddbf" path="/var/lib/kubelet/pods/afcc8cf3-8afd-44fd-ad7f-455c0838ddbf/volumes"
Jul 20 19:16:14.290172 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:14.290139    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:14.449488 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:14.449458    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-njbnv"
Jul 20 19:16:14.579339 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:14.579284    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:14.641392 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:14.641354    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:14.741131 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:14.741090    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:14.852362 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:14.852274    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:14.952266 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:14.952221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:15.028642 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:15.028569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:15.143255 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:15.143156    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:15.672162 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:15.672064    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:15.772820 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:15.772788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:18.142222 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:18.141944    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:18.237753 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:18.237720    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:18.337928 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:18.337860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:18.541633 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:18.541519    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kbnh" event={"ID":"a334e128-8982-4c51-890c-007e171f8c6e","Type":"ContainerStarted","Data":"095914fa8637664a02a1e0c4d63b3817462077361b290f249ba1397cdda63cc8"}
Jul 20 19:16:18.546796 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:18.546052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c565c4898-wshpm" event={"ID":"da0f5591-ac78-48ad-b8c7-c09425936da3","Type":"ContainerStarted","Data":"a1ca1d82d3400fb85c6acc6bcf60aa116c30a28521e9fda415ebef18c9677b42"}
Jul 20 19:16:18.550447 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:18.550405    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8zss7" event={"ID":"84194694-3e25-4fb9-97f4-39954b7b4467","Type":"ContainerStarted","Data":"25931bbbfa49b135e7c234e6592bd61da661cf84a848997e1408371306147594"}
Jul 20 19:16:18.553779 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:18.553733    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gdb6x" event={"ID":"89836d7f-263d-4464-b3dd-adb73febcdb1","Type":"ContainerStarted","Data":"87f8e687a8611a03c4c7c9197ed93ac249d346e919f41edbdfc33a2ed63b8c0d"}
Jul 20 19:16:18.589404 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:18.589331    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c565c4898-wshpm" podStartSLOduration=1.268260476 podStartE2EDuration="9.589306583s" totalImagesPullingTime="8.321046107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:18.56988708 +0000 UTC m=+64.793514252" watchObservedRunningTime="2026-07-20 19:16:18.589306583 +0000 UTC m=+64.812933773"
Jul 20 19:16:18.589565 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:18.589476    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8zss7" podStartSLOduration=1.338075438 podStartE2EDuration="9.589465172s" totalImagesPullingTime="8.251389734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:18.588427553 +0000 UTC m=+64.812054743" watchObservedRunningTime="2026-07-20 19:16:18.589465172 +0000 UTC m=+64.813092364"
Jul 20 19:16:19.560003 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:19.559924    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gdb6x" event={"ID":"89836d7f-263d-4464-b3dd-adb73febcdb1","Type":"ContainerStarted","Data":"476daf9e2b35e71faa483db916cc32ab9cbcf38c6c71bdad2d03a1ce25a77e2f"}
Jul 20 19:16:19.584283 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:19.584223    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gdb6x" podStartSLOduration=2.488358489 podStartE2EDuration="10.58420668s" totalImagesPullingTime="8.095848191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:19.583380865 +0000 UTC m=+65.807008046" watchObservedRunningTime="2026-07-20 19:16:19.58420668 +0000 UTC m=+65.807833851"
Jul 20 19:16:19.821238 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:19.821129    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:19.821238 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:19.821223    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:19.822769 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:19.822739    2581 patch_prober.go:28] interesting pod/console-5c565c4898-wshpm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.8:8443/health\": dial tcp 10.133.0.8:8443: connect: connection refused" start-of-body=
Jul 20 19:16:19.822870 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:19.822797    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5c565c4898-wshpm" podUID="da0f5591-ac78-48ad-b8c7-c09425936da3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.8:8443/health\": dial tcp 10.133.0.8:8443: connect: connection refused"
Jul 20 19:16:19.964606 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:19.964566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs\") pod \"network-metrics-daemon-knd47\" (UID: \"4bb1eb6f-7037-4418-8854-0eb07dc60dd2\") " pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:16:19.969538 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:19.969510    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 19:16:19.977700 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:19.977647    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb1eb6f-7037-4418-8854-0eb07dc60dd2-metrics-certs\") pod \"network-metrics-daemon-knd47\" (UID: \"4bb1eb6f-7037-4418-8854-0eb07dc60dd2\") " pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:16:20.062557 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.062515    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:20.065116 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.065092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:16:20.067887 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.067867    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 19:16:20.078894 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.078863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1d98b95-11d0-422d-bccf-6284f813cd9b-original-pull-secret\") pod \"global-pull-secret-syncer-l67tj\" (UID: \"b1d98b95-11d0-422d-bccf-6284f813cd9b\") " pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:16:20.159826 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.159786    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:20.165810 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.165780    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6np4\" (UniqueName: \"kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4\") pod \"network-check-target-xcfmn\" (UID: \"2c47c789-0902-479a-9713-a46677075564\") " pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:16:20.168736 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.168708    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 19:16:20.175473 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.175439    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nkhbx\""
Jul 20 19:16:20.178650 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.178618    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 19:16:20.178860 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.178837    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l67tj"
Jul 20 19:16:20.183547 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.183517    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-knd47"
Jul 20 19:16:20.189953 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.189924    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6np4\" (UniqueName: \"kubernetes.io/projected/2c47c789-0902-479a-9713-a46677075564-kube-api-access-b6np4\") pod \"network-check-target-xcfmn\" (UID: \"2c47c789-0902-479a-9713-a46677075564\") " pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:16:20.270148 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.270107    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:20.487821 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.487734    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vxxp2\""
Jul 20 19:16:20.496074 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.496041    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:16:20.564546 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:20.564514    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:21.232903 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:21.232862    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:23.668213 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:23.668148    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:24.320978 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:24.320933    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:24.396559 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:24.396522    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:26.213655 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.213605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:26.431655 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.431619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:26.464082 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.464007    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"]
Jul 20 19:16:26.467107 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.467082    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.471012 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.470991    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 20 19:16:26.471316 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.471301    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 19:16:26.471956 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.471925    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 20 19:16:26.471956 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.471935    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 19:16:26.472093 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.471982    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 19:16:26.472863 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.472846    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wjgzt\""
Jul 20 19:16:26.481357 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.481295    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"]
Jul 20 19:16:26.495532 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.495501    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xb9s8"]
Jul 20 19:16:26.497772 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.497736    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.500303 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.500251    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 19:16:26.500303 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.500261    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 19:16:26.500728 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.500575    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4x4qd\""
Jul 20 19:16:26.500728 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.500642    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 19:16:26.533333 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.533284    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:26.615909 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.615876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-textfile\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.616095 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.615930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4502df8c-6ebb-42e2-b2b8-4547b268c103-sys\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.616095 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.615950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-wtmp\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.616095 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.615971    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6875ac4a-cad6-4a63-828f-e13e42521ece-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-mmjjn\" (UID: \"6875ac4a-cad6-4a63-828f-e13e42521ece\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.616095 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.615998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4502df8c-6ebb-42e2-b2b8-4547b268c103-metrics-client-ca\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.616355 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.616098    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6875ac4a-cad6-4a63-828f-e13e42521ece-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-mmjjn\" (UID: \"6875ac4a-cad6-4a63-828f-e13e42521ece\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.616355 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.616125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.616355 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.616144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58bpq\" (UniqueName: \"kubernetes.io/projected/4502df8c-6ebb-42e2-b2b8-4547b268c103-kube-api-access-58bpq\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.616355 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.616173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbdch\" (UniqueName: \"kubernetes.io/projected/6875ac4a-cad6-4a63-828f-e13e42521ece-kube-api-access-bbdch\") pod \"openshift-state-metrics-79f6958cdf-mmjjn\" (UID: \"6875ac4a-cad6-4a63-828f-e13e42521ece\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.616355 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.616269    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-tls\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.616355 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.616301    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4502df8c-6ebb-42e2-b2b8-4547b268c103-root\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.616355 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.616324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6875ac4a-cad6-4a63-828f-e13e42521ece-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-mmjjn\" (UID: \"6875ac4a-cad6-4a63-828f-e13e42521ece\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.616355 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.616343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-accelerators-collector-config\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.639400 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.639364    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:26.717633 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.717544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4502df8c-6ebb-42e2-b2b8-4547b268c103-metrics-client-ca\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.717633 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.717588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6875ac4a-cad6-4a63-828f-e13e42521ece-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-mmjjn\" (UID: \"6875ac4a-cad6-4a63-828f-e13e42521ece\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.717633 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.717616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.717633 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.717632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58bpq\" (UniqueName: \"kubernetes.io/projected/4502df8c-6ebb-42e2-b2b8-4547b268c103-kube-api-access-58bpq\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.717951 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.717656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbdch\" (UniqueName: \"kubernetes.io/projected/6875ac4a-cad6-4a63-828f-e13e42521ece-kube-api-access-bbdch\") pod \"openshift-state-metrics-79f6958cdf-mmjjn\" (UID: \"6875ac4a-cad6-4a63-828f-e13e42521ece\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.717951 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.717691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-tls\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.717951 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.717724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4502df8c-6ebb-42e2-b2b8-4547b268c103-root\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.717951 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.717747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6875ac4a-cad6-4a63-828f-e13e42521ece-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-mmjjn\" (UID: \"6875ac4a-cad6-4a63-828f-e13e42521ece\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.717951 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.717770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-accelerators-collector-config\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.717951 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:16:26.717874    2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 19:16:26.718384 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:16:26.717959    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-tls podName:4502df8c-6ebb-42e2-b2b8-4547b268c103 nodeName:}" failed. No retries permitted until 2026-07-20 19:16:27.217936724 +0000 UTC m=+73.441563888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-tls") pod "node-exporter-xb9s8" (UID: "4502df8c-6ebb-42e2-b2b8-4547b268c103") : secret "node-exporter-tls" not found
Jul 20 19:16:26.718384 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.718175    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4502df8c-6ebb-42e2-b2b8-4547b268c103-metrics-client-ca\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.718384 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.718226    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-textfile\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.718384 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.718280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4502df8c-6ebb-42e2-b2b8-4547b268c103-sys\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.718384 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.718307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-wtmp\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.718384 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.718341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6875ac4a-cad6-4a63-828f-e13e42521ece-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-mmjjn\" (UID: \"6875ac4a-cad6-4a63-828f-e13e42521ece\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.718384 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.718356    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4502df8c-6ebb-42e2-b2b8-4547b268c103-sys\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.718743 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.718488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-textfile\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.718743 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.718499    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-wtmp\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.718743 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.718533    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4502df8c-6ebb-42e2-b2b8-4547b268c103-root\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.718743 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.718596    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-accelerators-collector-config\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.719291 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.719266    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6875ac4a-cad6-4a63-828f-e13e42521ece-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-mmjjn\" (UID: \"6875ac4a-cad6-4a63-828f-e13e42521ece\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.720667 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.720645    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6875ac4a-cad6-4a63-828f-e13e42521ece-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-mmjjn\" (UID: \"6875ac4a-cad6-4a63-828f-e13e42521ece\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.720667 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.720661    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6875ac4a-cad6-4a63-828f-e13e42521ece-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-mmjjn\" (UID: \"6875ac4a-cad6-4a63-828f-e13e42521ece\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.720849 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.720834    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.732631 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.732606    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58bpq\" (UniqueName: \"kubernetes.io/projected/4502df8c-6ebb-42e2-b2b8-4547b268c103-kube-api-access-58bpq\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:26.733632 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.733610    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbdch\" (UniqueName: \"kubernetes.io/projected/6875ac4a-cad6-4a63-828f-e13e42521ece-kube-api-access-bbdch\") pod \"openshift-state-metrics-79f6958cdf-mmjjn\" (UID: \"6875ac4a-cad6-4a63-828f-e13e42521ece\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.742995 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.742969    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:26.778091 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.778060    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"
Jul 20 19:16:26.842011 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.841921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:26.940334 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:26.940307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:27.040640 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:27.040560    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:27.139464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:27.139433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:27.222847 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:27.222816    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-tls\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:27.225530 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:27.225507    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4502df8c-6ebb-42e2-b2b8-4547b268c103-node-exporter-tls\") pod \"node-exporter-xb9s8\" (UID: \"4502df8c-6ebb-42e2-b2b8-4547b268c103\") " pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:27.409569 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:27.409536    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xb9s8"
Jul 20 19:16:27.447487 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:27.447446    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:27.537574 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:27.537541    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:27.681802 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:27.681719    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:29.385446 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:29.385415    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:29.528060 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:29.528027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:29.659356 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:29.659105    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-knd47"]
Jul 20 19:16:29.753753 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:16:29.753723    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb1eb6f_7037_4418_8854_0eb07dc60dd2.slice/crio-3be8dda65958a2f7024a5bbd4cefd82c0bbfabfe07765bda6e8abbe52f8b3fd6 WatchSource:0}: Error finding container 3be8dda65958a2f7024a5bbd4cefd82c0bbfabfe07765bda6e8abbe52f8b3fd6: Status 404 returned error can't find the container with id 3be8dda65958a2f7024a5bbd4cefd82c0bbfabfe07765bda6e8abbe52f8b3fd6
Jul 20 19:16:29.813367 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:16:29.812233    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4502df8c_6ebb_42e2_b2b8_4547b268c103.slice/crio-ab85a0d2c27fc47a364327203897a0e6a9a3b9cb24eedecabfa5faede69ef518 WatchSource:0}: Error finding container ab85a0d2c27fc47a364327203897a0e6a9a3b9cb24eedecabfa5faede69ef518: Status 404 returned error can't find the container with id ab85a0d2c27fc47a364327203897a0e6a9a3b9cb24eedecabfa5faede69ef518
Jul 20 19:16:29.828037 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:29.827771    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:29.828542 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:29.828350    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:29.860785 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:29.860756    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:16:29.907128 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:29.906912    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xcfmn"]
Jul 20 19:16:29.985839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:29.985810    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn"]
Jul 20 19:16:29.994620 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:16:29.994589    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6875ac4a_cad6_4a63_828f_e13e42521ece.slice/crio-d3521937f334ffb4f50805a5b7c48c6f7314b6b5d212f88f980094b5fe8b9899 WatchSource:0}: Error finding container d3521937f334ffb4f50805a5b7c48c6f7314b6b5d212f88f980094b5fe8b9899: Status 404 returned error can't find the container with id d3521937f334ffb4f50805a5b7c48c6f7314b6b5d212f88f980094b5fe8b9899
Jul 20 19:16:30.024369 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.024246    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l67tj"]
Jul 20 19:16:30.029150 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:16:30.029125    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d98b95_11d0_422d_bccf_6284f813cd9b.slice/crio-dab034918d45706d7c758454f55e1aa06ea705c7868dee9809853726adf24188 WatchSource:0}: Error finding container dab034918d45706d7c758454f55e1aa06ea705c7868dee9809853726adf24188: Status 404 returned error can't find the container with id dab034918d45706d7c758454f55e1aa06ea705c7868dee9809853726adf24188
Jul 20 19:16:30.038756 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.038731    2581 patch_prober.go:28] interesting pod/image-registry-d6c89bd89-nb7qk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 20 19:16:30.038834 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.038778    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk" podUID="19ba474b-7ca5-4f03-a6a6-b763a9921078" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 19:16:30.053374 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.053349    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:30.139415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.139388    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:30.570485 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.570405    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gdb6x"
Jul 20 19:16:30.606035 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.605943    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l67tj" event={"ID":"b1d98b95-11d0-422d-bccf-6284f813cd9b","Type":"ContainerStarted","Data":"dab034918d45706d7c758454f55e1aa06ea705c7868dee9809853726adf24188"}
Jul 20 19:16:30.613130 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.613036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xcfmn" event={"ID":"2c47c789-0902-479a-9713-a46677075564","Type":"ContainerStarted","Data":"3a45ead2d9634d1b1ce001ab325eba1217dd26c9f4578df530014a70d5d098f8"}
Jul 20 19:16:30.627669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.621508    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kbnh" event={"ID":"a334e128-8982-4c51-890c-007e171f8c6e","Type":"ContainerStarted","Data":"e429b64a864dc1c6e0709dcefc7ba5a6e6b70025960154861f3918fe85c7426a"}
Jul 20 19:16:30.627669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.626750    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn" event={"ID":"6875ac4a-cad6-4a63-828f-e13e42521ece","Type":"ContainerStarted","Data":"9f20e790b3f928eee9fde8fb4a1024f316aa146b006a3626d87cdcf8d669ed28"}
Jul 20 19:16:30.627669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.626834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn" event={"ID":"6875ac4a-cad6-4a63-828f-e13e42521ece","Type":"ContainerStarted","Data":"3ad2a8f4a5e20f6a00f88c5f984cdf08cf39aa78ca88e2e82a9af982fded3a99"}
Jul 20 19:16:30.627669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.626864    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn" event={"ID":"6875ac4a-cad6-4a63-828f-e13e42521ece","Type":"ContainerStarted","Data":"d3521937f334ffb4f50805a5b7c48c6f7314b6b5d212f88f980094b5fe8b9899"}
Jul 20 19:16:30.632210 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.629731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-2pp2d" event={"ID":"ede9f43b-32a6-4be2-8ce8-33dc87dc1760","Type":"ContainerStarted","Data":"940ad7d33497eb79700f5c7970b7152f7317eb7713aef30e9c3d8e91165fc754"}
Jul 20 19:16:30.632210 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.630774    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-2pp2d"
Jul 20 19:16:30.633053 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.633023    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xb9s8" event={"ID":"4502df8c-6ebb-42e2-b2b8-4547b268c103","Type":"ContainerStarted","Data":"ab85a0d2c27fc47a364327203897a0e6a9a3b9cb24eedecabfa5faede69ef518"}
Jul 20 19:16:30.637479 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.637415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-knd47" event={"ID":"4bb1eb6f-7037-4418-8854-0eb07dc60dd2","Type":"ContainerStarted","Data":"3be8dda65958a2f7024a5bbd4cefd82c0bbfabfe07765bda6e8abbe52f8b3fd6"}
Jul 20 19:16:30.637742 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.637721    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-2pp2d"
Jul 20 19:16:30.679213 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.677523    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-2pp2d" podStartSLOduration=1.897955805 podStartE2EDuration="21.677498336s" totalImagesPullingTime="19.779542531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:30.656514617 +0000 UTC m=+76.880141799" watchObservedRunningTime="2026-07-20 19:16:30.677498336 +0000 UTC m=+76.901125518"
Jul 20 19:16:30.683585 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.683552    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:30.785580 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.785548    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:30.890388 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.889301    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6cd546b44f-jh9gp"]
Jul 20 19:16:30.919280 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.918233    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6cd546b44f-jh9gp"]
Jul 20 19:16:30.919280 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.918357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:30.925564 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.925532    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 20 19:16:30.925825 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.925810    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 19:16:30.926073 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.926055    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 20 19:16:30.926548 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.926306    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dr5b8\""
Jul 20 19:16:30.926642 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.926587    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 20 19:16:30.926807 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:30.926789    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cr5304cle2hd7\""
Jul 20 19:16:31.062291 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.062240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1606d028-d95c-4a28-a562-26e4072af18f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.062722 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.062302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1606d028-d95c-4a28-a562-26e4072af18f-secret-metrics-server-client-certs\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.062722 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.062333    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh88z\" (UniqueName: \"kubernetes.io/projected/1606d028-d95c-4a28-a562-26e4072af18f-kube-api-access-gh88z\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.062722 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.062390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1606d028-d95c-4a28-a562-26e4072af18f-audit-log\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.062722 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.062420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1606d028-d95c-4a28-a562-26e4072af18f-secret-metrics-server-tls\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.062722 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.062479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1606d028-d95c-4a28-a562-26e4072af18f-metrics-server-audit-profiles\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.062722 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.062515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1606d028-d95c-4a28-a562-26e4072af18f-client-ca-bundle\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.166262 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.164338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1606d028-d95c-4a28-a562-26e4072af18f-metrics-server-audit-profiles\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.166262 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.164397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1606d028-d95c-4a28-a562-26e4072af18f-client-ca-bundle\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.166262 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.164447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1606d028-d95c-4a28-a562-26e4072af18f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.166262 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.164524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1606d028-d95c-4a28-a562-26e4072af18f-secret-metrics-server-client-certs\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.166262 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.164552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh88z\" (UniqueName: \"kubernetes.io/projected/1606d028-d95c-4a28-a562-26e4072af18f-kube-api-access-gh88z\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.166262 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.164576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1606d028-d95c-4a28-a562-26e4072af18f-audit-log\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.166262 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.164608    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1606d028-d95c-4a28-a562-26e4072af18f-secret-metrics-server-tls\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.166816 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.166788    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1606d028-d95c-4a28-a562-26e4072af18f-audit-log\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.167163 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.167139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1606d028-d95c-4a28-a562-26e4072af18f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.167811 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.167784    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1606d028-d95c-4a28-a562-26e4072af18f-metrics-server-audit-profiles\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.169868 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.169837    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1606d028-d95c-4a28-a562-26e4072af18f-client-ca-bundle\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.180170 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.179671    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1606d028-d95c-4a28-a562-26e4072af18f-secret-metrics-server-tls\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.185727 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.185680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh88z\" (UniqueName: \"kubernetes.io/projected/1606d028-d95c-4a28-a562-26e4072af18f-kube-api-access-gh88z\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.187235 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.187171    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1606d028-d95c-4a28-a562-26e4072af18f-secret-metrics-server-client-certs\") pod \"metrics-server-6cd546b44f-jh9gp\" (UID: \"1606d028-d95c-4a28-a562-26e4072af18f\") " pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.244293 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.243986    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:31.263210 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.263157    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:31.283975 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.282816    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt"]
Jul 20 19:16:31.309573 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.309511    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt"]
Jul 20 19:16:31.309754 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.309656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt"
Jul 20 19:16:31.316928 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.315813    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 20 19:16:31.316928 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.316110    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vdf8b\""
Jul 20 19:16:31.358277 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.356920    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-98cd4f568-7h6fv"]
Jul 20 19:16:31.377221 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.376162    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98cd4f568-7h6fv"]
Jul 20 19:16:31.377221 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.376333    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.391634 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.391468    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:31.396661 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.396635    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 19:16:31.470464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.470105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a47e70f-ec48-4f13-8400-454066dc43cb-console-serving-cert\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.470464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.470151    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-trusted-ca-bundle\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.470464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.470202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-service-ca\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.470464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.470236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a47e70f-ec48-4f13-8400-454066dc43cb-console-oauth-config\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.470464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.470261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/986328c7-1a7b-467c-923d-6095f1f57a65-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-528xt\" (UID: \"986328c7-1a7b-467c-923d-6095f1f57a65\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt"
Jul 20 19:16:31.470464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.470287    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79tgh\" (UniqueName: \"kubernetes.io/projected/986328c7-1a7b-467c-923d-6095f1f57a65-kube-api-access-79tgh\") pod \"monitoring-plugin-7b7b7bc8bf-528xt\" (UID: \"986328c7-1a7b-467c-923d-6095f1f57a65\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt"
Jul 20 19:16:31.470464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.470312    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-console-config\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.470464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.470359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-oauth-serving-cert\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.470464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.470381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb6d9\" (UniqueName: \"kubernetes.io/projected/8a47e70f-ec48-4f13-8400-454066dc43cb-kube-api-access-hb6d9\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.515972 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.515788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:31.571209 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.571159    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-trusted-ca-bundle\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.572493 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.572449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-service-ca\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.572635 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.572513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a47e70f-ec48-4f13-8400-454066dc43cb-console-oauth-config\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.572635 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.572534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/986328c7-1a7b-467c-923d-6095f1f57a65-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-528xt\" (UID: \"986328c7-1a7b-467c-923d-6095f1f57a65\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt"
Jul 20 19:16:31.572635 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.572553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79tgh\" (UniqueName: \"kubernetes.io/projected/986328c7-1a7b-467c-923d-6095f1f57a65-kube-api-access-79tgh\") pod \"monitoring-plugin-7b7b7bc8bf-528xt\" (UID: \"986328c7-1a7b-467c-923d-6095f1f57a65\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt"
Jul 20 19:16:31.572635 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.572576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-console-config\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.572635 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.572633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-oauth-serving-cert\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.572883 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.572657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb6d9\" (UniqueName: \"kubernetes.io/projected/8a47e70f-ec48-4f13-8400-454066dc43cb-kube-api-access-hb6d9\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.572883 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.572748    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a47e70f-ec48-4f13-8400-454066dc43cb-console-serving-cert\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.575794 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.574267    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-service-ca\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.575794 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.572373    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-trusted-ca-bundle\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.575794 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.574858    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-console-config\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.578255 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.575796    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-oauth-serving-cert\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.578255 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.576879    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a47e70f-ec48-4f13-8400-454066dc43cb-console-serving-cert\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.581537 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.581479    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/986328c7-1a7b-467c-923d-6095f1f57a65-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-528xt\" (UID: \"986328c7-1a7b-467c-923d-6095f1f57a65\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt"
Jul 20 19:16:31.591373 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.591274    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79tgh\" (UniqueName: \"kubernetes.io/projected/986328c7-1a7b-467c-923d-6095f1f57a65-kube-api-access-79tgh\") pod \"monitoring-plugin-7b7b7bc8bf-528xt\" (UID: \"986328c7-1a7b-467c-923d-6095f1f57a65\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt"
Jul 20 19:16:31.592272 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.592224    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a47e70f-ec48-4f13-8400-454066dc43cb-console-oauth-config\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.595065 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.595015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb6d9\" (UniqueName: \"kubernetes.io/projected/8a47e70f-ec48-4f13-8400-454066dc43cb-kube-api-access-hb6d9\") pod \"console-98cd4f568-7h6fv\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") " pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:31.630951 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.630912    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt"
Jul 20 19:16:31.692386 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:31.692350    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:32.521241 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:32.521126    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d6c89bd89-nb7qk"
Jul 20 19:16:32.732726 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:32.732625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:32.819902 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:32.818409    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6cd546b44f-jh9gp"]
Jul 20 19:16:32.830610 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:32.830268    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:32.876397 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:32.876364    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt"]
Jul 20 19:16:32.885913 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:32.885837    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98cd4f568-7h6fv"]
Jul 20 19:16:33.544220 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:16:33.544130    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a47e70f_ec48_4f13_8400_454066dc43cb.slice/crio-e8bff4ddb9cd6598c7248188ae2b6b3f8242f98389f304d9066da75bbb5e7c58 WatchSource:0}: Error finding container e8bff4ddb9cd6598c7248188ae2b6b3f8242f98389f304d9066da75bbb5e7c58: Status 404 returned error can't find the container with id e8bff4ddb9cd6598c7248188ae2b6b3f8242f98389f304d9066da75bbb5e7c58
Jul 20 19:16:33.546807 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:16:33.546776    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986328c7_1a7b_467c_923d_6095f1f57a65.slice/crio-37192ae4dc3d7cfd74ef05e286779a90101b166035a478a4052e13e58313cf33 WatchSource:0}: Error finding container 37192ae4dc3d7cfd74ef05e286779a90101b166035a478a4052e13e58313cf33: Status 404 returned error can't find the container with id 37192ae4dc3d7cfd74ef05e286779a90101b166035a478a4052e13e58313cf33
Jul 20 19:16:33.652891 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:33.652860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:33.672625 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:33.672588    2581 generic.go:356] "Generic (PLEG): container finished" podID="4502df8c-6ebb-42e2-b2b8-4547b268c103" containerID="186010bcb0bde5c6a8515a0f0be8867254067e57cf3dd44d15796f36afb9e74f" exitCode=0
Jul 20 19:16:33.672777 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:33.672678    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xb9s8" event={"ID":"4502df8c-6ebb-42e2-b2b8-4547b268c103","Type":"ContainerDied","Data":"186010bcb0bde5c6a8515a0f0be8867254067e57cf3dd44d15796f36afb9e74f"}
Jul 20 19:16:33.688858 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:33.688762    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-knd47" event={"ID":"4bb1eb6f-7037-4418-8854-0eb07dc60dd2","Type":"ContainerStarted","Data":"1a685a263efd11d6fd455edc2587efc867a6b7d51886132d7f931e508c56ed5e"}
Jul 20 19:16:33.693403 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:33.693167    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98cd4f568-7h6fv" event={"ID":"8a47e70f-ec48-4f13-8400-454066dc43cb","Type":"ContainerStarted","Data":"e8bff4ddb9cd6598c7248188ae2b6b3f8242f98389f304d9066da75bbb5e7c58"}
Jul 20 19:16:33.706415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:33.698875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp" event={"ID":"1606d028-d95c-4a28-a562-26e4072af18f","Type":"ContainerStarted","Data":"07753e6c3b6ae19e2e3bd85e82265fb9e29bbcc22d10da4c454e8f17b4bc8911"}
Jul 20 19:16:33.712603 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:33.712529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt" event={"ID":"986328c7-1a7b-467c-923d-6095f1f57a65","Type":"ContainerStarted","Data":"37192ae4dc3d7cfd74ef05e286779a90101b166035a478a4052e13e58313cf33"}
Jul 20 19:16:34.690155 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:34.690114    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:34.723709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:34.723574    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn" event={"ID":"6875ac4a-cad6-4a63-828f-e13e42521ece","Type":"ContainerStarted","Data":"d2e5c799ec92111977ed158e8a3f5356773cdb5240577a253c6944e723575f69"}
Jul 20 19:16:34.732213 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:34.732076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xb9s8" event={"ID":"4502df8c-6ebb-42e2-b2b8-4547b268c103","Type":"ContainerStarted","Data":"822375ef7db15b742ed984ac6137816f00f37f3614d945f128d4a4e22c975c67"}
Jul 20 19:16:34.732213 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:34.732138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xb9s8" event={"ID":"4502df8c-6ebb-42e2-b2b8-4547b268c103","Type":"ContainerStarted","Data":"b9c9c88b54258b98cfd0c0d52f11a8d46842a92df40b74636a742646e048788a"}
Jul 20 19:16:34.738230 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:34.737801    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-knd47" event={"ID":"4bb1eb6f-7037-4418-8854-0eb07dc60dd2","Type":"ContainerStarted","Data":"f28b53c2c1077499af85d4512643b3cbc4602def79b78f6fe67e17fd91bb4cf0"}
Jul 20 19:16:34.747127 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:34.746632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98cd4f568-7h6fv" event={"ID":"8a47e70f-ec48-4f13-8400-454066dc43cb","Type":"ContainerStarted","Data":"d4452a50ae56b5b53711ec3c987bca0982e0b7203b9421daee38631ab6517eb3"}
Jul 20 19:16:34.775942 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:34.775125    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mmjjn" podStartSLOduration=5.03826591 podStartE2EDuration="8.775104607s" totalImagesPullingTime="3.736838697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:34.745300704 +0000 UTC m=+80.968927887" watchObservedRunningTime="2026-07-20 19:16:34.775104607 +0000 UTC m=+80.998731790"
Jul 20 19:16:34.775942 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:34.775282    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xb9s8" podStartSLOduration=5.9567428719999995 podStartE2EDuration="8.775272198s" totalImagesPullingTime="2.713681419s" totalInitContainerRuntime="104.847907ms" isStatefulPod=true podCreationTimestamp="2026-07-20 19:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:34.773153509 +0000 UTC m=+80.996780693" watchObservedRunningTime="2026-07-20 19:16:34.775272198 +0000 UTC m=+80.998899380"
Jul 20 19:16:34.790875 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:34.790845    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:34.803288 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:34.803137    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-knd47" podStartSLOduration=78.083263549 podStartE2EDuration="1m20.803117114s" totalImagesPullingTime="2.719853565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:34.80242521 +0000 UTC m=+81.026052393" watchObservedRunningTime="2026-07-20 19:16:34.803117114 +0000 UTC m=+81.026744295"
Jul 20 19:16:34.824026 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:34.823938    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-98cd4f568-7h6fv" podStartSLOduration=3.823918139 podStartE2EDuration="3.823918139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:34.822933321 +0000 UTC m=+81.046560504" watchObservedRunningTime="2026-07-20 19:16:34.823918139 +0000 UTC m=+81.047545303"
Jul 20 19:16:34.920546 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:34.920505    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:35.023136 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:35.023034    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:36.767334 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:36.767296    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:36.823895 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:36.823854    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:39.226489 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:39.226459    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:39.297040 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:39.297011    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:41.693520 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:41.693485    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:41.694138 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:41.693578    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:41.699010 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:41.698986    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:41.782045 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:41.782020    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:16:41.852839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:41.852808    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c565c4898-wshpm"]
Jul 20 19:16:41.970362 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:41.970287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:42.070694 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.070665    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:42.171886 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.171856    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:42.784731 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.784699    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kbnh" event={"ID":"a334e128-8982-4c51-890c-007e171f8c6e","Type":"ContainerStarted","Data":"d4ef6ec10612b29f2c541b123c06529dedfb327e9fb85f3c5fb66df848e8216a"}
Jul 20 19:16:42.786230 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.786204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt" event={"ID":"986328c7-1a7b-467c-923d-6095f1f57a65","Type":"ContainerStarted","Data":"f54512c74c743dab352b7e6e056a4a588d034a53e4df320ccb7c3f74e62ba27c"}
Jul 20 19:16:42.786311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.786259    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt"
Jul 20 19:16:42.787775 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.787748    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp" event={"ID":"1606d028-d95c-4a28-a562-26e4072af18f","Type":"ContainerStarted","Data":"a32e4fc3ab844d1e4acb8818122e8d695f9894200c0e95a5d2e899a1175e8389"}
Jul 20 19:16:42.789395 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.789367    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l67tj" event={"ID":"b1d98b95-11d0-422d-bccf-6284f813cd9b","Type":"ContainerStarted","Data":"e58d1ab0c5f35f3d92d18fb5ff421956ed8185335c0d8912e089ff04d0f22d95"}
Jul 20 19:16:42.790744 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.790722    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xcfmn" event={"ID":"2c47c789-0902-479a-9713-a46677075564","Type":"ContainerStarted","Data":"86aa575db1a1dd552eda6777afdeae2454439851008b7f71e42e53d0baeb1837"}
Jul 20 19:16:42.792223 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.792181    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt"
Jul 20 19:16:42.811374 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.811324    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4kbnh" podStartSLOduration=1.957926544 podStartE2EDuration="33.811299721s" totalImagesPullingTime="31.853373177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:16:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:42.809829748 +0000 UTC m=+89.033456931" watchObservedRunningTime="2026-07-20 19:16:42.811299721 +0000 UTC m=+89.034926880"
Jul 20 19:16:42.856979 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.856935    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xcfmn" podStartSLOduration=76.529239637 podStartE2EDuration="1m28.856917511s" totalImagesPullingTime="12.327677874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:42.855653421 +0000 UTC m=+89.079280625" watchObservedRunningTime="2026-07-20 19:16:42.856917511 +0000 UTC m=+89.080544693"
Jul 20 19:16:42.857169 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.857150    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l67tj" podStartSLOduration=76.643068803 podStartE2EDuration="1m28.857144935s" totalImagesPullingTime="12.214076132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:42.83698492 +0000 UTC m=+89.060612101" watchObservedRunningTime="2026-07-20 19:16:42.857144935 +0000 UTC m=+89.080772107"
Jul 20 19:16:42.886335 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.886272    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp" podStartSLOduration=4.180867046 podStartE2EDuration="12.88625305s" totalImagesPullingTime="8.705386004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:42.885879278 +0000 UTC m=+89.109506459" watchObservedRunningTime="2026-07-20 19:16:42.88625305 +0000 UTC m=+89.109880232"
Jul 20 19:16:42.915522 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:42.915476    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-528xt" podStartSLOduration=3.221387855 podStartE2EDuration="11.915463119s" totalImagesPullingTime="8.694075264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:16:42.909294807 +0000 UTC m=+89.132921999" watchObservedRunningTime="2026-07-20 19:16:42.915463119 +0000 UTC m=+89.139090300"
Jul 20 19:16:43.766077 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:43.766044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:43.794151 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:43.794113    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:16:43.864992 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:43.864962    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:45.867410 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:45.867373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:45.968172 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:45.968137    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:46.648165 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:46.648126    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:46.752903 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:46.752872    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:16:51.244773 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:51.244730    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:16:51.245286 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:16:51.244793    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:17:01.648149 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:01.648115    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:01.745447 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:01.745417    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:01.979924 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:01.979829    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:02.080039 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:02.079999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:02.509537 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:02.509498    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:02.610054 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:02.610024    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:06.873056 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:06.873015    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c565c4898-wshpm" podUID="da0f5591-ac78-48ad-b8c7-c09425936da3" containerName="console" containerID="cri-o://a1ca1d82d3400fb85c6acc6bcf60aa116c30a28521e9fda415ebef18c9677b42" gracePeriod=15
Jul 20 19:17:07.143707 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.143643    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:17:07.159593 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.159558    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-console-config\") pod \"da0f5591-ac78-48ad-b8c7-c09425936da3\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") "
Jul 20 19:17:07.159593 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.159596    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da0f5591-ac78-48ad-b8c7-c09425936da3-console-serving-cert\") pod \"da0f5591-ac78-48ad-b8c7-c09425936da3\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") "
Jul 20 19:17:07.159814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.159635    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dbnq\" (UniqueName: \"kubernetes.io/projected/da0f5591-ac78-48ad-b8c7-c09425936da3-kube-api-access-9dbnq\") pod \"da0f5591-ac78-48ad-b8c7-c09425936da3\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") "
Jul 20 19:17:07.159814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.159666    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-service-ca\") pod \"da0f5591-ac78-48ad-b8c7-c09425936da3\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") "
Jul 20 19:17:07.159814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.159709    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da0f5591-ac78-48ad-b8c7-c09425936da3-console-oauth-config\") pod \"da0f5591-ac78-48ad-b8c7-c09425936da3\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") "
Jul 20 19:17:07.159814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.159779    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-oauth-serving-cert\") pod \"da0f5591-ac78-48ad-b8c7-c09425936da3\" (UID: \"da0f5591-ac78-48ad-b8c7-c09425936da3\") "
Jul 20 19:17:07.160065 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.159998    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-console-config" (OuterVolumeSpecName: "console-config") pod "da0f5591-ac78-48ad-b8c7-c09425936da3" (UID: "da0f5591-ac78-48ad-b8c7-c09425936da3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:17:07.160224 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.160171    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-service-ca" (OuterVolumeSpecName: "service-ca") pod "da0f5591-ac78-48ad-b8c7-c09425936da3" (UID: "da0f5591-ac78-48ad-b8c7-c09425936da3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:17:07.160336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.160312    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da0f5591-ac78-48ad-b8c7-c09425936da3" (UID: "da0f5591-ac78-48ad-b8c7-c09425936da3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:17:07.162122 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.162091    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da0f5591-ac78-48ad-b8c7-c09425936da3-kube-api-access-9dbnq" (OuterVolumeSpecName: "kube-api-access-9dbnq") pod "da0f5591-ac78-48ad-b8c7-c09425936da3" (UID: "da0f5591-ac78-48ad-b8c7-c09425936da3"). InnerVolumeSpecName "kube-api-access-9dbnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:17:07.162122 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.162108    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da0f5591-ac78-48ad-b8c7-c09425936da3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da0f5591-ac78-48ad-b8c7-c09425936da3" (UID: "da0f5591-ac78-48ad-b8c7-c09425936da3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:17:07.162282 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.162142    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da0f5591-ac78-48ad-b8c7-c09425936da3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da0f5591-ac78-48ad-b8c7-c09425936da3" (UID: "da0f5591-ac78-48ad-b8c7-c09425936da3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:17:07.260618 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.260576    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-oauth-serving-cert\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:17:07.260618 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.260616    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-console-config\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:17:07.260618 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.260626    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da0f5591-ac78-48ad-b8c7-c09425936da3-console-serving-cert\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:17:07.260859 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.260634    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dbnq\" (UniqueName: \"kubernetes.io/projected/da0f5591-ac78-48ad-b8c7-c09425936da3-kube-api-access-9dbnq\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:17:07.260859 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.260644    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da0f5591-ac78-48ad-b8c7-c09425936da3-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:17:07.260859 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.260652    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da0f5591-ac78-48ad-b8c7-c09425936da3-console-oauth-config\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:17:07.883061 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.883025    2581 generic.go:356] "Generic (PLEG): container finished" podID="da0f5591-ac78-48ad-b8c7-c09425936da3" containerID="a1ca1d82d3400fb85c6acc6bcf60aa116c30a28521e9fda415ebef18c9677b42" exitCode=0
Jul 20 19:17:07.883486 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.883069    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c565c4898-wshpm"
Jul 20 19:17:07.883486 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.883099    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c565c4898-wshpm" event={"ID":"da0f5591-ac78-48ad-b8c7-c09425936da3","Type":"ContainerDied","Data":"a1ca1d82d3400fb85c6acc6bcf60aa116c30a28521e9fda415ebef18c9677b42"}
Jul 20 19:17:07.883486 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.883144    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c565c4898-wshpm" event={"ID":"da0f5591-ac78-48ad-b8c7-c09425936da3","Type":"ContainerDied","Data":"b44d2cb81f01dc3e91035f70978a122f0bb46158b0292c248e8827651583f623"}
Jul 20 19:17:07.883486 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.883163    2581 scope.go:117] "RemoveContainer" containerID="a1ca1d82d3400fb85c6acc6bcf60aa116c30a28521e9fda415ebef18c9677b42"
Jul 20 19:17:07.892021 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.892001    2581 scope.go:117] "RemoveContainer" containerID="a1ca1d82d3400fb85c6acc6bcf60aa116c30a28521e9fda415ebef18c9677b42"
Jul 20 19:17:07.892316 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:17:07.892297    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1ca1d82d3400fb85c6acc6bcf60aa116c30a28521e9fda415ebef18c9677b42\": container with ID starting with a1ca1d82d3400fb85c6acc6bcf60aa116c30a28521e9fda415ebef18c9677b42 not found: ID does not exist" containerID="a1ca1d82d3400fb85c6acc6bcf60aa116c30a28521e9fda415ebef18c9677b42"
Jul 20 19:17:07.892381 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.892325    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1ca1d82d3400fb85c6acc6bcf60aa116c30a28521e9fda415ebef18c9677b42"} err="failed to get container status \"a1ca1d82d3400fb85c6acc6bcf60aa116c30a28521e9fda415ebef18c9677b42\": rpc error: code = NotFound desc = could not find container \"a1ca1d82d3400fb85c6acc6bcf60aa116c30a28521e9fda415ebef18c9677b42\": container with ID starting with a1ca1d82d3400fb85c6acc6bcf60aa116c30a28521e9fda415ebef18c9677b42 not found: ID does not exist"
Jul 20 19:17:07.906669 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.906645    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c565c4898-wshpm"]
Jul 20 19:17:07.911744 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:07.911723    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c565c4898-wshpm"]
Jul 20 19:17:08.264237 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:08.264147    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da0f5591-ac78-48ad-b8c7-c09425936da3" path="/var/lib/kubelet/pods/da0f5591-ac78-48ad-b8c7-c09425936da3/volumes"
Jul 20 19:17:10.645035 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:10.644968    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:10.687551 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:10.687507    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8zss7_84194694-3e25-4fb9-97f4-39954b7b4467/serve-healthcheck-canary/0.log"
Jul 20 19:17:11.250085 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:11.250057    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:17:11.254238 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:11.254212    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6cd546b44f-jh9gp"
Jul 20 19:17:11.316352 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:11.316319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:11.432489 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:11.432458    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:11.501804 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:11.501714    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:14.800449 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:14.800420    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xcfmn"
Jul 20 19:17:16.727928 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:16.727868    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:16.805896 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:16.805860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:45.695347 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:45.695310    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:46.034743 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:46.034621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:50.798923 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.798885    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c66784696-jfbzn"]
Jul 20 19:17:50.799306 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.799165    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da0f5591-ac78-48ad-b8c7-c09425936da3" containerName="console"
Jul 20 19:17:50.799306 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.799176    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="da0f5591-ac78-48ad-b8c7-c09425936da3" containerName="console"
Jul 20 19:17:50.799306 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.799230    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="da0f5591-ac78-48ad-b8c7-c09425936da3" containerName="console"
Jul 20 19:17:50.801768 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.801752    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.804141 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.804118    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rd2zv\""
Jul 20 19:17:50.804312 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.804159    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 20 19:17:50.804312 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.804221    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 20 19:17:50.804312 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.804245    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 20 19:17:50.804807 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.804793    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 20 19:17:50.807056 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.807039    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 20 19:17:50.810277 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.810255    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 20 19:17:50.816991 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.816965    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c66784696-jfbzn"]
Jul 20 19:17:50.889248 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.889221    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf859\" (UniqueName: \"kubernetes.io/projected/fb59c2b9-0af7-4146-b058-89f47891c478-kube-api-access-pf859\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.889441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.889260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb59c2b9-0af7-4146-b058-89f47891c478-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.889441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.889280    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb59c2b9-0af7-4146-b058-89f47891c478-serving-certs-ca-bundle\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.889441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.889304    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fb59c2b9-0af7-4146-b058-89f47891c478-secret-telemeter-client\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.889441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.889328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fb59c2b9-0af7-4146-b058-89f47891c478-telemeter-client-tls\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.889441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.889346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fb59c2b9-0af7-4146-b058-89f47891c478-federate-client-tls\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.889441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.889359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb59c2b9-0af7-4146-b058-89f47891c478-metrics-client-ca\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.889441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.889382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb59c2b9-0af7-4146-b058-89f47891c478-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.990252 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.990219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fb59c2b9-0af7-4146-b058-89f47891c478-federate-client-tls\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.990252 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.990253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb59c2b9-0af7-4146-b058-89f47891c478-metrics-client-ca\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.990492 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.990276    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb59c2b9-0af7-4146-b058-89f47891c478-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.990492 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.990315    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf859\" (UniqueName: \"kubernetes.io/projected/fb59c2b9-0af7-4146-b058-89f47891c478-kube-api-access-pf859\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.990492 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.990345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb59c2b9-0af7-4146-b058-89f47891c478-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.990492 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.990362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb59c2b9-0af7-4146-b058-89f47891c478-serving-certs-ca-bundle\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.990492 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.990385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fb59c2b9-0af7-4146-b058-89f47891c478-secret-telemeter-client\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.990735 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.990532    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fb59c2b9-0af7-4146-b058-89f47891c478-telemeter-client-tls\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.991213 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.991136    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb59c2b9-0af7-4146-b058-89f47891c478-serving-certs-ca-bundle\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.991213 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.991239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb59c2b9-0af7-4146-b058-89f47891c478-metrics-client-ca\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.991540 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.991518    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb59c2b9-0af7-4146-b058-89f47891c478-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.993014 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.992995    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fb59c2b9-0af7-4146-b058-89f47891c478-secret-telemeter-client\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.993131 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.993108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fb59c2b9-0af7-4146-b058-89f47891c478-federate-client-tls\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.993367 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.993349    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb59c2b9-0af7-4146-b058-89f47891c478-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.993578 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.993558    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fb59c2b9-0af7-4146-b058-89f47891c478-telemeter-client-tls\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:50.998228 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:50.998181    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf859\" (UniqueName: \"kubernetes.io/projected/fb59c2b9-0af7-4146-b058-89f47891c478-kube-api-access-pf859\") pod \"telemeter-client-7c66784696-jfbzn\" (UID: \"fb59c2b9-0af7-4146-b058-89f47891c478\") " pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:51.110839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:51.110814    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn"
Jul 20 19:17:51.252631 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:51.252603    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c66784696-jfbzn"]
Jul 20 19:17:51.254495 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:17:51.254465    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb59c2b9_0af7_4146_b058_89f47891c478.slice/crio-d3b952f50586c12fa7105b4bc1492218494df003c116789265ff2cb9a28d82d6 WatchSource:0}: Error finding container d3b952f50586c12fa7105b4bc1492218494df003c116789265ff2cb9a28d82d6: Status 404 returned error can't find the container with id d3b952f50586c12fa7105b4bc1492218494df003c116789265ff2cb9a28d82d6
Jul 20 19:17:52.040042 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:52.040000    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn" event={"ID":"fb59c2b9-0af7-4146-b058-89f47891c478","Type":"ContainerStarted","Data":"d3b952f50586c12fa7105b4bc1492218494df003c116789265ff2cb9a28d82d6"}
Jul 20 19:17:53.045912 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:53.045876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn" event={"ID":"fb59c2b9-0af7-4146-b058-89f47891c478","Type":"ContainerStarted","Data":"65d226c78001da8d071c3db16d8e31cf66b463e4364aaa9cd3c22a629199b8a6"}
Jul 20 19:17:54.051046 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:54.051012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn" event={"ID":"fb59c2b9-0af7-4146-b058-89f47891c478","Type":"ContainerStarted","Data":"b1bfa5662dafe655721c9d7341e17acc10fdcf30e4bef51d0ca79b6800dc6609"}
Jul 20 19:17:55.056109 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.056070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn" event={"ID":"fb59c2b9-0af7-4146-b058-89f47891c478","Type":"ContainerStarted","Data":"d1e9cc13ac000ed87146750fe8dd8b9d50f70c3b2f878bdbccb3870e909d931d"}
Jul 20 19:17:55.082334 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.082280    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c66784696-jfbzn" podStartSLOduration=2.439643941 podStartE2EDuration="5.082263793s" totalImagesPullingTime="2.642619852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:17:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:17:55.081241659 +0000 UTC m=+161.304868843" watchObservedRunningTime="2026-07-20 19:17:55.082263793 +0000 UTC m=+161.305890973"
Jul 20 19:17:55.814656 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.814628    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-568855886d-jcdcr"]
Jul 20 19:17:55.816781 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.816763    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:55.835012 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.834986    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568855886d-jcdcr"]
Jul 20 19:17:55.866117 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.866092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:55.931271 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.931240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-service-ca\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:55.931393 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.931276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dks9k\" (UniqueName: \"kubernetes.io/projected/14d385ba-0bc8-40d3-8141-db104b7ca015-kube-api-access-dks9k\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:55.931393 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.931309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-trusted-ca-bundle\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:55.931393 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.931343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14d385ba-0bc8-40d3-8141-db104b7ca015-console-serving-cert\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:55.931510 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.931406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-console-config\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:55.931510 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.931430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-oauth-serving-cert\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:55.931510 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.931468    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14d385ba-0bc8-40d3-8141-db104b7ca015-console-oauth-config\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:55.937112 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:55.937092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:17:56.032528 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.032495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-console-config\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.032704 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.032537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-oauth-serving-cert\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.032704 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.032593    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14d385ba-0bc8-40d3-8141-db104b7ca015-console-oauth-config\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.032704 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.032623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-service-ca\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.032704 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.032646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dks9k\" (UniqueName: \"kubernetes.io/projected/14d385ba-0bc8-40d3-8141-db104b7ca015-kube-api-access-dks9k\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.032704 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.032674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-trusted-ca-bundle\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.032704 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.032698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14d385ba-0bc8-40d3-8141-db104b7ca015-console-serving-cert\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.033342 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.033319    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-console-config\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.033458 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.033346    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-oauth-serving-cert\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.033502 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.033478    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-service-ca\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.033694 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.033676    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-trusted-ca-bundle\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.035796 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.035770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14d385ba-0bc8-40d3-8141-db104b7ca015-console-oauth-config\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.035876 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.035845    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14d385ba-0bc8-40d3-8141-db104b7ca015-console-serving-cert\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.042287 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.042269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dks9k\" (UniqueName: \"kubernetes.io/projected/14d385ba-0bc8-40d3-8141-db104b7ca015-kube-api-access-dks9k\") pod \"console-568855886d-jcdcr\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") " pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.125743 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.125714    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:17:56.254933 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:56.254893    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568855886d-jcdcr"]
Jul 20 19:17:56.258876 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:17:56.258851    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14d385ba_0bc8_40d3_8141_db104b7ca015.slice/crio-c6981f9e52d46beef737bc6f09cd3355a8ea0e1d161b84558cb85e6c72d7e4b4 WatchSource:0}: Error finding container c6981f9e52d46beef737bc6f09cd3355a8ea0e1d161b84558cb85e6c72d7e4b4: Status 404 returned error can't find the container with id c6981f9e52d46beef737bc6f09cd3355a8ea0e1d161b84558cb85e6c72d7e4b4
Jul 20 19:17:57.064312 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:57.064273    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568855886d-jcdcr" event={"ID":"14d385ba-0bc8-40d3-8141-db104b7ca015","Type":"ContainerStarted","Data":"e9955e4e4302c239c8857f0280590dd15327686696124b7edc5fa12a818bf4d8"}
Jul 20 19:17:57.064464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:57.064354    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568855886d-jcdcr" event={"ID":"14d385ba-0bc8-40d3-8141-db104b7ca015","Type":"ContainerStarted","Data":"c6981f9e52d46beef737bc6f09cd3355a8ea0e1d161b84558cb85e6c72d7e4b4"}
Jul 20 19:17:57.085144 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:17:57.085097    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-568855886d-jcdcr" podStartSLOduration=2.085082048 podStartE2EDuration="2.085082048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:17:57.083406627 +0000 UTC m=+163.307033810" watchObservedRunningTime="2026-07-20 19:17:57.085082048 +0000 UTC m=+163.308709229"
Jul 20 19:18:01.069927 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:01.069885    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:01.166860 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:01.166827    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:02.811059 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:02.811021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:06.126496 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:06.126407    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:18:06.126853 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:06.126726    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:18:06.131501 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:06.131480    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:18:07.109770 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.109741    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:18:07.186280 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.186251    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98cd4f568-7h6fv"]
Jul 20 19:18:07.387091 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.386999    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c97bbb465-v25vn"]
Jul 20 19:18:07.390060 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.390040    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.403338 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.403315    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c97bbb465-v25vn"]
Jul 20 19:18:07.416690 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.416664    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:07.416819 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.416695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-console-config\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.416819 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.416720    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5861901-5ca8-4a51-895a-cb96daab3536-console-oauth-config\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.416819 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.416778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-service-ca\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.416953 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.416819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-oauth-serving-cert\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.416953 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.416868    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5861901-5ca8-4a51-895a-cb96daab3536-console-serving-cert\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.416953 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.416898    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-trusted-ca-bundle\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.416953 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.416930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tttf5\" (UniqueName: \"kubernetes.io/projected/a5861901-5ca8-4a51-895a-cb96daab3536-kube-api-access-tttf5\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.515245 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.515210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:07.517244 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.517220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-service-ca\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.517301 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.517254    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-oauth-serving-cert\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.517301 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.517293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5861901-5ca8-4a51-895a-cb96daab3536-console-serving-cert\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.517384 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.517309    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-trusted-ca-bundle\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.517384 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.517326    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tttf5\" (UniqueName: \"kubernetes.io/projected/a5861901-5ca8-4a51-895a-cb96daab3536-kube-api-access-tttf5\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.517384 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.517348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-console-config\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.517384 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.517366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5861901-5ca8-4a51-895a-cb96daab3536-console-oauth-config\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.518047 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.518024    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-service-ca\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.518158 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.518031    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-oauth-serving-cert\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.518316 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.518296    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-console-config\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.518360 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.518304    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-trusted-ca-bundle\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.519781 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.519763    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5861901-5ca8-4a51-895a-cb96daab3536-console-serving-cert\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.519928 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.519912    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5861901-5ca8-4a51-895a-cb96daab3536-console-oauth-config\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.525161 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.525144    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tttf5\" (UniqueName: \"kubernetes.io/projected/a5861901-5ca8-4a51-895a-cb96daab3536-kube-api-access-tttf5\") pod \"console-c97bbb465-v25vn\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") " pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.699634 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.699545    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:07.829942 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.829844    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c97bbb465-v25vn"]
Jul 20 19:18:07.832393 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:18:07.832367    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5861901_5ca8_4a51_895a_cb96daab3536.slice/crio-9908ffcfd3570f5f6eec03577cabc493699e9b624db3b38b49602330781f1cc6 WatchSource:0}: Error finding container 9908ffcfd3570f5f6eec03577cabc493699e9b624db3b38b49602330781f1cc6: Status 404 returned error can't find the container with id 9908ffcfd3570f5f6eec03577cabc493699e9b624db3b38b49602330781f1cc6
Jul 20 19:18:07.852818 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.852785    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:07.951865 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:07.951772    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:08.111335 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:08.111296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c97bbb465-v25vn" event={"ID":"a5861901-5ca8-4a51-895a-cb96daab3536","Type":"ContainerStarted","Data":"8cecae653468e4d19b44d979c392335c2fc6453d084c71ff770dcae901613fba"}
Jul 20 19:18:08.111481 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:08.111354    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c97bbb465-v25vn" event={"ID":"a5861901-5ca8-4a51-895a-cb96daab3536","Type":"ContainerStarted","Data":"9908ffcfd3570f5f6eec03577cabc493699e9b624db3b38b49602330781f1cc6"}
Jul 20 19:18:08.131634 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:08.131591    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c97bbb465-v25vn" podStartSLOduration=1.131577659 podStartE2EDuration="1.131577659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:18:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:18:08.130978086 +0000 UTC m=+174.354605268" watchObservedRunningTime="2026-07-20 19:18:08.131577659 +0000 UTC m=+174.355204906"
Jul 20 19:18:12.962549 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:12.962515    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:13.063490 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:13.063455    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:16.649390 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:16.649347    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:16.748321 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:16.748279    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:17.700281 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:17.700236    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:17.700735 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:17.700299    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:17.704576 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:17.704555    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:18.152157 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:18.152129    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:18:18.213179 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:18.213139    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568855886d-jcdcr"]
Jul 20 19:18:18.333666 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:18.333633    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:18.434280 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:18.434171    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:18.497258 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:18.497231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:32.207585 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.207520    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-98cd4f568-7h6fv" podUID="8a47e70f-ec48-4f13-8400-454066dc43cb" containerName="console" containerID="cri-o://d4452a50ae56b5b53711ec3c987bca0982e0b7203b9421daee38631ab6517eb3" gracePeriod=15
Jul 20 19:18:32.465764 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.465705    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:18:32.526536 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.526507    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-console-config\") pod \"8a47e70f-ec48-4f13-8400-454066dc43cb\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") "
Jul 20 19:18:32.526701 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.526557    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hb6d9\" (UniqueName: \"kubernetes.io/projected/8a47e70f-ec48-4f13-8400-454066dc43cb-kube-api-access-hb6d9\") pod \"8a47e70f-ec48-4f13-8400-454066dc43cb\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") "
Jul 20 19:18:32.526701 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.526579    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-service-ca\") pod \"8a47e70f-ec48-4f13-8400-454066dc43cb\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") "
Jul 20 19:18:32.526701 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.526596    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a47e70f-ec48-4f13-8400-454066dc43cb-console-oauth-config\") pod \"8a47e70f-ec48-4f13-8400-454066dc43cb\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") "
Jul 20 19:18:32.526701 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.526644    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-oauth-serving-cert\") pod \"8a47e70f-ec48-4f13-8400-454066dc43cb\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") "
Jul 20 19:18:32.526701 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.526697    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-trusted-ca-bundle\") pod \"8a47e70f-ec48-4f13-8400-454066dc43cb\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") "
Jul 20 19:18:32.526894 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.526737    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a47e70f-ec48-4f13-8400-454066dc43cb-console-serving-cert\") pod \"8a47e70f-ec48-4f13-8400-454066dc43cb\" (UID: \"8a47e70f-ec48-4f13-8400-454066dc43cb\") "
Jul 20 19:18:32.526894 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.526875    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-console-config" (OuterVolumeSpecName: "console-config") pod "8a47e70f-ec48-4f13-8400-454066dc43cb" (UID: "8a47e70f-ec48-4f13-8400-454066dc43cb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:18:32.527070 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.527043    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-service-ca" (OuterVolumeSpecName: "service-ca") pod "8a47e70f-ec48-4f13-8400-454066dc43cb" (UID: "8a47e70f-ec48-4f13-8400-454066dc43cb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:18:32.527129 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.527069    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8a47e70f-ec48-4f13-8400-454066dc43cb" (UID: "8a47e70f-ec48-4f13-8400-454066dc43cb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:18:32.527279 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.527261    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8a47e70f-ec48-4f13-8400-454066dc43cb" (UID: "8a47e70f-ec48-4f13-8400-454066dc43cb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:18:32.528980 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.528935    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a47e70f-ec48-4f13-8400-454066dc43cb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8a47e70f-ec48-4f13-8400-454066dc43cb" (UID: "8a47e70f-ec48-4f13-8400-454066dc43cb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:18:32.529084 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.528994    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a47e70f-ec48-4f13-8400-454066dc43cb-kube-api-access-hb6d9" (OuterVolumeSpecName: "kube-api-access-hb6d9") pod "8a47e70f-ec48-4f13-8400-454066dc43cb" (UID: "8a47e70f-ec48-4f13-8400-454066dc43cb"). InnerVolumeSpecName "kube-api-access-hb6d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:18:32.529084 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.529006    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a47e70f-ec48-4f13-8400-454066dc43cb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8a47e70f-ec48-4f13-8400-454066dc43cb" (UID: "8a47e70f-ec48-4f13-8400-454066dc43cb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:18:32.627977 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.627937    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-oauth-serving-cert\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:32.627977 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.627969    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-trusted-ca-bundle\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:32.627977 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.627983    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a47e70f-ec48-4f13-8400-454066dc43cb-console-serving-cert\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:32.628288 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.627994    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-console-config\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:32.628288 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.628006    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb6d9\" (UniqueName: \"kubernetes.io/projected/8a47e70f-ec48-4f13-8400-454066dc43cb-kube-api-access-hb6d9\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:32.628288 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.628017    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a47e70f-ec48-4f13-8400-454066dc43cb-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:32.628288 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:32.628028    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a47e70f-ec48-4f13-8400-454066dc43cb-console-oauth-config\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:33.199313 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:33.199277    2581 generic.go:356] "Generic (PLEG): container finished" podID="8a47e70f-ec48-4f13-8400-454066dc43cb" containerID="d4452a50ae56b5b53711ec3c987bca0982e0b7203b9421daee38631ab6517eb3" exitCode=0
Jul 20 19:18:33.199482 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:33.199322    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98cd4f568-7h6fv"
Jul 20 19:18:33.199482 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:33.199328    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98cd4f568-7h6fv" event={"ID":"8a47e70f-ec48-4f13-8400-454066dc43cb","Type":"ContainerDied","Data":"d4452a50ae56b5b53711ec3c987bca0982e0b7203b9421daee38631ab6517eb3"}
Jul 20 19:18:33.199482 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:33.199392    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98cd4f568-7h6fv" event={"ID":"8a47e70f-ec48-4f13-8400-454066dc43cb","Type":"ContainerDied","Data":"e8bff4ddb9cd6598c7248188ae2b6b3f8242f98389f304d9066da75bbb5e7c58"}
Jul 20 19:18:33.199482 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:33.199411    2581 scope.go:117] "RemoveContainer" containerID="d4452a50ae56b5b53711ec3c987bca0982e0b7203b9421daee38631ab6517eb3"
Jul 20 19:18:33.207698 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:33.207679    2581 scope.go:117] "RemoveContainer" containerID="d4452a50ae56b5b53711ec3c987bca0982e0b7203b9421daee38631ab6517eb3"
Jul 20 19:18:33.207974 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:18:33.207943    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4452a50ae56b5b53711ec3c987bca0982e0b7203b9421daee38631ab6517eb3\": container with ID starting with d4452a50ae56b5b53711ec3c987bca0982e0b7203b9421daee38631ab6517eb3 not found: ID does not exist" containerID="d4452a50ae56b5b53711ec3c987bca0982e0b7203b9421daee38631ab6517eb3"
Jul 20 19:18:33.208022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:33.207968    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4452a50ae56b5b53711ec3c987bca0982e0b7203b9421daee38631ab6517eb3"} err="failed to get container status \"d4452a50ae56b5b53711ec3c987bca0982e0b7203b9421daee38631ab6517eb3\": rpc error: code = NotFound desc = could not find container \"d4452a50ae56b5b53711ec3c987bca0982e0b7203b9421daee38631ab6517eb3\": container with ID starting with d4452a50ae56b5b53711ec3c987bca0982e0b7203b9421daee38631ab6517eb3 not found: ID does not exist"
Jul 20 19:18:33.220432 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:33.220395    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98cd4f568-7h6fv"]
Jul 20 19:18:33.223960 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:33.223939    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-98cd4f568-7h6fv"]
Jul 20 19:18:34.264980 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:34.264942    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a47e70f-ec48-4f13-8400-454066dc43cb" path="/var/lib/kubelet/pods/8a47e70f-ec48-4f13-8400-454066dc43cb/volumes"
Jul 20 19:18:40.879339 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:40.879276    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:40.943527 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:40.943500    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:43.234177 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.234143    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-568855886d-jcdcr" podUID="14d385ba-0bc8-40d3-8141-db104b7ca015" containerName="console" containerID="cri-o://e9955e4e4302c239c8857f0280590dd15327686696124b7edc5fa12a818bf4d8" gracePeriod=15
Jul 20 19:18:43.482630 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.482607    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:18:43.612662 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.612633    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dks9k\" (UniqueName: \"kubernetes.io/projected/14d385ba-0bc8-40d3-8141-db104b7ca015-kube-api-access-dks9k\") pod \"14d385ba-0bc8-40d3-8141-db104b7ca015\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") "
Jul 20 19:18:43.612839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.612687    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14d385ba-0bc8-40d3-8141-db104b7ca015-console-serving-cert\") pod \"14d385ba-0bc8-40d3-8141-db104b7ca015\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") "
Jul 20 19:18:43.612839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.612728    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-oauth-serving-cert\") pod \"14d385ba-0bc8-40d3-8141-db104b7ca015\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") "
Jul 20 19:18:43.612839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.612781    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-service-ca\") pod \"14d385ba-0bc8-40d3-8141-db104b7ca015\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") "
Jul 20 19:18:43.612839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.612811    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-console-config\") pod \"14d385ba-0bc8-40d3-8141-db104b7ca015\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") "
Jul 20 19:18:43.612839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.612833    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-trusted-ca-bundle\") pod \"14d385ba-0bc8-40d3-8141-db104b7ca015\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") "
Jul 20 19:18:43.613077 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.612854    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14d385ba-0bc8-40d3-8141-db104b7ca015-console-oauth-config\") pod \"14d385ba-0bc8-40d3-8141-db104b7ca015\" (UID: \"14d385ba-0bc8-40d3-8141-db104b7ca015\") "
Jul 20 19:18:43.613270 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.613246    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "14d385ba-0bc8-40d3-8141-db104b7ca015" (UID: "14d385ba-0bc8-40d3-8141-db104b7ca015"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:18:43.613352 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.613272    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-service-ca" (OuterVolumeSpecName: "service-ca") pod "14d385ba-0bc8-40d3-8141-db104b7ca015" (UID: "14d385ba-0bc8-40d3-8141-db104b7ca015"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:18:43.613352 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.613307    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-console-config" (OuterVolumeSpecName: "console-config") pod "14d385ba-0bc8-40d3-8141-db104b7ca015" (UID: "14d385ba-0bc8-40d3-8141-db104b7ca015"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:18:43.613352 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.613332    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "14d385ba-0bc8-40d3-8141-db104b7ca015" (UID: "14d385ba-0bc8-40d3-8141-db104b7ca015"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:18:43.614935 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.614913    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14d385ba-0bc8-40d3-8141-db104b7ca015-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "14d385ba-0bc8-40d3-8141-db104b7ca015" (UID: "14d385ba-0bc8-40d3-8141-db104b7ca015"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:18:43.615007 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.614988    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14d385ba-0bc8-40d3-8141-db104b7ca015-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "14d385ba-0bc8-40d3-8141-db104b7ca015" (UID: "14d385ba-0bc8-40d3-8141-db104b7ca015"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:18:43.615046 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.615024    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14d385ba-0bc8-40d3-8141-db104b7ca015-kube-api-access-dks9k" (OuterVolumeSpecName: "kube-api-access-dks9k") pod "14d385ba-0bc8-40d3-8141-db104b7ca015" (UID: "14d385ba-0bc8-40d3-8141-db104b7ca015"). InnerVolumeSpecName "kube-api-access-dks9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:18:43.713581 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.713534    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:43.713581 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.713574    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-console-config\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:43.713581 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.713583    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-trusted-ca-bundle\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:43.713581 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.713596    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14d385ba-0bc8-40d3-8141-db104b7ca015-console-oauth-config\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:43.713848 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.713606    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dks9k\" (UniqueName: \"kubernetes.io/projected/14d385ba-0bc8-40d3-8141-db104b7ca015-kube-api-access-dks9k\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:43.713848 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.713615    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14d385ba-0bc8-40d3-8141-db104b7ca015-console-serving-cert\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:43.713848 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:43.713624    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14d385ba-0bc8-40d3-8141-db104b7ca015-oauth-serving-cert\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:18:44.239078 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:44.239042    2581 generic.go:356] "Generic (PLEG): container finished" podID="14d385ba-0bc8-40d3-8141-db104b7ca015" containerID="e9955e4e4302c239c8857f0280590dd15327686696124b7edc5fa12a818bf4d8" exitCode=0
Jul 20 19:18:44.239508 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:44.239100    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568855886d-jcdcr"
Jul 20 19:18:44.239508 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:44.239128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568855886d-jcdcr" event={"ID":"14d385ba-0bc8-40d3-8141-db104b7ca015","Type":"ContainerDied","Data":"e9955e4e4302c239c8857f0280590dd15327686696124b7edc5fa12a818bf4d8"}
Jul 20 19:18:44.239508 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:44.239217    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568855886d-jcdcr" event={"ID":"14d385ba-0bc8-40d3-8141-db104b7ca015","Type":"ContainerDied","Data":"c6981f9e52d46beef737bc6f09cd3355a8ea0e1d161b84558cb85e6c72d7e4b4"}
Jul 20 19:18:44.239508 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:44.239242    2581 scope.go:117] "RemoveContainer" containerID="e9955e4e4302c239c8857f0280590dd15327686696124b7edc5fa12a818bf4d8"
Jul 20 19:18:44.247548 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:44.247534    2581 scope.go:117] "RemoveContainer" containerID="e9955e4e4302c239c8857f0280590dd15327686696124b7edc5fa12a818bf4d8"
Jul 20 19:18:44.247801 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:18:44.247777    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9955e4e4302c239c8857f0280590dd15327686696124b7edc5fa12a818bf4d8\": container with ID starting with e9955e4e4302c239c8857f0280590dd15327686696124b7edc5fa12a818bf4d8 not found: ID does not exist" containerID="e9955e4e4302c239c8857f0280590dd15327686696124b7edc5fa12a818bf4d8"
Jul 20 19:18:44.247849 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:44.247801    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9955e4e4302c239c8857f0280590dd15327686696124b7edc5fa12a818bf4d8"} err="failed to get container status \"e9955e4e4302c239c8857f0280590dd15327686696124b7edc5fa12a818bf4d8\": rpc error: code = NotFound desc = could not find container \"e9955e4e4302c239c8857f0280590dd15327686696124b7edc5fa12a818bf4d8\": container with ID starting with e9955e4e4302c239c8857f0280590dd15327686696124b7edc5fa12a818bf4d8 not found: ID does not exist"
Jul 20 19:18:44.258978 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:44.258955    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568855886d-jcdcr"]
Jul 20 19:18:44.265556 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:44.265533    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-568855886d-jcdcr"]
Jul 20 19:18:46.264495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:46.264461    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14d385ba-0bc8-40d3-8141-db104b7ca015" path="/var/lib/kubelet/pods/14d385ba-0bc8-40d3-8141-db104b7ca015/volumes"
Jul 20 19:18:59.560849 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:59.560808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:18:59.661544 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:18:59.661508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:01.012488 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.012454    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"]
Jul 20 19:19:01.012859 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.012735    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14d385ba-0bc8-40d3-8141-db104b7ca015" containerName="console"
Jul 20 19:19:01.012859 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.012746    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="14d385ba-0bc8-40d3-8141-db104b7ca015" containerName="console"
Jul 20 19:19:01.012859 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.012753    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a47e70f-ec48-4f13-8400-454066dc43cb" containerName="console"
Jul 20 19:19:01.012859 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.012759    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a47e70f-ec48-4f13-8400-454066dc43cb" containerName="console"
Jul 20 19:19:01.012859 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.012808    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="14d385ba-0bc8-40d3-8141-db104b7ca015" containerName="console"
Jul 20 19:19:01.012859 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.012818    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a47e70f-ec48-4f13-8400-454066dc43cb" containerName="console"
Jul 20 19:19:01.017318 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.017303    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"
Jul 20 19:19:01.019944 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.019925    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cl8sz\""
Jul 20 19:19:01.020340 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.020324    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 19:19:01.020817 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.020803    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 19:19:01.028649 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.028630    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"]
Jul 20 19:19:01.049784 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.049760    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6168aeab-cb96-4c71-95f4-44ca1cf49a89-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx\" (UID: \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"
Jul 20 19:19:01.049880 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.049832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdxnk\" (UniqueName: \"kubernetes.io/projected/6168aeab-cb96-4c71-95f4-44ca1cf49a89-kube-api-access-fdxnk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx\" (UID: \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"
Jul 20 19:19:01.049880 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.049858    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6168aeab-cb96-4c71-95f4-44ca1cf49a89-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx\" (UID: \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"
Jul 20 19:19:01.150251 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.150217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdxnk\" (UniqueName: \"kubernetes.io/projected/6168aeab-cb96-4c71-95f4-44ca1cf49a89-kube-api-access-fdxnk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx\" (UID: \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"
Jul 20 19:19:01.150251 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.150259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6168aeab-cb96-4c71-95f4-44ca1cf49a89-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx\" (UID: \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"
Jul 20 19:19:01.150495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.150293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6168aeab-cb96-4c71-95f4-44ca1cf49a89-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx\" (UID: \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"
Jul 20 19:19:01.150602 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.150586    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6168aeab-cb96-4c71-95f4-44ca1cf49a89-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx\" (UID: \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"
Jul 20 19:19:01.150652 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.150624    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6168aeab-cb96-4c71-95f4-44ca1cf49a89-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx\" (UID: \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"
Jul 20 19:19:01.159208 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.159159    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdxnk\" (UniqueName: \"kubernetes.io/projected/6168aeab-cb96-4c71-95f4-44ca1cf49a89-kube-api-access-fdxnk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx\" (UID: \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"
Jul 20 19:19:01.325873 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.325795    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"
Jul 20 19:19:01.461966 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:01.461936    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"]
Jul 20 19:19:01.464995 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:19:01.464971    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6168aeab_cb96_4c71_95f4_44ca1cf49a89.slice/crio-b04f38aa5d0c201a42d9c52e9ca4efb2ed88496a1665b6f8a8846404c2dda781 WatchSource:0}: Error finding container b04f38aa5d0c201a42d9c52e9ca4efb2ed88496a1665b6f8a8846404c2dda781: Status 404 returned error can't find the container with id b04f38aa5d0c201a42d9c52e9ca4efb2ed88496a1665b6f8a8846404c2dda781
Jul 20 19:19:02.301718 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:02.301680    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx" event={"ID":"6168aeab-cb96-4c71-95f4-44ca1cf49a89","Type":"ContainerStarted","Data":"b04f38aa5d0c201a42d9c52e9ca4efb2ed88496a1665b6f8a8846404c2dda781"}
Jul 20 19:19:08.325304 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:08.325267    2581 generic.go:356] "Generic (PLEG): container finished" podID="6168aeab-cb96-4c71-95f4-44ca1cf49a89" containerID="a3b1814555daa05928aeb32b1a5ad4c68879f5463118c013ad2b65a081208f9e" exitCode=0
Jul 20 19:19:08.325855 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:08.325357    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx" event={"ID":"6168aeab-cb96-4c71-95f4-44ca1cf49a89","Type":"ContainerDied","Data":"a3b1814555daa05928aeb32b1a5ad4c68879f5463118c013ad2b65a081208f9e"}
Jul 20 19:19:11.341728 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:11.341689    2581 generic.go:356] "Generic (PLEG): container finished" podID="6168aeab-cb96-4c71-95f4-44ca1cf49a89" containerID="52886fe576c2607b01668a7033eaef98048c0ec28bf031888b4afadae67095d4" exitCode=0
Jul 20 19:19:11.342101 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:11.341728    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx" event={"ID":"6168aeab-cb96-4c71-95f4-44ca1cf49a89","Type":"ContainerDied","Data":"52886fe576c2607b01668a7033eaef98048c0ec28bf031888b4afadae67095d4"}
Jul 20 19:19:18.371563 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:18.371523    2581 generic.go:356] "Generic (PLEG): container finished" podID="6168aeab-cb96-4c71-95f4-44ca1cf49a89" containerID="1b3095817183070cef4e4aaa73e2e452874ee9f150f8abb6e99bedd4443ef1e3" exitCode=0
Jul 20 19:19:18.371931 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:18.371607    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx" event={"ID":"6168aeab-cb96-4c71-95f4-44ca1cf49a89","Type":"ContainerDied","Data":"1b3095817183070cef4e4aaa73e2e452874ee9f150f8abb6e99bedd4443ef1e3"}
Jul 20 19:19:19.498739 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:19.498709    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"
Jul 20 19:19:19.599127 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:19.599095    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6168aeab-cb96-4c71-95f4-44ca1cf49a89-util\") pod \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\" (UID: \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\") "
Jul 20 19:19:19.599315 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:19.599153    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdxnk\" (UniqueName: \"kubernetes.io/projected/6168aeab-cb96-4c71-95f4-44ca1cf49a89-kube-api-access-fdxnk\") pod \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\" (UID: \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\") "
Jul 20 19:19:19.599315 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:19.599180    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6168aeab-cb96-4c71-95f4-44ca1cf49a89-bundle\") pod \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\" (UID: \"6168aeab-cb96-4c71-95f4-44ca1cf49a89\") "
Jul 20 19:19:19.599899 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:19.599875    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6168aeab-cb96-4c71-95f4-44ca1cf49a89-bundle" (OuterVolumeSpecName: "bundle") pod "6168aeab-cb96-4c71-95f4-44ca1cf49a89" (UID: "6168aeab-cb96-4c71-95f4-44ca1cf49a89"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:19:19.601550 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:19.601527    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6168aeab-cb96-4c71-95f4-44ca1cf49a89-kube-api-access-fdxnk" (OuterVolumeSpecName: "kube-api-access-fdxnk") pod "6168aeab-cb96-4c71-95f4-44ca1cf49a89" (UID: "6168aeab-cb96-4c71-95f4-44ca1cf49a89"). InnerVolumeSpecName "kube-api-access-fdxnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:19:19.603953 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:19.603923    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6168aeab-cb96-4c71-95f4-44ca1cf49a89-util" (OuterVolumeSpecName: "util") pod "6168aeab-cb96-4c71-95f4-44ca1cf49a89" (UID: "6168aeab-cb96-4c71-95f4-44ca1cf49a89"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:19:19.700152 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:19.700051    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6168aeab-cb96-4c71-95f4-44ca1cf49a89-util\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:19:19.700152 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:19.700098    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdxnk\" (UniqueName: \"kubernetes.io/projected/6168aeab-cb96-4c71-95f4-44ca1cf49a89-kube-api-access-fdxnk\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:19:19.700152 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:19.700110    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6168aeab-cb96-4c71-95f4-44ca1cf49a89-bundle\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:19:20.380736 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:20.380702    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx" event={"ID":"6168aeab-cb96-4c71-95f4-44ca1cf49a89","Type":"ContainerDied","Data":"b04f38aa5d0c201a42d9c52e9ca4efb2ed88496a1665b6f8a8846404c2dda781"}
Jul 20 19:19:20.380901 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:20.380741    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tglbx"
Jul 20 19:19:20.380901 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:20.380753    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b04f38aa5d0c201a42d9c52e9ca4efb2ed88496a1665b6f8a8846404c2dda781"
Jul 20 19:19:22.054247 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:22.054212    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:22.906042 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:22.906006    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:24.030920 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.030884    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t"]
Jul 20 19:19:24.031385 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.031135    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6168aeab-cb96-4c71-95f4-44ca1cf49a89" containerName="pull"
Jul 20 19:19:24.031385 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.031145    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6168aeab-cb96-4c71-95f4-44ca1cf49a89" containerName="pull"
Jul 20 19:19:24.031385 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.031157    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6168aeab-cb96-4c71-95f4-44ca1cf49a89" containerName="util"
Jul 20 19:19:24.031385 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.031163    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6168aeab-cb96-4c71-95f4-44ca1cf49a89" containerName="util"
Jul 20 19:19:24.031385 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.031172    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6168aeab-cb96-4c71-95f4-44ca1cf49a89" containerName="extract"
Jul 20 19:19:24.031385 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.031177    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6168aeab-cb96-4c71-95f4-44ca1cf49a89" containerName="extract"
Jul 20 19:19:24.031385 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.031241    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6168aeab-cb96-4c71-95f4-44ca1cf49a89" containerName="extract"
Jul 20 19:19:24.075921 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.075882    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t"]
Jul 20 19:19:24.076094 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.076001    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t"
Jul 20 19:19:24.080885 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.080855    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 20 19:19:24.081035 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.080934    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:19:24.081035 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.081031    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-k5b8b\""
Jul 20 19:19:24.139893 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.139858    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d77168df-6070-4e2d-be44-424e24fd8cb2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cll7t\" (UID: \"d77168df-6070-4e2d-be44-424e24fd8cb2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t"
Jul 20 19:19:24.140090 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.139910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnjdg\" (UniqueName: \"kubernetes.io/projected/d77168df-6070-4e2d-be44-424e24fd8cb2-kube-api-access-qnjdg\") pod \"cert-manager-operator-controller-manager-55c444bf86-cll7t\" (UID: \"d77168df-6070-4e2d-be44-424e24fd8cb2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t"
Jul 20 19:19:24.240405 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.240374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d77168df-6070-4e2d-be44-424e24fd8cb2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cll7t\" (UID: \"d77168df-6070-4e2d-be44-424e24fd8cb2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t"
Jul 20 19:19:24.240612 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.240422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnjdg\" (UniqueName: \"kubernetes.io/projected/d77168df-6070-4e2d-be44-424e24fd8cb2-kube-api-access-qnjdg\") pod \"cert-manager-operator-controller-manager-55c444bf86-cll7t\" (UID: \"d77168df-6070-4e2d-be44-424e24fd8cb2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t"
Jul 20 19:19:24.240825 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.240803    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d77168df-6070-4e2d-be44-424e24fd8cb2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cll7t\" (UID: \"d77168df-6070-4e2d-be44-424e24fd8cb2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t"
Jul 20 19:19:24.252176 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.252147    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnjdg\" (UniqueName: \"kubernetes.io/projected/d77168df-6070-4e2d-be44-424e24fd8cb2-kube-api-access-qnjdg\") pod \"cert-manager-operator-controller-manager-55c444bf86-cll7t\" (UID: \"d77168df-6070-4e2d-be44-424e24fd8cb2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t"
Jul 20 19:19:24.384853 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.384819    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t"
Jul 20 19:19:24.542311 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:24.542283    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t"]
Jul 20 19:19:24.545237 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:19:24.545182    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77168df_6070_4e2d_be44_424e24fd8cb2.slice/crio-0aab7f2d2410017c55ac6dd741daf9313fd44b620b954c8aece2f364d8533b2a WatchSource:0}: Error finding container 0aab7f2d2410017c55ac6dd741daf9313fd44b620b954c8aece2f364d8533b2a: Status 404 returned error can't find the container with id 0aab7f2d2410017c55ac6dd741daf9313fd44b620b954c8aece2f364d8533b2a
Jul 20 19:19:25.400335 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:25.400297    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t" event={"ID":"d77168df-6070-4e2d-be44-424e24fd8cb2","Type":"ContainerStarted","Data":"0aab7f2d2410017c55ac6dd741daf9313fd44b620b954c8aece2f364d8533b2a"}
Jul 20 19:19:25.742794 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:25.742698    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:25.842825 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:25.842770    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:28.313239 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.313179    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:28.413580 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.413539    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t" event={"ID":"d77168df-6070-4e2d-be44-424e24fd8cb2","Type":"ContainerStarted","Data":"c234f24a6e026c20dad0f7580199e02fbf8d4c4d3d6b9c28c10f4b50448ba9bb"}
Jul 20 19:19:28.427514 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.427486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:28.465299 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.465222    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cll7t" podStartSLOduration=2.576664262 podStartE2EDuration="5.465205801s" totalImagesPullingTime="2.888541539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:19:28.461915073 +0000 UTC m=+254.685542265" watchObservedRunningTime="2026-07-20 19:19:28.465205801 +0000 UTC m=+254.688832989"
Jul 20 19:19:28.532718 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.532684    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h6f2r"]
Jul 20 19:19:28.534963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.534948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h6f2r"
Jul 20 19:19:28.537914 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.537890    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 19:19:28.538037 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.537928    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 19:19:28.538612 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.538592    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xkvrp\""
Jul 20 19:19:28.547929 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.547907    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h6f2r"]
Jul 20 19:19:28.681282 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.681253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szwml\" (UniqueName: \"kubernetes.io/projected/96456379-be96-4955-913c-9d2c91df38bc-kube-api-access-szwml\") pod \"cert-manager-webhook-6486ffd997-h6f2r\" (UID: \"96456379-be96-4955-913c-9d2c91df38bc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h6f2r"
Jul 20 19:19:28.681444 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.681326    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96456379-be96-4955-913c-9d2c91df38bc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h6f2r\" (UID: \"96456379-be96-4955-913c-9d2c91df38bc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h6f2r"
Jul 20 19:19:28.781676 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.781647    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96456379-be96-4955-913c-9d2c91df38bc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h6f2r\" (UID: \"96456379-be96-4955-913c-9d2c91df38bc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h6f2r"
Jul 20 19:19:28.781806 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.781680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szwml\" (UniqueName: \"kubernetes.io/projected/96456379-be96-4955-913c-9d2c91df38bc-kube-api-access-szwml\") pod \"cert-manager-webhook-6486ffd997-h6f2r\" (UID: \"96456379-be96-4955-913c-9d2c91df38bc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h6f2r"
Jul 20 19:19:28.803629 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.803600    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96456379-be96-4955-913c-9d2c91df38bc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h6f2r\" (UID: \"96456379-be96-4955-913c-9d2c91df38bc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h6f2r"
Jul 20 19:19:28.803896 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.803872    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szwml\" (UniqueName: \"kubernetes.io/projected/96456379-be96-4955-913c-9d2c91df38bc-kube-api-access-szwml\") pod \"cert-manager-webhook-6486ffd997-h6f2r\" (UID: \"96456379-be96-4955-913c-9d2c91df38bc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h6f2r"
Jul 20 19:19:28.855372 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.855336    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h6f2r"
Jul 20 19:19:28.867829 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.867721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:28.994019 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:28.993991    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h6f2r"]
Jul 20 19:19:28.996804 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:19:28.996778    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96456379_be96_4955_913c_9d2c91df38bc.slice/crio-fd67e0b22d1fab6e07438094535d924c9a30be033b51798c41013f1878924aca WatchSource:0}: Error finding container fd67e0b22d1fab6e07438094535d924c9a30be033b51798c41013f1878924aca: Status 404 returned error can't find the container with id fd67e0b22d1fab6e07438094535d924c9a30be033b51798c41013f1878924aca
Jul 20 19:19:29.005380 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.005357    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"]
Jul 20 19:19:29.008047 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.008032    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"
Jul 20 19:19:29.010970 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.010947    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 19:19:29.011264 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.011243    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 19:19:29.011449 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.011434    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cl8sz\""
Jul 20 19:19:29.022921 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.022901    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"]
Jul 20 19:19:29.084113 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.084080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256419fb-700d-4a02-92ad-6d1aac7d2b69-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb\" (UID: \"256419fb-700d-4a02-92ad-6d1aac7d2b69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"
Jul 20 19:19:29.084356 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.084127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nvh6\" (UniqueName: \"kubernetes.io/projected/256419fb-700d-4a02-92ad-6d1aac7d2b69-kube-api-access-9nvh6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb\" (UID: \"256419fb-700d-4a02-92ad-6d1aac7d2b69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"
Jul 20 19:19:29.084356 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.084160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256419fb-700d-4a02-92ad-6d1aac7d2b69-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb\" (UID: \"256419fb-700d-4a02-92ad-6d1aac7d2b69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"
Jul 20 19:19:29.185121 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.185088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256419fb-700d-4a02-92ad-6d1aac7d2b69-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb\" (UID: \"256419fb-700d-4a02-92ad-6d1aac7d2b69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"
Jul 20 19:19:29.185121 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.185127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nvh6\" (UniqueName: \"kubernetes.io/projected/256419fb-700d-4a02-92ad-6d1aac7d2b69-kube-api-access-9nvh6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb\" (UID: \"256419fb-700d-4a02-92ad-6d1aac7d2b69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"
Jul 20 19:19:29.185356 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.185150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256419fb-700d-4a02-92ad-6d1aac7d2b69-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb\" (UID: \"256419fb-700d-4a02-92ad-6d1aac7d2b69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"
Jul 20 19:19:29.185494 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.185476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256419fb-700d-4a02-92ad-6d1aac7d2b69-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb\" (UID: \"256419fb-700d-4a02-92ad-6d1aac7d2b69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"
Jul 20 19:19:29.185546 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.185529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256419fb-700d-4a02-92ad-6d1aac7d2b69-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb\" (UID: \"256419fb-700d-4a02-92ad-6d1aac7d2b69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"
Jul 20 19:19:29.200673 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.200601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nvh6\" (UniqueName: \"kubernetes.io/projected/256419fb-700d-4a02-92ad-6d1aac7d2b69-kube-api-access-9nvh6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb\" (UID: \"256419fb-700d-4a02-92ad-6d1aac7d2b69\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"
Jul 20 19:19:29.317691 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.317649    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"
Jul 20 19:19:29.419578 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.419540    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:29.420510 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.420478    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h6f2r" event={"ID":"96456379-be96-4955-913c-9d2c91df38bc","Type":"ContainerStarted","Data":"fd67e0b22d1fab6e07438094535d924c9a30be033b51798c41013f1878924aca"}
Jul 20 19:19:29.455611 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:29.455541    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"]
Jul 20 19:19:29.458836 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:19:29.458804    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256419fb_700d_4a02_92ad_6d1aac7d2b69.slice/crio-4b82de4ecd5374864c991dd2b5f14c5c3abbd51b4044d75b8212b73a0edab4a6 WatchSource:0}: Error finding container 4b82de4ecd5374864c991dd2b5f14c5c3abbd51b4044d75b8212b73a0edab4a6: Status 404 returned error can't find the container with id 4b82de4ecd5374864c991dd2b5f14c5c3abbd51b4044d75b8212b73a0edab4a6
Jul 20 19:19:30.157533 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:30.157502    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:30.427041 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:30.426965    2581 generic.go:356] "Generic (PLEG): container finished" podID="256419fb-700d-4a02-92ad-6d1aac7d2b69" containerID="9e366997add8a4ae84ef5eaa10fc60a358e5ee346151c52482fb0db18ad08bb5" exitCode=0
Jul 20 19:19:30.427520 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:30.427058    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb" event={"ID":"256419fb-700d-4a02-92ad-6d1aac7d2b69","Type":"ContainerDied","Data":"9e366997add8a4ae84ef5eaa10fc60a358e5ee346151c52482fb0db18ad08bb5"}
Jul 20 19:19:30.427520 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:30.427122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb" event={"ID":"256419fb-700d-4a02-92ad-6d1aac7d2b69","Type":"ContainerStarted","Data":"4b82de4ecd5374864c991dd2b5f14c5c3abbd51b4044d75b8212b73a0edab4a6"}
Jul 20 19:19:30.732401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:30.732311    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:31.875663 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:31.875621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:31.954492 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:31.954447    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:33.444033 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:33.443998    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h6f2r" event={"ID":"96456379-be96-4955-913c-9d2c91df38bc","Type":"ContainerStarted","Data":"505cd5cdde1f05f05b550557bb99bd0e6a16342ebea87f0d759d6643d1883c39"}
Jul 20 19:19:33.444497 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:33.444159    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h6f2r"
Jul 20 19:19:33.445872 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:33.445850    2581 generic.go:356] "Generic (PLEG): container finished" podID="256419fb-700d-4a02-92ad-6d1aac7d2b69" containerID="e3a56defe740f33562cf0386d583543bc811e56a41cf7d980561f6f0e6b32a9e" exitCode=0
Jul 20 19:19:33.445943 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:33.445881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb" event={"ID":"256419fb-700d-4a02-92ad-6d1aac7d2b69","Type":"ContainerDied","Data":"e3a56defe740f33562cf0386d583543bc811e56a41cf7d980561f6f0e6b32a9e"}
Jul 20 19:19:33.465664 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:33.465621    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-h6f2r" podStartSLOduration=1.518442973 podStartE2EDuration="5.465606438s" totalImagesPullingTime="3.947163465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:19:33.464530611 +0000 UTC m=+259.688157792" watchObservedRunningTime="2026-07-20 19:19:33.465606438 +0000 UTC m=+259.689233619"
Jul 20 19:19:34.451837 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:34.451754    2581 generic.go:356] "Generic (PLEG): container finished" podID="256419fb-700d-4a02-92ad-6d1aac7d2b69" containerID="f56c35c57f43a60ae208c1631ecd500dc2f05a04deac30c386946c351aa28fab" exitCode=0
Jul 20 19:19:34.452287 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:34.451839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb" event={"ID":"256419fb-700d-4a02-92ad-6d1aac7d2b69","Type":"ContainerDied","Data":"f56c35c57f43a60ae208c1631ecd500dc2f05a04deac30c386946c351aa28fab"}
Jul 20 19:19:34.870141 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:34.870111    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:34.962162 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:34.962128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:35.580736 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:35.580713    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"
Jul 20 19:19:35.745621 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:35.745533    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nvh6\" (UniqueName: \"kubernetes.io/projected/256419fb-700d-4a02-92ad-6d1aac7d2b69-kube-api-access-9nvh6\") pod \"256419fb-700d-4a02-92ad-6d1aac7d2b69\" (UID: \"256419fb-700d-4a02-92ad-6d1aac7d2b69\") "
Jul 20 19:19:35.745621 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:35.745581    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256419fb-700d-4a02-92ad-6d1aac7d2b69-util\") pod \"256419fb-700d-4a02-92ad-6d1aac7d2b69\" (UID: \"256419fb-700d-4a02-92ad-6d1aac7d2b69\") "
Jul 20 19:19:35.745621 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:35.745624    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256419fb-700d-4a02-92ad-6d1aac7d2b69-bundle\") pod \"256419fb-700d-4a02-92ad-6d1aac7d2b69\" (UID: \"256419fb-700d-4a02-92ad-6d1aac7d2b69\") "
Jul 20 19:19:35.746102 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:35.746064    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256419fb-700d-4a02-92ad-6d1aac7d2b69-bundle" (OuterVolumeSpecName: "bundle") pod "256419fb-700d-4a02-92ad-6d1aac7d2b69" (UID: "256419fb-700d-4a02-92ad-6d1aac7d2b69"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:19:35.747777 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:35.747753    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/256419fb-700d-4a02-92ad-6d1aac7d2b69-kube-api-access-9nvh6" (OuterVolumeSpecName: "kube-api-access-9nvh6") pod "256419fb-700d-4a02-92ad-6d1aac7d2b69" (UID: "256419fb-700d-4a02-92ad-6d1aac7d2b69"). InnerVolumeSpecName "kube-api-access-9nvh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:19:35.750682 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:35.750644    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256419fb-700d-4a02-92ad-6d1aac7d2b69-util" (OuterVolumeSpecName: "util") pod "256419fb-700d-4a02-92ad-6d1aac7d2b69" (UID: "256419fb-700d-4a02-92ad-6d1aac7d2b69"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:19:35.846984 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:35.846937    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nvh6\" (UniqueName: \"kubernetes.io/projected/256419fb-700d-4a02-92ad-6d1aac7d2b69-kube-api-access-9nvh6\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:19:35.846984 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:35.846973    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256419fb-700d-4a02-92ad-6d1aac7d2b69-util\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:19:35.846984 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:35.846984    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256419fb-700d-4a02-92ad-6d1aac7d2b69-bundle\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:19:36.461735 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:36.461708    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb"
Jul 20 19:19:36.461905 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:36.461712    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw9pcb" event={"ID":"256419fb-700d-4a02-92ad-6d1aac7d2b69","Type":"ContainerDied","Data":"4b82de4ecd5374864c991dd2b5f14c5c3abbd51b4044d75b8212b73a0edab4a6"}
Jul 20 19:19:36.461905 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:36.461825    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b82de4ecd5374864c991dd2b5f14c5c3abbd51b4044d75b8212b73a0edab4a6"
Jul 20 19:19:39.453980 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:39.453951    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h6f2r"
Jul 20 19:19:39.527338 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:39.527307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:39.800327 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:39.800242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:39.898138 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:39.898103    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:41.815077 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.815046    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp"]
Jul 20 19:19:41.815552 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.815428    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256419fb-700d-4a02-92ad-6d1aac7d2b69" containerName="pull"
Jul 20 19:19:41.815552 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.815445    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="256419fb-700d-4a02-92ad-6d1aac7d2b69" containerName="pull"
Jul 20 19:19:41.815552 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.815474    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256419fb-700d-4a02-92ad-6d1aac7d2b69" containerName="extract"
Jul 20 19:19:41.815552 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.815483    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="256419fb-700d-4a02-92ad-6d1aac7d2b69" containerName="extract"
Jul 20 19:19:41.815552 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.815499    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256419fb-700d-4a02-92ad-6d1aac7d2b69" containerName="util"
Jul 20 19:19:41.815552 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.815507    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="256419fb-700d-4a02-92ad-6d1aac7d2b69" containerName="util"
Jul 20 19:19:41.815854 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.815567    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="256419fb-700d-4a02-92ad-6d1aac7d2b69" containerName="extract"
Jul 20 19:19:41.817569 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.817550    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp"
Jul 20 19:19:41.820913 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.820893    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 19:19:41.821034 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.820943    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:19:41.821034 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.820893    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-sdz8l\""
Jul 20 19:19:41.833670 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.833644    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp"]
Jul 20 19:19:41.995474 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.995439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zjh6\" (UniqueName: \"kubernetes.io/projected/480db2ea-0271-49ff-9c19-4fc50f9e8e38-kube-api-access-7zjh6\") pod \"openshift-lws-operator-fd8ccff4c-dhxbp\" (UID: \"480db2ea-0271-49ff-9c19-4fc50f9e8e38\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp"
Jul 20 19:19:41.995650 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:41.995529    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/480db2ea-0271-49ff-9c19-4fc50f9e8e38-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dhxbp\" (UID: \"480db2ea-0271-49ff-9c19-4fc50f9e8e38\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp"
Jul 20 19:19:42.096480 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:42.096454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zjh6\" (UniqueName: \"kubernetes.io/projected/480db2ea-0271-49ff-9c19-4fc50f9e8e38-kube-api-access-7zjh6\") pod \"openshift-lws-operator-fd8ccff4c-dhxbp\" (UID: \"480db2ea-0271-49ff-9c19-4fc50f9e8e38\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp"
Jul 20 19:19:42.096630 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:42.096489    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/480db2ea-0271-49ff-9c19-4fc50f9e8e38-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dhxbp\" (UID: \"480db2ea-0271-49ff-9c19-4fc50f9e8e38\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp"
Jul 20 19:19:42.096824 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:42.096810    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/480db2ea-0271-49ff-9c19-4fc50f9e8e38-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dhxbp\" (UID: \"480db2ea-0271-49ff-9c19-4fc50f9e8e38\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp"
Jul 20 19:19:42.106256 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:42.106231    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zjh6\" (UniqueName: \"kubernetes.io/projected/480db2ea-0271-49ff-9c19-4fc50f9e8e38-kube-api-access-7zjh6\") pod \"openshift-lws-operator-fd8ccff4c-dhxbp\" (UID: \"480db2ea-0271-49ff-9c19-4fc50f9e8e38\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp"
Jul 20 19:19:42.126963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:42.126933    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp"
Jul 20 19:19:42.254610 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:42.254585    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp"]
Jul 20 19:19:42.487146 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:42.487063    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp" event={"ID":"480db2ea-0271-49ff-9c19-4fc50f9e8e38","Type":"ContainerStarted","Data":"72774ed32f0614a2910b6c018525b4f3cce7a616d0f94e6c9b6e4318c531beff"}
Jul 20 19:19:44.498305 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:44.498270    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp" event={"ID":"480db2ea-0271-49ff-9c19-4fc50f9e8e38","Type":"ContainerStarted","Data":"66ad134fdea6b9059eeb49ac5bd35441abc3e017cf5b257ccd212cf620ea3aba"}
Jul 20 19:19:44.529855 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:44.529727    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dhxbp" podStartSLOduration=1.521772243 podStartE2EDuration="3.52971087s" totalImagesPullingTime="2.007938627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:19:44.528700374 +0000 UTC m=+270.752327555" watchObservedRunningTime="2026-07-20 19:19:44.52971087 +0000 UTC m=+270.753338050"
Jul 20 19:19:45.226901 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:45.226868    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:45.331836 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:45.331800    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:46.400755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:46.400727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:46.989318 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:46.989279    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"]
Jul 20 19:19:46.991784 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:46.991767    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"
Jul 20 19:19:46.994396 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:46.994375    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cl8sz\""
Jul 20 19:19:46.994503 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:46.994400    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 19:19:46.995394 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:46.995378    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 19:19:47.001875 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.001850    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"]
Jul 20 19:19:47.129803 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.129773    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:47.137773 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.137751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w6d6\" (UniqueName: \"kubernetes.io/projected/37c70139-4ddf-47b0-b34d-9d305760b2ac-kube-api-access-4w6d6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc\" (UID: \"37c70139-4ddf-47b0-b34d-9d305760b2ac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"
Jul 20 19:19:47.137871 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.137783    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c70139-4ddf-47b0-b34d-9d305760b2ac-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc\" (UID: \"37c70139-4ddf-47b0-b34d-9d305760b2ac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"
Jul 20 19:19:47.137871 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.137809    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c70139-4ddf-47b0-b34d-9d305760b2ac-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc\" (UID: \"37c70139-4ddf-47b0-b34d-9d305760b2ac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"
Jul 20 19:19:47.238468 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.238426    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w6d6\" (UniqueName: \"kubernetes.io/projected/37c70139-4ddf-47b0-b34d-9d305760b2ac-kube-api-access-4w6d6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc\" (UID: \"37c70139-4ddf-47b0-b34d-9d305760b2ac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"
Jul 20 19:19:47.238667 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.238475    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c70139-4ddf-47b0-b34d-9d305760b2ac-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc\" (UID: \"37c70139-4ddf-47b0-b34d-9d305760b2ac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"
Jul 20 19:19:47.238667 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.238518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c70139-4ddf-47b0-b34d-9d305760b2ac-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc\" (UID: \"37c70139-4ddf-47b0-b34d-9d305760b2ac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"
Jul 20 19:19:47.238936 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.238914    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c70139-4ddf-47b0-b34d-9d305760b2ac-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc\" (UID: \"37c70139-4ddf-47b0-b34d-9d305760b2ac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"
Jul 20 19:19:47.239003 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.238937    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c70139-4ddf-47b0-b34d-9d305760b2ac-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc\" (UID: \"37c70139-4ddf-47b0-b34d-9d305760b2ac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"
Jul 20 19:19:47.248693 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.248627    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w6d6\" (UniqueName: \"kubernetes.io/projected/37c70139-4ddf-47b0-b34d-9d305760b2ac-kube-api-access-4w6d6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc\" (UID: \"37c70139-4ddf-47b0-b34d-9d305760b2ac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"
Jul 20 19:19:47.301572 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.301540    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"
Jul 20 19:19:47.430298 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.430244    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"]
Jul 20 19:19:47.432888 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:19:47.432858    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c70139_4ddf_47b0_b34d_9d305760b2ac.slice/crio-1438330b9a2a394b1453f25c9c9f349e25678bb296fe19f980fe6cb637a71881 WatchSource:0}: Error finding container 1438330b9a2a394b1453f25c9c9f349e25678bb296fe19f980fe6cb637a71881: Status 404 returned error can't find the container with id 1438330b9a2a394b1453f25c9c9f349e25678bb296fe19f980fe6cb637a71881
Jul 20 19:19:47.517771 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.517738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc" event={"ID":"37c70139-4ddf-47b0-b34d-9d305760b2ac","Type":"ContainerStarted","Data":"b724d9261f06a83f6352eb3c943c8f9ab047cdbd66151f6d31b5254b41e835d6"}
Jul 20 19:19:47.517901 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:47.517815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc" event={"ID":"37c70139-4ddf-47b0-b34d-9d305760b2ac","Type":"ContainerStarted","Data":"1438330b9a2a394b1453f25c9c9f349e25678bb296fe19f980fe6cb637a71881"}
Jul 20 19:19:48.523789 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:48.523704    2581 generic.go:356] "Generic (PLEG): container finished" podID="37c70139-4ddf-47b0-b34d-9d305760b2ac" containerID="b724d9261f06a83f6352eb3c943c8f9ab047cdbd66151f6d31b5254b41e835d6" exitCode=0
Jul 20 19:19:48.524158 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:48.523799    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc" event={"ID":"37c70139-4ddf-47b0-b34d-9d305760b2ac","Type":"ContainerDied","Data":"b724d9261f06a83f6352eb3c943c8f9ab047cdbd66151f6d31b5254b41e835d6"}
Jul 20 19:19:49.530226 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:49.530167    2581 generic.go:356] "Generic (PLEG): container finished" podID="37c70139-4ddf-47b0-b34d-9d305760b2ac" containerID="3e581e9ad7f3e221e46333c10047e858b863062c39e0d1fefee09f9a28242845" exitCode=0
Jul 20 19:19:49.530698 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:49.530248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc" event={"ID":"37c70139-4ddf-47b0-b34d-9d305760b2ac","Type":"ContainerDied","Data":"3e581e9ad7f3e221e46333c10047e858b863062c39e0d1fefee09f9a28242845"}
Jul 20 19:19:50.535890 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:50.535847    2581 generic.go:356] "Generic (PLEG): container finished" podID="37c70139-4ddf-47b0-b34d-9d305760b2ac" containerID="3a0c5ae5e4bd01a98fa7d77215ac90864fe090b09c59787b79a7ceaedc0b2900" exitCode=0
Jul 20 19:19:50.536353 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:50.535898    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc" event={"ID":"37c70139-4ddf-47b0-b34d-9d305760b2ac","Type":"ContainerDied","Data":"3a0c5ae5e4bd01a98fa7d77215ac90864fe090b09c59787b79a7ceaedc0b2900"}
Jul 20 19:19:51.672330 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:51.672305    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"
Jul 20 19:19:51.692690 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:51.692661    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w6d6\" (UniqueName: \"kubernetes.io/projected/37c70139-4ddf-47b0-b34d-9d305760b2ac-kube-api-access-4w6d6\") pod \"37c70139-4ddf-47b0-b34d-9d305760b2ac\" (UID: \"37c70139-4ddf-47b0-b34d-9d305760b2ac\") "
Jul 20 19:19:51.692847 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:51.692701    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c70139-4ddf-47b0-b34d-9d305760b2ac-util\") pod \"37c70139-4ddf-47b0-b34d-9d305760b2ac\" (UID: \"37c70139-4ddf-47b0-b34d-9d305760b2ac\") "
Jul 20 19:19:51.692847 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:51.692724    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c70139-4ddf-47b0-b34d-9d305760b2ac-bundle\") pod \"37c70139-4ddf-47b0-b34d-9d305760b2ac\" (UID: \"37c70139-4ddf-47b0-b34d-9d305760b2ac\") "
Jul 20 19:19:51.693498 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:51.693472    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37c70139-4ddf-47b0-b34d-9d305760b2ac-bundle" (OuterVolumeSpecName: "bundle") pod "37c70139-4ddf-47b0-b34d-9d305760b2ac" (UID: "37c70139-4ddf-47b0-b34d-9d305760b2ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:19:51.695211 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:51.695168    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37c70139-4ddf-47b0-b34d-9d305760b2ac-kube-api-access-4w6d6" (OuterVolumeSpecName: "kube-api-access-4w6d6") pod "37c70139-4ddf-47b0-b34d-9d305760b2ac" (UID: "37c70139-4ddf-47b0-b34d-9d305760b2ac"). InnerVolumeSpecName "kube-api-access-4w6d6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:19:51.698424 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:51.698399    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37c70139-4ddf-47b0-b34d-9d305760b2ac-util" (OuterVolumeSpecName: "util") pod "37c70139-4ddf-47b0-b34d-9d305760b2ac" (UID: "37c70139-4ddf-47b0-b34d-9d305760b2ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:19:51.793768 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:51.793679    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w6d6\" (UniqueName: \"kubernetes.io/projected/37c70139-4ddf-47b0-b34d-9d305760b2ac-kube-api-access-4w6d6\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:19:51.793768 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:51.793707    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c70139-4ddf-47b0-b34d-9d305760b2ac-util\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:19:51.793768 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:51.793716    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c70139-4ddf-47b0-b34d-9d305760b2ac-bundle\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:19:52.552331 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:52.552233    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc" event={"ID":"37c70139-4ddf-47b0-b34d-9d305760b2ac","Type":"ContainerDied","Data":"1438330b9a2a394b1453f25c9c9f349e25678bb296fe19f980fe6cb637a71881"}
Jul 20 19:19:52.552331 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:52.552272    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afld6pc"
Jul 20 19:19:52.552331 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:52.552305    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1438330b9a2a394b1453f25c9c9f349e25678bb296fe19f980fe6cb637a71881"
Jul 20 19:19:59.334744 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:59.334708    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:59.439000 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:59.438971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:19:59.944135 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:19:59.944109    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:00.308650 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.308530    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:00.434050 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.433993    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:00.440343 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.440319    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"]
Jul 20 19:20:00.440646 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.440633    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c70139-4ddf-47b0-b34d-9d305760b2ac" containerName="extract"
Jul 20 19:20:00.440688 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.440648    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c70139-4ddf-47b0-b34d-9d305760b2ac" containerName="extract"
Jul 20 19:20:00.440688 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.440658    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c70139-4ddf-47b0-b34d-9d305760b2ac" containerName="pull"
Jul 20 19:20:00.440688 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.440664    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c70139-4ddf-47b0-b34d-9d305760b2ac" containerName="pull"
Jul 20 19:20:00.440688 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.440682    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c70139-4ddf-47b0-b34d-9d305760b2ac" containerName="util"
Jul 20 19:20:00.440860 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.440690    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c70139-4ddf-47b0-b34d-9d305760b2ac" containerName="util"
Jul 20 19:20:00.440860 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.440745    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="37c70139-4ddf-47b0-b34d-9d305760b2ac" containerName="extract"
Jul 20 19:20:00.445149 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.445128    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.449896 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.449874    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 19:20:00.450047 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.449927    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6dd72\""
Jul 20 19:20:00.450116 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.450080    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 19:20:00.450306 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.450290    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 19:20:00.450857 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.450839    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 19:20:00.466978 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.466954    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"]
Jul 20 19:20:00.554896 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.554860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f14b95b-decb-4950-9126-ea19535eec93-webhook-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.555090 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.554904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f14b95b-decb-4950-9126-ea19535eec93-tmp\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.555090 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.554930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f14b95b-decb-4950-9126-ea19535eec93-manifests\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.555090 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.555011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f14b95b-decb-4950-9126-ea19535eec93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.555090 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.555078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpbdt\" (UniqueName: \"kubernetes.io/projected/9f14b95b-decb-4950-9126-ea19535eec93-kube-api-access-mpbdt\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.656263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.656214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f14b95b-decb-4950-9126-ea19535eec93-tmp\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.656467 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.656276    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f14b95b-decb-4950-9126-ea19535eec93-manifests\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.656467 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.656297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f14b95b-decb-4950-9126-ea19535eec93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.656467 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.656329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpbdt\" (UniqueName: \"kubernetes.io/projected/9f14b95b-decb-4950-9126-ea19535eec93-kube-api-access-mpbdt\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.656467 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.656374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f14b95b-decb-4950-9126-ea19535eec93-webhook-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.656737 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.656719    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f14b95b-decb-4950-9126-ea19535eec93-manifests\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.658628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.658605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f14b95b-decb-4950-9126-ea19535eec93-tmp\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.658852 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.658832    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f14b95b-decb-4950-9126-ea19535eec93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.658945 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.658925    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f14b95b-decb-4950-9126-ea19535eec93-webhook-cert\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.667747 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.667725    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpbdt\" (UniqueName: \"kubernetes.io/projected/9f14b95b-decb-4950-9126-ea19535eec93-kube-api-access-mpbdt\") pod \"opendatahub-operator-controller-manager-8569dc75f9-kjghb\" (UID: \"9f14b95b-decb-4950-9126-ea19535eec93\") " pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.707517 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.707485    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:00.755143 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.755112    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:00.806539 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.806024    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:00.901038 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.900900    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"]
Jul 20 19:20:00.903300 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:20:00.903276    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f14b95b_decb_4950_9126_ea19535eec93.slice/crio-d23218b0e2c2c354d2a1c621a33d371fb47083804a66e6a6fc3ad2e759641cd4 WatchSource:0}: Error finding container d23218b0e2c2c354d2a1c621a33d371fb47083804a66e6a6fc3ad2e759641cd4: Status 404 returned error can't find the container with id d23218b0e2c2c354d2a1c621a33d371fb47083804a66e6a6fc3ad2e759641cd4
Jul 20 19:20:00.907277 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:00.907145    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:01.031944 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:01.031913    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:01.130834 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:01.130799    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:01.275023 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:01.274939    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:01.596054 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:01.596018    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb" event={"ID":"9f14b95b-decb-4950-9126-ea19535eec93","Type":"ContainerStarted","Data":"d23218b0e2c2c354d2a1c621a33d371fb47083804a66e6a6fc3ad2e759641cd4"}
Jul 20 19:20:04.612246 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:04.612207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb" event={"ID":"9f14b95b-decb-4950-9126-ea19535eec93","Type":"ContainerStarted","Data":"67af3536514f4ea9b56b235ee8d8764a5fad8a4fd76e115ae8afb2e7bd0378be"}
Jul 20 19:20:05.617939 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:05.617905    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f14b95b-decb-4950-9126-ea19535eec93" containerID="67af3536514f4ea9b56b235ee8d8764a5fad8a4fd76e115ae8afb2e7bd0378be" exitCode=0
Jul 20 19:20:05.618345 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:05.617970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb" event={"ID":"9f14b95b-decb-4950-9126-ea19535eec93","Type":"ContainerDied","Data":"67af3536514f4ea9b56b235ee8d8764a5fad8a4fd76e115ae8afb2e7bd0378be"}
Jul 20 19:20:06.623879 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:06.623826    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb" event={"ID":"9f14b95b-decb-4950-9126-ea19535eec93","Type":"ContainerStarted","Data":"48fb32ebf73d0c361a8e415b37a74e95ce1e48a7b724cfdd6a7567792cd1a7d5"}
Jul 20 19:20:06.624258 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:06.623924    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:06.648370 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:06.648311    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb" podStartSLOduration=2.151859151 podStartE2EDuration="6.6482883s" totalImagesPullingTime="3.488758933s" totalInitContainerRuntime="1.007670216s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:06.64698886 +0000 UTC m=+292.870616041" watchObservedRunningTime="2026-07-20 19:20:06.6482883 +0000 UTC m=+292.871915484"
Jul 20 19:20:11.359667 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:11.359632    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:11.471011 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:11.470973    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:14.137878 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:14.137849    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:20:14.141688 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:14.141654    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 19:20:14.141889 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:14.141872    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:20:17.630685 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:17.630656    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8569dc75f9-kjghb"
Jul 20 19:20:19.520078 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:19.520047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:19.679969 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:19.679941    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:20.082028 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.081990    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"]
Jul 20 19:20:20.086126 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.086107    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.090364 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.090333    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 19:20:20.090481 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.090367    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nf6bd\""
Jul 20 19:20:20.098205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.098174    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 19:20:20.106597 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.106577    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 19:20:20.112716 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.112696    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"]
Jul 20 19:20:20.209888 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.209845    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gs4m\" (UniqueName: \"kubernetes.io/projected/a636f934-b07d-4290-acbb-f7bba984224f-kube-api-access-9gs4m\") pod \"lws-controller-manager-554c775d9-sq7wm\" (UID: \"a636f934-b07d-4290-acbb-f7bba984224f\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.210073 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.209909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a636f934-b07d-4290-acbb-f7bba984224f-manager-config\") pod \"lws-controller-manager-554c775d9-sq7wm\" (UID: \"a636f934-b07d-4290-acbb-f7bba984224f\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.210073 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.209947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a636f934-b07d-4290-acbb-f7bba984224f-cert\") pod \"lws-controller-manager-554c775d9-sq7wm\" (UID: \"a636f934-b07d-4290-acbb-f7bba984224f\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.210073 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.210011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a636f934-b07d-4290-acbb-f7bba984224f-metrics-cert\") pod \"lws-controller-manager-554c775d9-sq7wm\" (UID: \"a636f934-b07d-4290-acbb-f7bba984224f\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.310461 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.310430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a636f934-b07d-4290-acbb-f7bba984224f-cert\") pod \"lws-controller-manager-554c775d9-sq7wm\" (UID: \"a636f934-b07d-4290-acbb-f7bba984224f\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.310461 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.310468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a636f934-b07d-4290-acbb-f7bba984224f-metrics-cert\") pod \"lws-controller-manager-554c775d9-sq7wm\" (UID: \"a636f934-b07d-4290-acbb-f7bba984224f\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.310717 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.310533    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gs4m\" (UniqueName: \"kubernetes.io/projected/a636f934-b07d-4290-acbb-f7bba984224f-kube-api-access-9gs4m\") pod \"lws-controller-manager-554c775d9-sq7wm\" (UID: \"a636f934-b07d-4290-acbb-f7bba984224f\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.310717 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.310584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a636f934-b07d-4290-acbb-f7bba984224f-manager-config\") pod \"lws-controller-manager-554c775d9-sq7wm\" (UID: \"a636f934-b07d-4290-acbb-f7bba984224f\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.310861 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.310820    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:20.311309 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.311291    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a636f934-b07d-4290-acbb-f7bba984224f-manager-config\") pod \"lws-controller-manager-554c775d9-sq7wm\" (UID: \"a636f934-b07d-4290-acbb-f7bba984224f\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.313130 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.313108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a636f934-b07d-4290-acbb-f7bba984224f-metrics-cert\") pod \"lws-controller-manager-554c775d9-sq7wm\" (UID: \"a636f934-b07d-4290-acbb-f7bba984224f\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.313263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.313137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a636f934-b07d-4290-acbb-f7bba984224f-cert\") pod \"lws-controller-manager-554c775d9-sq7wm\" (UID: \"a636f934-b07d-4290-acbb-f7bba984224f\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.336281 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.336174    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gs4m\" (UniqueName: \"kubernetes.io/projected/a636f934-b07d-4290-acbb-f7bba984224f-kube-api-access-9gs4m\") pod \"lws-controller-manager-554c775d9-sq7wm\" (UID: \"a636f934-b07d-4290-acbb-f7bba984224f\") " pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.395555 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.395514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:20.546045 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.546004    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"]
Jul 20 19:20:20.550244 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:20:20.550218    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda636f934_b07d_4290_acbb_f7bba984224f.slice/crio-c6f9dcc3a039aa75256b8bac8643f6009652ae979538f8ae53ecb6754f50fe8a WatchSource:0}: Error finding container c6f9dcc3a039aa75256b8bac8643f6009652ae979538f8ae53ecb6754f50fe8a: Status 404 returned error can't find the container with id c6f9dcc3a039aa75256b8bac8643f6009652ae979538f8ae53ecb6754f50fe8a
Jul 20 19:20:20.552085 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.552068    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:20:20.676276 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.676179    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:20.685000 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.684970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm" event={"ID":"a636f934-b07d-4290-acbb-f7bba984224f","Type":"ContainerStarted","Data":"c6f9dcc3a039aa75256b8bac8643f6009652ae979538f8ae53ecb6754f50fe8a"}
Jul 20 19:20:20.834097 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.834041    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:20.951356 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:20.951264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:21.049352 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:21.049314    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:21.150284 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:21.150256    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:21.751049 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:21.750999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:22.176344 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:22.176311    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:22.271654 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:22.271625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:22.696747 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:22.696710    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm" event={"ID":"a636f934-b07d-4290-acbb-f7bba984224f","Type":"ContainerStarted","Data":"a14234b44b7439543caa37630f9a30b66919c44a8e758de379d063da1c4c047f"}
Jul 20 19:20:22.696937 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:22.696780    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:22.738050 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:22.738002    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm" podStartSLOduration=1.043031162 podStartE2EDuration="2.737986482s" totalImagesPullingTime="1.69495532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:22.736890534 +0000 UTC m=+308.960517715" watchObservedRunningTime="2026-07-20 19:20:22.737986482 +0000 UTC m=+308.961613662"
Jul 20 19:20:23.486029 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:23.486002    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:28.348101 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.348060    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:28.446533 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.446500    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:28.615755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.615671    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"]
Jul 20 19:20:28.620093 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.620074    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.622541 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.622510    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 20 19:20:28.622675 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.622508    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 20 19:20:28.622675 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.622594    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 19:20:28.622675 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.622648    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 19:20:28.623568 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.623552    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 19:20:28.623662 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.623557    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8xt92\""
Jul 20 19:20:28.623662 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.623558    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 20 19:20:28.631658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.631626    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"]
Jul 20 19:20:28.682296 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.682264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e47ff2e-e614-4721-9811-a33b8057690d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.682474 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.682301    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2e47ff2e-e614-4721-9811-a33b8057690d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.682474 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.682334    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e47ff2e-e614-4721-9811-a33b8057690d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.682474 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.682387    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dflx\" (UniqueName: \"kubernetes.io/projected/2e47ff2e-e614-4721-9811-a33b8057690d-kube-api-access-7dflx\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.682474 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.682441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2e47ff2e-e614-4721-9811-a33b8057690d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.682474 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.682468    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2e47ff2e-e614-4721-9811-a33b8057690d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.682674 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.682492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e47ff2e-e614-4721-9811-a33b8057690d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.777409 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.777373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:28.783382 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.783351    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2e47ff2e-e614-4721-9811-a33b8057690d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.783510 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.783393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e47ff2e-e614-4721-9811-a33b8057690d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.783570 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.783515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e47ff2e-e614-4721-9811-a33b8057690d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.783570 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.783554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2e47ff2e-e614-4721-9811-a33b8057690d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.783678 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.783592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e47ff2e-e614-4721-9811-a33b8057690d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.783678 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.783627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dflx\" (UniqueName: \"kubernetes.io/projected/2e47ff2e-e614-4721-9811-a33b8057690d-kube-api-access-7dflx\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.783778 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.783719    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2e47ff2e-e614-4721-9811-a33b8057690d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.784552 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.784526    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2e47ff2e-e614-4721-9811-a33b8057690d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.785971 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.785945    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2e47ff2e-e614-4721-9811-a33b8057690d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.786103 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.786040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e47ff2e-e614-4721-9811-a33b8057690d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.786103 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.786084    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e47ff2e-e614-4721-9811-a33b8057690d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.786208 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.786103    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2e47ff2e-e614-4721-9811-a33b8057690d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.792650 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.792628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dflx\" (UniqueName: \"kubernetes.io/projected/2e47ff2e-e614-4721-9811-a33b8057690d-kube-api-access-7dflx\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.792948 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.792927    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e47ff2e-e614-4721-9811-a33b8057690d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kmp7m\" (UID: \"2e47ff2e-e614-4721-9811-a33b8057690d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:28.929726 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:28.929639    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:29.070978 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:29.070949    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:29.154904 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:20:29.154868    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e47ff2e_e614_4721_9811_a33b8057690d.slice/crio-5fa1cfbb7cc3346edb984f049c73c13033ef8570a782b37cd5b575d9e2371d7f WatchSource:0}: Error finding container 5fa1cfbb7cc3346edb984f049c73c13033ef8570a782b37cd5b575d9e2371d7f: Status 404 returned error can't find the container with id 5fa1cfbb7cc3346edb984f049c73c13033ef8570a782b37cd5b575d9e2371d7f
Jul 20 19:20:29.158506 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:29.158484    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"]
Jul 20 19:20:29.276717 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:29.276624    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:29.731391 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:29.731317    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m" event={"ID":"2e47ff2e-e614-4721-9811-a33b8057690d","Type":"ContainerStarted","Data":"5fa1cfbb7cc3346edb984f049c73c13033ef8570a782b37cd5b575d9e2371d7f"}
Jul 20 19:20:31.297947 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:31.297905    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 20 19:20:31.298371 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:31.297991    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 20 19:20:31.743141 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:31.743108    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m" event={"ID":"2e47ff2e-e614-4721-9811-a33b8057690d","Type":"ContainerStarted","Data":"ae7e881649e3882dfff6ff1735bb833f1c1e9723422e308c9532bc78f8b5624a"}
Jul 20 19:20:31.743362 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:31.743236    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:31.801143 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:31.801090    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m" podStartSLOduration=1.660795816 podStartE2EDuration="3.801075856s" totalImagesPullingTime="2.14028004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:31.801001779 +0000 UTC m=+318.024628957" watchObservedRunningTime="2026-07-20 19:20:31.801075856 +0000 UTC m=+318.024703050"
Jul 20 19:20:32.262390 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.262358    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:32.460255 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.460218    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:32.468342 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.468314    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9"]
Jul 20 19:20:32.471623 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.471608    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9"
Jul 20 19:20:32.475589 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.475571    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 20 19:20:32.475674 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.475651    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-25h4x\""
Jul 20 19:20:32.507615 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.507582    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9"]
Jul 20 19:20:32.621457 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.621426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lw5g\" (UniqueName: \"kubernetes.io/projected/fb9caa89-cbe8-4189-84c1-1ae0ec7597f5-kube-api-access-9lw5g\") pod \"kserve-controller-manager-d6f4b65b8-gn9q9\" (UID: \"fb9caa89-cbe8-4189-84c1-1ae0ec7597f5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9"
Jul 20 19:20:32.621628 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.621479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb9caa89-cbe8-4189-84c1-1ae0ec7597f5-cert\") pod \"kserve-controller-manager-d6f4b65b8-gn9q9\" (UID: \"fb9caa89-cbe8-4189-84c1-1ae0ec7597f5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9"
Jul 20 19:20:32.632835 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.632797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:32.722529 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.722500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb9caa89-cbe8-4189-84c1-1ae0ec7597f5-cert\") pod \"kserve-controller-manager-d6f4b65b8-gn9q9\" (UID: \"fb9caa89-cbe8-4189-84c1-1ae0ec7597f5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9"
Jul 20 19:20:32.722697 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.722613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lw5g\" (UniqueName: \"kubernetes.io/projected/fb9caa89-cbe8-4189-84c1-1ae0ec7597f5-kube-api-access-9lw5g\") pod \"kserve-controller-manager-d6f4b65b8-gn9q9\" (UID: \"fb9caa89-cbe8-4189-84c1-1ae0ec7597f5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9"
Jul 20 19:20:32.725062 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.725044    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb9caa89-cbe8-4189-84c1-1ae0ec7597f5-cert\") pod \"kserve-controller-manager-d6f4b65b8-gn9q9\" (UID: \"fb9caa89-cbe8-4189-84c1-1ae0ec7597f5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9"
Jul 20 19:20:32.732003 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.731975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lw5g\" (UniqueName: \"kubernetes.io/projected/fb9caa89-cbe8-4189-84c1-1ae0ec7597f5-kube-api-access-9lw5g\") pod \"kserve-controller-manager-d6f4b65b8-gn9q9\" (UID: \"fb9caa89-cbe8-4189-84c1-1ae0ec7597f5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9"
Jul 20 19:20:32.732271 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.732246    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:32.749005 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.748984    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmp7m"
Jul 20 19:20:32.782035 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.781997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9"
Jul 20 19:20:32.964893 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:32.964858    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9"]
Jul 20 19:20:32.968117 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:20:32.968091    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb9caa89_cbe8_4189_84c1_1ae0ec7597f5.slice/crio-54a5c2839f395b89cca44a936ee4fa9a198082dc4a6acc43d40bc6c1e6a5198f WatchSource:0}: Error finding container 54a5c2839f395b89cca44a936ee4fa9a198082dc4a6acc43d40bc6c1e6a5198f: Status 404 returned error can't find the container with id 54a5c2839f395b89cca44a936ee4fa9a198082dc4a6acc43d40bc6c1e6a5198f
Jul 20 19:20:33.704005 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:33.703969    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-554c775d9-sq7wm"
Jul 20 19:20:33.725753 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:33.725701    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:33.754503 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:33.754468    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9" event={"ID":"fb9caa89-cbe8-4189-84c1-1ae0ec7597f5","Type":"ContainerStarted","Data":"54a5c2839f395b89cca44a936ee4fa9a198082dc4a6acc43d40bc6c1e6a5198f"}
Jul 20 19:20:33.851448 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:33.851420    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:20:36.770340 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:36.770299    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9" event={"ID":"fb9caa89-cbe8-4189-84c1-1ae0ec7597f5","Type":"ContainerStarted","Data":"b0f5dcea95693bbbdd88ca1146dfb9b96f029ffaa42585b441276a4705c13b1d"}
Jul 20 19:20:36.770713 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:36.770388    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9"
Jul 20 19:20:36.796040 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:20:36.795991    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9" podStartSLOduration=1.784993961 podStartE2EDuration="4.795976941s" totalImagesPullingTime="3.01098298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:20:36.795615583 +0000 UTC m=+323.019242767" watchObservedRunningTime="2026-07-20 19:20:36.795976941 +0000 UTC m=+323.019604122"
Jul 20 19:21:07.780178 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:07.780099    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gn9q9"
Jul 20 19:21:21.012004 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:21.011972    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:21:21.102703 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:21.102671    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:21:21.183654 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:21.183621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:21:36.322228 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.322181    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"]
Jul 20 19:21:36.324966 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.324951    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"
Jul 20 19:21:36.327763 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.327735    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 19:21:36.327900 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.327883    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 19:21:36.328808 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.328789    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z5xgj\""
Jul 20 19:21:36.335673 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.335652    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"]
Jul 20 19:21:36.455577 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.455524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb544841-fb4d-4608-9957-839b920023d1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss\" (UID: \"bb544841-fb4d-4608-9957-839b920023d1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"
Jul 20 19:21:36.455577 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.455590    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb544841-fb4d-4608-9957-839b920023d1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss\" (UID: \"bb544841-fb4d-4608-9957-839b920023d1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"
Jul 20 19:21:36.455799 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.455665    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bfpn\" (UniqueName: \"kubernetes.io/projected/bb544841-fb4d-4608-9957-839b920023d1-kube-api-access-9bfpn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss\" (UID: \"bb544841-fb4d-4608-9957-839b920023d1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"
Jul 20 19:21:36.556564 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.556513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb544841-fb4d-4608-9957-839b920023d1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss\" (UID: \"bb544841-fb4d-4608-9957-839b920023d1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"
Jul 20 19:21:36.556564 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.556579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb544841-fb4d-4608-9957-839b920023d1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss\" (UID: \"bb544841-fb4d-4608-9957-839b920023d1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"
Jul 20 19:21:36.556785 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.556609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bfpn\" (UniqueName: \"kubernetes.io/projected/bb544841-fb4d-4608-9957-839b920023d1-kube-api-access-9bfpn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss\" (UID: \"bb544841-fb4d-4608-9957-839b920023d1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"
Jul 20 19:21:36.557003 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.556980    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb544841-fb4d-4608-9957-839b920023d1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss\" (UID: \"bb544841-fb4d-4608-9957-839b920023d1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"
Jul 20 19:21:36.557046 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.556988    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb544841-fb4d-4608-9957-839b920023d1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss\" (UID: \"bb544841-fb4d-4608-9957-839b920023d1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"
Jul 20 19:21:36.568082 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.568058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bfpn\" (UniqueName: \"kubernetes.io/projected/bb544841-fb4d-4608-9957-839b920023d1-kube-api-access-9bfpn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss\" (UID: \"bb544841-fb4d-4608-9957-839b920023d1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"
Jul 20 19:21:36.633783 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.633742    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"
Jul 20 19:21:36.764427 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:36.764403    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"]
Jul 20 19:21:36.766957 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:21:36.766934    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb544841_fb4d_4608_9957_839b920023d1.slice/crio-8aa844f04c37ecc01435a45c45ec06f2ec161344900a87644561680be69081c8 WatchSource:0}: Error finding container 8aa844f04c37ecc01435a45c45ec06f2ec161344900a87644561680be69081c8: Status 404 returned error can't find the container with id 8aa844f04c37ecc01435a45c45ec06f2ec161344900a87644561680be69081c8
Jul 20 19:21:37.039297 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.039206    2581 generic.go:356] "Generic (PLEG): container finished" podID="bb544841-fb4d-4608-9957-839b920023d1" containerID="b383414e2be0c29f3915794a474139ec71e3b158dd7e8d27252ee08e7d33367a" exitCode=0
Jul 20 19:21:37.039297 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.039249    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss" event={"ID":"bb544841-fb4d-4608-9957-839b920023d1","Type":"ContainerDied","Data":"b383414e2be0c29f3915794a474139ec71e3b158dd7e8d27252ee08e7d33367a"}
Jul 20 19:21:37.039500 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.039307    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss" event={"ID":"bb544841-fb4d-4608-9957-839b920023d1","Type":"ContainerStarted","Data":"8aa844f04c37ecc01435a45c45ec06f2ec161344900a87644561680be69081c8"}
Jul 20 19:21:37.129089 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.129051    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"]
Jul 20 19:21:37.131443 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.131422    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"
Jul 20 19:21:37.141557 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.141536    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"]
Jul 20 19:21:37.262168 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.262130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21337ad5-34c7-4212-851c-a6d141caee6e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd\" (UID: \"21337ad5-34c7-4212-851c-a6d141caee6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"
Jul 20 19:21:37.262168 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.262164    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21337ad5-34c7-4212-851c-a6d141caee6e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd\" (UID: \"21337ad5-34c7-4212-851c-a6d141caee6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"
Jul 20 19:21:37.262398 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.262213    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r59w\" (UniqueName: \"kubernetes.io/projected/21337ad5-34c7-4212-851c-a6d141caee6e-kube-api-access-6r59w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd\" (UID: \"21337ad5-34c7-4212-851c-a6d141caee6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"
Jul 20 19:21:37.362810 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.362778    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21337ad5-34c7-4212-851c-a6d141caee6e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd\" (UID: \"21337ad5-34c7-4212-851c-a6d141caee6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"
Jul 20 19:21:37.362810 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.362810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21337ad5-34c7-4212-851c-a6d141caee6e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd\" (UID: \"21337ad5-34c7-4212-851c-a6d141caee6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"
Jul 20 19:21:37.363259 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.362832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r59w\" (UniqueName: \"kubernetes.io/projected/21337ad5-34c7-4212-851c-a6d141caee6e-kube-api-access-6r59w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd\" (UID: \"21337ad5-34c7-4212-851c-a6d141caee6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"
Jul 20 19:21:37.363259 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.363137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21337ad5-34c7-4212-851c-a6d141caee6e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd\" (UID: \"21337ad5-34c7-4212-851c-a6d141caee6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"
Jul 20 19:21:37.363259 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.363216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21337ad5-34c7-4212-851c-a6d141caee6e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd\" (UID: \"21337ad5-34c7-4212-851c-a6d141caee6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"
Jul 20 19:21:37.372086 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.372069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r59w\" (UniqueName: \"kubernetes.io/projected/21337ad5-34c7-4212-851c-a6d141caee6e-kube-api-access-6r59w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd\" (UID: \"21337ad5-34c7-4212-851c-a6d141caee6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"
Jul 20 19:21:37.439971 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.439942    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"
Jul 20 19:21:37.535905 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.535875    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"]
Jul 20 19:21:37.538941 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.538915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"
Jul 20 19:21:37.550523 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.550488    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"]
Jul 20 19:21:37.575431 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.575401    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"]
Jul 20 19:21:37.577566 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:21:37.577538    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21337ad5_34c7_4212_851c_a6d141caee6e.slice/crio-2c4c1978f55f5b154dbcd6f51ad9b20734e3bd25688e0392b5efdbd6bd7879ae WatchSource:0}: Error finding container 2c4c1978f55f5b154dbcd6f51ad9b20734e3bd25688e0392b5efdbd6bd7879ae: Status 404 returned error can't find the container with id 2c4c1978f55f5b154dbcd6f51ad9b20734e3bd25688e0392b5efdbd6bd7879ae
Jul 20 19:21:37.665935 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.665901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9qdx\" (UniqueName: \"kubernetes.io/projected/d5c90583-595f-4e5d-85c2-01549d3765cd-kube-api-access-d9qdx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967\" (UID: \"d5c90583-595f-4e5d-85c2-01549d3765cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"
Jul 20 19:21:37.666099 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.665950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5c90583-595f-4e5d-85c2-01549d3765cd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967\" (UID: \"d5c90583-595f-4e5d-85c2-01549d3765cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"
Jul 20 19:21:37.666099 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.666027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5c90583-595f-4e5d-85c2-01549d3765cd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967\" (UID: \"d5c90583-595f-4e5d-85c2-01549d3765cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"
Jul 20 19:21:37.766824 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.766786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9qdx\" (UniqueName: \"kubernetes.io/projected/d5c90583-595f-4e5d-85c2-01549d3765cd-kube-api-access-d9qdx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967\" (UID: \"d5c90583-595f-4e5d-85c2-01549d3765cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"
Jul 20 19:21:37.767003 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.766838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5c90583-595f-4e5d-85c2-01549d3765cd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967\" (UID: \"d5c90583-595f-4e5d-85c2-01549d3765cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"
Jul 20 19:21:37.767003 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.766886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5c90583-595f-4e5d-85c2-01549d3765cd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967\" (UID: \"d5c90583-595f-4e5d-85c2-01549d3765cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"
Jul 20 19:21:37.767247 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.767178    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5c90583-595f-4e5d-85c2-01549d3765cd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967\" (UID: \"d5c90583-595f-4e5d-85c2-01549d3765cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"
Jul 20 19:21:37.767325 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.767251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5c90583-595f-4e5d-85c2-01549d3765cd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967\" (UID: \"d5c90583-595f-4e5d-85c2-01549d3765cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"
Jul 20 19:21:37.783208 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.783162    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9qdx\" (UniqueName: \"kubernetes.io/projected/d5c90583-595f-4e5d-85c2-01549d3765cd-kube-api-access-d9qdx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967\" (UID: \"d5c90583-595f-4e5d-85c2-01549d3765cd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"
Jul 20 19:21:37.850167 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.850128    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"
Jul 20 19:21:37.928530 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.927868    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"]
Jul 20 19:21:37.931002 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.930980    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"
Jul 20 19:21:37.941802 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:37.941780    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"]
Jul 20 19:21:38.005059 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.005036    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"]
Jul 20 19:21:38.006850 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:21:38.006823    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c90583_595f_4e5d_85c2_01549d3765cd.slice/crio-e8017dc5b9a849ac394f7bcce8ffcf5039faa4a82d3b619f0ff4b7a7ff81faa3 WatchSource:0}: Error finding container e8017dc5b9a849ac394f7bcce8ffcf5039faa4a82d3b619f0ff4b7a7ff81faa3: Status 404 returned error can't find the container with id e8017dc5b9a849ac394f7bcce8ffcf5039faa4a82d3b619f0ff4b7a7ff81faa3
Jul 20 19:21:38.049171 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.049056    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967" event={"ID":"d5c90583-595f-4e5d-85c2-01549d3765cd","Type":"ContainerStarted","Data":"e8017dc5b9a849ac394f7bcce8ffcf5039faa4a82d3b619f0ff4b7a7ff81faa3"}
Jul 20 19:21:38.050880 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.050852    2581 generic.go:356] "Generic (PLEG): container finished" podID="21337ad5-34c7-4212-851c-a6d141caee6e" containerID="f77b4996174f9fc9a1decef15c40a11be38fb1b94e727118eeb91509bdba8406" exitCode=0
Jul 20 19:21:38.050994 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.050925    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd" event={"ID":"21337ad5-34c7-4212-851c-a6d141caee6e","Type":"ContainerDied","Data":"f77b4996174f9fc9a1decef15c40a11be38fb1b94e727118eeb91509bdba8406"}
Jul 20 19:21:38.050994 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.050965    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd" event={"ID":"21337ad5-34c7-4212-851c-a6d141caee6e","Type":"ContainerStarted","Data":"2c4c1978f55f5b154dbcd6f51ad9b20734e3bd25688e0392b5efdbd6bd7879ae"}
Jul 20 19:21:38.069345 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.069313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjcvr\" (UniqueName: \"kubernetes.io/projected/547beb18-0f38-46d6-a994-a5570edce61a-kube-api-access-jjcvr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747\" (UID: \"547beb18-0f38-46d6-a994-a5570edce61a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"
Jul 20 19:21:38.069493 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.069395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/547beb18-0f38-46d6-a994-a5570edce61a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747\" (UID: \"547beb18-0f38-46d6-a994-a5570edce61a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"
Jul 20 19:21:38.069493 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.069424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/547beb18-0f38-46d6-a994-a5570edce61a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747\" (UID: \"547beb18-0f38-46d6-a994-a5570edce61a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"
Jul 20 19:21:38.170281 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.170251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/547beb18-0f38-46d6-a994-a5570edce61a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747\" (UID: \"547beb18-0f38-46d6-a994-a5570edce61a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"
Jul 20 19:21:38.170368 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.170297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/547beb18-0f38-46d6-a994-a5570edce61a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747\" (UID: \"547beb18-0f38-46d6-a994-a5570edce61a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"
Jul 20 19:21:38.170368 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.170336    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjcvr\" (UniqueName: \"kubernetes.io/projected/547beb18-0f38-46d6-a994-a5570edce61a-kube-api-access-jjcvr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747\" (UID: \"547beb18-0f38-46d6-a994-a5570edce61a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"
Jul 20 19:21:38.170652 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.170632    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/547beb18-0f38-46d6-a994-a5570edce61a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747\" (UID: \"547beb18-0f38-46d6-a994-a5570edce61a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"
Jul 20 19:21:38.170690 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.170671    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/547beb18-0f38-46d6-a994-a5570edce61a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747\" (UID: \"547beb18-0f38-46d6-a994-a5570edce61a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"
Jul 20 19:21:38.179064 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.179045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjcvr\" (UniqueName: \"kubernetes.io/projected/547beb18-0f38-46d6-a994-a5570edce61a-kube-api-access-jjcvr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747\" (UID: \"547beb18-0f38-46d6-a994-a5570edce61a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"
Jul 20 19:21:38.241776 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.241751    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"
Jul 20 19:21:38.371177 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:38.371151    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"]
Jul 20 19:21:38.373329 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:21:38.373307    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod547beb18_0f38_46d6_a994_a5570edce61a.slice/crio-6e1cd0a33ccdcbb4f00ad2a011b5bad1541d381ff4522673bdea378d2779580f WatchSource:0}: Error finding container 6e1cd0a33ccdcbb4f00ad2a011b5bad1541d381ff4522673bdea378d2779580f: Status 404 returned error can't find the container with id 6e1cd0a33ccdcbb4f00ad2a011b5bad1541d381ff4522673bdea378d2779580f
Jul 20 19:21:39.058321 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:39.058286    2581 generic.go:356] "Generic (PLEG): container finished" podID="21337ad5-34c7-4212-851c-a6d141caee6e" containerID="90ad130515c26964881952213111b0430308a26f656d2cf40869706383ea0e6f" exitCode=0
Jul 20 19:21:39.058532 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:39.058388    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd" event={"ID":"21337ad5-34c7-4212-851c-a6d141caee6e","Type":"ContainerDied","Data":"90ad130515c26964881952213111b0430308a26f656d2cf40869706383ea0e6f"}
Jul 20 19:21:39.060020 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:39.060000    2581 generic.go:356] "Generic (PLEG): container finished" podID="547beb18-0f38-46d6-a994-a5570edce61a" containerID="aa371a41bf6f15cf883d8c98839310c1794f62273cd7b4dc28e5bb1bccbcd300" exitCode=0
Jul 20 19:21:39.060099 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:39.060077    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747" event={"ID":"547beb18-0f38-46d6-a994-a5570edce61a","Type":"ContainerDied","Data":"aa371a41bf6f15cf883d8c98839310c1794f62273cd7b4dc28e5bb1bccbcd300"}
Jul 20 19:21:39.060161 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:39.060134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747" event={"ID":"547beb18-0f38-46d6-a994-a5570edce61a","Type":"ContainerStarted","Data":"6e1cd0a33ccdcbb4f00ad2a011b5bad1541d381ff4522673bdea378d2779580f"}
Jul 20 19:21:39.062080 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:39.062058    2581 generic.go:356] "Generic (PLEG): container finished" podID="bb544841-fb4d-4608-9957-839b920023d1" containerID="63f5739c3f011762856f2e196087fd046183d4866be499c03673421b15549c65" exitCode=0
Jul 20 19:21:39.062181 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:39.062153    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss" event={"ID":"bb544841-fb4d-4608-9957-839b920023d1","Type":"ContainerDied","Data":"63f5739c3f011762856f2e196087fd046183d4866be499c03673421b15549c65"}
Jul 20 19:21:39.063770 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:39.063750    2581 generic.go:356] "Generic (PLEG): container finished" podID="d5c90583-595f-4e5d-85c2-01549d3765cd" containerID="94f01f7276d89ef0105bef86d99e7dadb70dd217b7204be1b3a76d0688b4ae1a" exitCode=0
Jul 20 19:21:39.063834 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:39.063790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967" event={"ID":"d5c90583-595f-4e5d-85c2-01549d3765cd","Type":"ContainerDied","Data":"94f01f7276d89ef0105bef86d99e7dadb70dd217b7204be1b3a76d0688b4ae1a"}
Jul 20 19:21:40.071045 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:40.071014    2581 generic.go:356] "Generic (PLEG): container finished" podID="21337ad5-34c7-4212-851c-a6d141caee6e" containerID="b24d6636547a2134012bd8bf804df468cc3c284e7db26b180eab9d46d81017e2" exitCode=0
Jul 20 19:21:40.071490 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:40.071092    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd" event={"ID":"21337ad5-34c7-4212-851c-a6d141caee6e","Type":"ContainerDied","Data":"b24d6636547a2134012bd8bf804df468cc3c284e7db26b180eab9d46d81017e2"}
Jul 20 19:21:40.073329 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:40.073305    2581 generic.go:356] "Generic (PLEG): container finished" podID="bb544841-fb4d-4608-9957-839b920023d1" containerID="3a4c78edb0cba9011f911f098a4633fbf23b3a5b1acada10d7fe528fe3f38ba1" exitCode=0
Jul 20 19:21:40.073464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:40.073371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss" event={"ID":"bb544841-fb4d-4608-9957-839b920023d1","Type":"ContainerDied","Data":"3a4c78edb0cba9011f911f098a4633fbf23b3a5b1acada10d7fe528fe3f38ba1"}
Jul 20 19:21:40.075128 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:40.075108    2581 generic.go:356] "Generic (PLEG): container finished" podID="d5c90583-595f-4e5d-85c2-01549d3765cd" containerID="9b896f5f23ee14aec256fdbc12195a8f7f56bf79cbb04b65f0975ecea810cdf4" exitCode=0
Jul 20 19:21:40.075257 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:40.075151    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967" event={"ID":"d5c90583-595f-4e5d-85c2-01549d3765cd","Type":"ContainerDied","Data":"9b896f5f23ee14aec256fdbc12195a8f7f56bf79cbb04b65f0975ecea810cdf4"}
Jul 20 19:21:41.082438 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.082405    2581 generic.go:356] "Generic (PLEG): container finished" podID="547beb18-0f38-46d6-a994-a5570edce61a" containerID="56947c2376ccdf693393ff269907ffbfc26cfc401a71a1886014fa0b84b7f9f1" exitCode=0
Jul 20 19:21:41.082874 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.082494    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747" event={"ID":"547beb18-0f38-46d6-a994-a5570edce61a","Type":"ContainerDied","Data":"56947c2376ccdf693393ff269907ffbfc26cfc401a71a1886014fa0b84b7f9f1"}
Jul 20 19:21:41.084731 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.084706    2581 generic.go:356] "Generic (PLEG): container finished" podID="d5c90583-595f-4e5d-85c2-01549d3765cd" containerID="a8fc436f0cd33fbc642f1993edf5bb0ae44bb584a6e33da765313e158411126b" exitCode=0
Jul 20 19:21:41.084825 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.084782    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967" event={"ID":"d5c90583-595f-4e5d-85c2-01549d3765cd","Type":"ContainerDied","Data":"a8fc436f0cd33fbc642f1993edf5bb0ae44bb584a6e33da765313e158411126b"}
Jul 20 19:21:41.229530 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.229506    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"
Jul 20 19:21:41.297807 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.297777    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21337ad5-34c7-4212-851c-a6d141caee6e-bundle\") pod \"21337ad5-34c7-4212-851c-a6d141caee6e\" (UID: \"21337ad5-34c7-4212-851c-a6d141caee6e\") "
Jul 20 19:21:41.297952 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.297817    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r59w\" (UniqueName: \"kubernetes.io/projected/21337ad5-34c7-4212-851c-a6d141caee6e-kube-api-access-6r59w\") pod \"21337ad5-34c7-4212-851c-a6d141caee6e\" (UID: \"21337ad5-34c7-4212-851c-a6d141caee6e\") "
Jul 20 19:21:41.297952 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.297871    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21337ad5-34c7-4212-851c-a6d141caee6e-util\") pod \"21337ad5-34c7-4212-851c-a6d141caee6e\" (UID: \"21337ad5-34c7-4212-851c-a6d141caee6e\") "
Jul 20 19:21:41.298436 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.298408    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21337ad5-34c7-4212-851c-a6d141caee6e-bundle" (OuterVolumeSpecName: "bundle") pod "21337ad5-34c7-4212-851c-a6d141caee6e" (UID: "21337ad5-34c7-4212-851c-a6d141caee6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:21:41.300138 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.300114    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21337ad5-34c7-4212-851c-a6d141caee6e-kube-api-access-6r59w" (OuterVolumeSpecName: "kube-api-access-6r59w") pod "21337ad5-34c7-4212-851c-a6d141caee6e" (UID: "21337ad5-34c7-4212-851c-a6d141caee6e"). InnerVolumeSpecName "kube-api-access-6r59w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:21:41.303557 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.303537    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21337ad5-34c7-4212-851c-a6d141caee6e-util" (OuterVolumeSpecName: "util") pod "21337ad5-34c7-4212-851c-a6d141caee6e" (UID: "21337ad5-34c7-4212-851c-a6d141caee6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:21:41.309270 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.309250    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"
Jul 20 19:21:41.398685 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.398606    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bfpn\" (UniqueName: \"kubernetes.io/projected/bb544841-fb4d-4608-9957-839b920023d1-kube-api-access-9bfpn\") pod \"bb544841-fb4d-4608-9957-839b920023d1\" (UID: \"bb544841-fb4d-4608-9957-839b920023d1\") "
Jul 20 19:21:41.398685 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.398673    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb544841-fb4d-4608-9957-839b920023d1-bundle\") pod \"bb544841-fb4d-4608-9957-839b920023d1\" (UID: \"bb544841-fb4d-4608-9957-839b920023d1\") "
Jul 20 19:21:41.398893 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.398700    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb544841-fb4d-4608-9957-839b920023d1-util\") pod \"bb544841-fb4d-4608-9957-839b920023d1\" (UID: \"bb544841-fb4d-4608-9957-839b920023d1\") "
Jul 20 19:21:41.398893 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.398887    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21337ad5-34c7-4212-851c-a6d141caee6e-bundle\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:21:41.399003 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.398903    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r59w\" (UniqueName: \"kubernetes.io/projected/21337ad5-34c7-4212-851c-a6d141caee6e-kube-api-access-6r59w\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:21:41.399003 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.398918    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21337ad5-34c7-4212-851c-a6d141caee6e-util\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:21:41.399303 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.399278    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb544841-fb4d-4608-9957-839b920023d1-bundle" (OuterVolumeSpecName: "bundle") pod "bb544841-fb4d-4608-9957-839b920023d1" (UID: "bb544841-fb4d-4608-9957-839b920023d1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:21:41.400862 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.400840    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb544841-fb4d-4608-9957-839b920023d1-kube-api-access-9bfpn" (OuterVolumeSpecName: "kube-api-access-9bfpn") pod "bb544841-fb4d-4608-9957-839b920023d1" (UID: "bb544841-fb4d-4608-9957-839b920023d1"). InnerVolumeSpecName "kube-api-access-9bfpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:21:41.404098 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.404077    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb544841-fb4d-4608-9957-839b920023d1-util" (OuterVolumeSpecName: "util") pod "bb544841-fb4d-4608-9957-839b920023d1" (UID: "bb544841-fb4d-4608-9957-839b920023d1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:21:41.500046 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.500013    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bfpn\" (UniqueName: \"kubernetes.io/projected/bb544841-fb4d-4608-9957-839b920023d1-kube-api-access-9bfpn\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:21:41.500046 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.500039    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb544841-fb4d-4608-9957-839b920023d1-bundle\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:21:41.500046 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:41.500048    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb544841-fb4d-4608-9957-839b920023d1-util\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:21:42.093575 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.093542    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd" event={"ID":"21337ad5-34c7-4212-851c-a6d141caee6e","Type":"ContainerDied","Data":"2c4c1978f55f5b154dbcd6f51ad9b20734e3bd25688e0392b5efdbd6bd7879ae"}
Jul 20 19:21:42.094013 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.093594    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c4c1978f55f5b154dbcd6f51ad9b20734e3bd25688e0392b5efdbd6bd7879ae"
Jul 20 19:21:42.094013 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.093548    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd"
Jul 20 19:21:42.095674 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.095651    2581 generic.go:356] "Generic (PLEG): container finished" podID="547beb18-0f38-46d6-a994-a5570edce61a" containerID="934890da627816ecf304226196a91f258650fb90a6fe4872957ac3ca54793b04" exitCode=0
Jul 20 19:21:42.095783 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.095730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747" event={"ID":"547beb18-0f38-46d6-a994-a5570edce61a","Type":"ContainerDied","Data":"934890da627816ecf304226196a91f258650fb90a6fe4872957ac3ca54793b04"}
Jul 20 19:21:42.097565 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.097545    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss"
Jul 20 19:21:42.097655 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.097566    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss" event={"ID":"bb544841-fb4d-4608-9957-839b920023d1","Type":"ContainerDied","Data":"8aa844f04c37ecc01435a45c45ec06f2ec161344900a87644561680be69081c8"}
Jul 20 19:21:42.097655 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.097595    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8aa844f04c37ecc01435a45c45ec06f2ec161344900a87644561680be69081c8"
Jul 20 19:21:42.229611 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.229588    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"
Jul 20 19:21:42.305798 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.305765    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5c90583-595f-4e5d-85c2-01549d3765cd-bundle\") pod \"d5c90583-595f-4e5d-85c2-01549d3765cd\" (UID: \"d5c90583-595f-4e5d-85c2-01549d3765cd\") "
Jul 20 19:21:42.305938 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.305858    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5c90583-595f-4e5d-85c2-01549d3765cd-util\") pod \"d5c90583-595f-4e5d-85c2-01549d3765cd\" (UID: \"d5c90583-595f-4e5d-85c2-01549d3765cd\") "
Jul 20 19:21:42.305938 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.305907    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9qdx\" (UniqueName: \"kubernetes.io/projected/d5c90583-595f-4e5d-85c2-01549d3765cd-kube-api-access-d9qdx\") pod \"d5c90583-595f-4e5d-85c2-01549d3765cd\" (UID: \"d5c90583-595f-4e5d-85c2-01549d3765cd\") "
Jul 20 19:21:42.306368 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.306346    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c90583-595f-4e5d-85c2-01549d3765cd-bundle" (OuterVolumeSpecName: "bundle") pod "d5c90583-595f-4e5d-85c2-01549d3765cd" (UID: "d5c90583-595f-4e5d-85c2-01549d3765cd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:21:42.308069 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.308048    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c90583-595f-4e5d-85c2-01549d3765cd-kube-api-access-d9qdx" (OuterVolumeSpecName: "kube-api-access-d9qdx") pod "d5c90583-595f-4e5d-85c2-01549d3765cd" (UID: "d5c90583-595f-4e5d-85c2-01549d3765cd"). InnerVolumeSpecName "kube-api-access-d9qdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:21:42.311099 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.311065    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c90583-595f-4e5d-85c2-01549d3765cd-util" (OuterVolumeSpecName: "util") pod "d5c90583-595f-4e5d-85c2-01549d3765cd" (UID: "d5c90583-595f-4e5d-85c2-01549d3765cd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:21:42.412517 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.407897    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5c90583-595f-4e5d-85c2-01549d3765cd-bundle\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:21:42.412517 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.407930    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5c90583-595f-4e5d-85c2-01549d3765cd-util\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:21:42.412517 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:42.407948    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9qdx\" (UniqueName: \"kubernetes.io/projected/d5c90583-595f-4e5d-85c2-01549d3765cd-kube-api-access-d9qdx\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:21:43.103737 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:43.103705    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967"
Jul 20 19:21:43.103737 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:43.103733    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967" event={"ID":"d5c90583-595f-4e5d-85c2-01549d3765cd","Type":"ContainerDied","Data":"e8017dc5b9a849ac394f7bcce8ffcf5039faa4a82d3b619f0ff4b7a7ff81faa3"}
Jul 20 19:21:43.104135 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:43.103807    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8017dc5b9a849ac394f7bcce8ffcf5039faa4a82d3b619f0ff4b7a7ff81faa3"
Jul 20 19:21:43.236540 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:43.236517    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"
Jul 20 19:21:43.315769 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:43.315739    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjcvr\" (UniqueName: \"kubernetes.io/projected/547beb18-0f38-46d6-a994-a5570edce61a-kube-api-access-jjcvr\") pod \"547beb18-0f38-46d6-a994-a5570edce61a\" (UID: \"547beb18-0f38-46d6-a994-a5570edce61a\") "
Jul 20 19:21:43.315958 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:43.315808    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/547beb18-0f38-46d6-a994-a5570edce61a-util\") pod \"547beb18-0f38-46d6-a994-a5570edce61a\" (UID: \"547beb18-0f38-46d6-a994-a5570edce61a\") "
Jul 20 19:21:43.315958 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:43.315854    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/547beb18-0f38-46d6-a994-a5570edce61a-bundle\") pod \"547beb18-0f38-46d6-a994-a5570edce61a\" (UID: \"547beb18-0f38-46d6-a994-a5570edce61a\") "
Jul 20 19:21:43.316325 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:43.316289    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/547beb18-0f38-46d6-a994-a5570edce61a-bundle" (OuterVolumeSpecName: "bundle") pod "547beb18-0f38-46d6-a994-a5570edce61a" (UID: "547beb18-0f38-46d6-a994-a5570edce61a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:21:43.317932 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:43.317906    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/547beb18-0f38-46d6-a994-a5570edce61a-kube-api-access-jjcvr" (OuterVolumeSpecName: "kube-api-access-jjcvr") pod "547beb18-0f38-46d6-a994-a5570edce61a" (UID: "547beb18-0f38-46d6-a994-a5570edce61a"). InnerVolumeSpecName "kube-api-access-jjcvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:21:43.323634 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:43.323606    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/547beb18-0f38-46d6-a994-a5570edce61a-util" (OuterVolumeSpecName: "util") pod "547beb18-0f38-46d6-a994-a5570edce61a" (UID: "547beb18-0f38-46d6-a994-a5570edce61a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:21:43.416850 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:43.416743    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/547beb18-0f38-46d6-a994-a5570edce61a-util\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:21:43.416850 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:43.416788    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/547beb18-0f38-46d6-a994-a5570edce61a-bundle\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:21:43.416850 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:43.416797    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjcvr\" (UniqueName: \"kubernetes.io/projected/547beb18-0f38-46d6-a994-a5570edce61a-kube-api-access-jjcvr\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:21:44.110775 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:44.110744    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747"
Jul 20 19:21:44.110775 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:44.110768    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747" event={"ID":"547beb18-0f38-46d6-a994-a5570edce61a","Type":"ContainerDied","Data":"6e1cd0a33ccdcbb4f00ad2a011b5bad1541d381ff4522673bdea378d2779580f"}
Jul 20 19:21:44.111262 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:44.110820    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e1cd0a33ccdcbb4f00ad2a011b5bad1541d381ff4522673bdea378d2779580f"
Jul 20 19:21:50.150249 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:50.150220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:21:53.229521 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:53.229491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:21:55.613010 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:55.612974    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:21:57.059880 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:57.059848    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:21:57.938388 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:57.938354    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:21:59.410970 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:21:59.410922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:00.180494 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:00.180458    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:00.757648 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:00.757609    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:01.613980 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:01.613945    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:01.758460 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:01.758430    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:05.068865 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:05.068825    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:05.242400 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:05.242362    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:06.483711 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:06.483680    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:06.569435 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:06.569406    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:12.406331 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:12.406294    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:12.504170 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:12.504138    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:17.262903 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:17.262869    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:17.365267 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:17.365234    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:18.330696 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:18.330653    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:21.956267 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:21.956230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:22.055787 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:22.055754    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:26.157316 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:26.157282    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:26.256486 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:26.256448    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:33.372582 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:33.372549    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:33.471503 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:33.471473    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:37.565011 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:37.564929    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:37.665512 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:37.665486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:41.293888 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:41.293849    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:41.359338 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:41.359311    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:42.360342 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:42.360309    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:42.460323 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:42.460283    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:56.386285 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:56.386252    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:22:56.448112 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:22:56.448069    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:06.275763 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:06.275733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:06.501151 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:06.501108    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:08.763783 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:08.763746    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:08.865538 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:08.865510    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:08.922780 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:08.922754    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:09.134827 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.134794    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:23:09.135087 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135076    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21337ad5-34c7-4212-851c-a6d141caee6e" containerName="extract"
Jul 20 19:23:09.135129 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135088    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="21337ad5-34c7-4212-851c-a6d141caee6e" containerName="extract"
Jul 20 19:23:09.135129 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135099    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb544841-fb4d-4608-9957-839b920023d1" containerName="pull"
Jul 20 19:23:09.135129 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135104    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb544841-fb4d-4608-9957-839b920023d1" containerName="pull"
Jul 20 19:23:09.135129 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135111    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c90583-595f-4e5d-85c2-01549d3765cd" containerName="pull"
Jul 20 19:23:09.135129 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135118    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c90583-595f-4e5d-85c2-01549d3765cd" containerName="pull"
Jul 20 19:23:09.135129 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135126    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21337ad5-34c7-4212-851c-a6d141caee6e" containerName="pull"
Jul 20 19:23:09.135129 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135131    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="21337ad5-34c7-4212-851c-a6d141caee6e" containerName="pull"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135140    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="547beb18-0f38-46d6-a994-a5570edce61a" containerName="util"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135145    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="547beb18-0f38-46d6-a994-a5570edce61a" containerName="util"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135154    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb544841-fb4d-4608-9957-839b920023d1" containerName="util"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135159    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb544841-fb4d-4608-9957-839b920023d1" containerName="util"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135165    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21337ad5-34c7-4212-851c-a6d141caee6e" containerName="util"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135169    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="21337ad5-34c7-4212-851c-a6d141caee6e" containerName="util"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135174    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c90583-595f-4e5d-85c2-01549d3765cd" containerName="extract"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135179    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c90583-595f-4e5d-85c2-01549d3765cd" containerName="extract"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135199    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="547beb18-0f38-46d6-a994-a5570edce61a" containerName="pull"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135204    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="547beb18-0f38-46d6-a994-a5570edce61a" containerName="pull"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135209    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="547beb18-0f38-46d6-a994-a5570edce61a" containerName="extract"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135214    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="547beb18-0f38-46d6-a994-a5570edce61a" containerName="extract"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135220    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb544841-fb4d-4608-9957-839b920023d1" containerName="extract"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135225    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb544841-fb4d-4608-9957-839b920023d1" containerName="extract"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135231    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c90583-595f-4e5d-85c2-01549d3765cd" containerName="util"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135237    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c90583-595f-4e5d-85c2-01549d3765cd" containerName="util"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135294    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb544841-fb4d-4608-9957-839b920023d1" containerName="extract"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135301    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5c90583-595f-4e5d-85c2-01549d3765cd" containerName="extract"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135308    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="21337ad5-34c7-4212-851c-a6d141caee6e" containerName="extract"
Jul 20 19:23:09.135401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.135313    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="547beb18-0f38-46d6-a994-a5570edce61a" containerName="extract"
Jul 20 19:23:09.138179 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.138163    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vg88v"
Jul 20 19:23:09.140672 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.140652    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 19:23:09.140672 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.140662    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z5xgj\""
Jul 20 19:23:09.140844 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.140740    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 19:23:09.141392 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.141379    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 19:23:09.148942 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.148909    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:23:09.159647 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.159611    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:23:09.199172 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.199134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xzv6\" (UniqueName: \"kubernetes.io/projected/172b7df5-5721-4576-bf97-8433d22e0e2f-kube-api-access-2xzv6\") pod \"limitador-limitador-54d6d988d5-vg88v\" (UID: \"172b7df5-5721-4576-bf97-8433d22e0e2f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vg88v"
Jul 20 19:23:09.199343 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.199244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/172b7df5-5721-4576-bf97-8433d22e0e2f-config-file\") pod \"limitador-limitador-54d6d988d5-vg88v\" (UID: \"172b7df5-5721-4576-bf97-8433d22e0e2f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vg88v"
Jul 20 19:23:09.300203 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.300165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/172b7df5-5721-4576-bf97-8433d22e0e2f-config-file\") pod \"limitador-limitador-54d6d988d5-vg88v\" (UID: \"172b7df5-5721-4576-bf97-8433d22e0e2f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vg88v"
Jul 20 19:23:09.300377 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.300259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xzv6\" (UniqueName: \"kubernetes.io/projected/172b7df5-5721-4576-bf97-8433d22e0e2f-kube-api-access-2xzv6\") pod \"limitador-limitador-54d6d988d5-vg88v\" (UID: \"172b7df5-5721-4576-bf97-8433d22e0e2f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vg88v"
Jul 20 19:23:09.300806 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.300785    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/172b7df5-5721-4576-bf97-8433d22e0e2f-config-file\") pod \"limitador-limitador-54d6d988d5-vg88v\" (UID: \"172b7df5-5721-4576-bf97-8433d22e0e2f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vg88v"
Jul 20 19:23:09.308175 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.308152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xzv6\" (UniqueName: \"kubernetes.io/projected/172b7df5-5721-4576-bf97-8433d22e0e2f-kube-api-access-2xzv6\") pod \"limitador-limitador-54d6d988d5-vg88v\" (UID: \"172b7df5-5721-4576-bf97-8433d22e0e2f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vg88v"
Jul 20 19:23:09.450603 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.450503    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vg88v"
Jul 20 19:23:09.586771 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.586609    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:23:09.588978 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:23:09.588955    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172b7df5_5721_4576_bf97_8433d22e0e2f.slice/crio-4bf7649db55f927b78696e512435d12b5a3e8d1cd518c9fbd3193fb3aa521c5e WatchSource:0}: Error finding container 4bf7649db55f927b78696e512435d12b5a3e8d1cd518c9fbd3193fb3aa521c5e: Status 404 returned error can't find the container with id 4bf7649db55f927b78696e512435d12b5a3e8d1cd518c9fbd3193fb3aa521c5e
Jul 20 19:23:09.634845 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.634802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:09.788961 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:09.788862    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:10.514731 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:10.514637    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vg88v" event={"ID":"172b7df5-5721-4576-bf97-8433d22e0e2f","Type":"ContainerStarted","Data":"4bf7649db55f927b78696e512435d12b5a3e8d1cd518c9fbd3193fb3aa521c5e"}
Jul 20 19:23:12.526812 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:12.526779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vg88v" event={"ID":"172b7df5-5721-4576-bf97-8433d22e0e2f","Type":"ContainerStarted","Data":"17789504fede91150c4bda559b7ebf54e56745729ea437e56edbec63cc465f63"}
Jul 20 19:23:12.527335 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:12.526876    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vg88v"
Jul 20 19:23:12.542553 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:12.542508    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vg88v" podStartSLOduration=1.0719442319999999 podStartE2EDuration="3.542492597s" totalImagesPullingTime="2.470548365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:23:12.541654246 +0000 UTC m=+478.765281428" watchObservedRunningTime="2026-07-20 19:23:12.542492597 +0000 UTC m=+478.766119778"
Jul 20 19:23:23.532060 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:23.532031    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vg88v"
Jul 20 19:23:24.692172 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:24.692137    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:24.784809 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:24.784773    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:25.158823 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:25.158771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:36.878817 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:36.878783    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:36.978254 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:36.978202    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:43.389965 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:43.389929    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:43.483787 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:43.483746    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:43.539363 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:43.539335    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:43.719018 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:43.718929    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:46.867069 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:46.867032    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:23:46.964738 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:23:46.964705    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:24:20.446096 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:24:20.446003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:24:20.544026 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:24:20.543999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:24:21.093352 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:24:21.093318    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:24:21.223346 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:24:21.223306    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:24:21.544689 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:24:21.544600    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:24:21.646414 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:24:21.646375    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:24:21.728398 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:24:21.728363    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:24:30.884850 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:24:30.884812    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:24:30.959323 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:24:30.959293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:24:50.012290 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:24:50.012249    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:24:50.371894 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:24:50.371860    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:24:58.040447 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:24:58.040407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:24:58.141467 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:24:58.141432    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:25:00.405145 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:25:00.405106    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:25:01.291948 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:25:01.291912    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:25:14.170337 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:25:14.170295    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:25:14.171000 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:25:14.170982    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:25:21.677097 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:25:21.677054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:25:22.793110 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:25:22.793075    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:25:39.467832 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:25:39.467752    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:25:39.570429 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:25:39.570392    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:25:50.150880 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:25:50.150833    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:25:51.531630 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:25:51.531603    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:25:51.649696 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:25:51.649668    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:25:58.210753 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:25:58.210706    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:25:59.786093 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:25:59.786049    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:26:03.685984 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.685948    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"]
Jul 20 19:26:03.689429 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.689405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.692337 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.692303    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 19:26:03.692444 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.692307    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4pg4h\""
Jul 20 19:26:03.692444 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.692308    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 20 19:26:03.693073 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.693057    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 19:26:03.698657 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.698636    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"]
Jul 20 19:26:03.717702 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.717672    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:26:03.794981 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.794944    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.799271 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.795291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.799271 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.795345    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.799271 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.795395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.799271 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.795429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.799271 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.795497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4tgj\" (UniqueName: \"kubernetes.io/projected/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-kube-api-access-w4tgj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.896563 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.896521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.896563 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.896569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.896821 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.896589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.896821 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.896644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4tgj\" (UniqueName: \"kubernetes.io/projected/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-kube-api-access-w4tgj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.896821 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.896715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.896821 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.896738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.897047 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.896970    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.897047 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.897026    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.897124 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.897083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.899056 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.899026    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.899221 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.899204    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:03.904499 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:03.904481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4tgj\" (UniqueName: \"kubernetes.io/projected/61f59870-ec1c-4dfd-b9fe-8519e119cb1e-kube-api-access-w4tgj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x8l8x\" (UID: \"61f59870-ec1c-4dfd-b9fe-8519e119cb1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:04.000730 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:04.000636    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:04.137726 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:04.137703    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"]
Jul 20 19:26:04.139444 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:26:04.139415    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f59870_ec1c_4dfd_b9fe_8519e119cb1e.slice/crio-74dd23dabcd516b731875a564799bd404819e76f79a70c7dd83986cb16681ec5 WatchSource:0}: Error finding container 74dd23dabcd516b731875a564799bd404819e76f79a70c7dd83986cb16681ec5: Status 404 returned error can't find the container with id 74dd23dabcd516b731875a564799bd404819e76f79a70c7dd83986cb16681ec5
Jul 20 19:26:04.140649 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:04.140632    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:26:04.355086 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:04.355044    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x" event={"ID":"61f59870-ec1c-4dfd-b9fe-8519e119cb1e","Type":"ContainerStarted","Data":"74dd23dabcd516b731875a564799bd404819e76f79a70c7dd83986cb16681ec5"}
Jul 20 19:26:05.362302 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:05.362261    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x" event={"ID":"61f59870-ec1c-4dfd-b9fe-8519e119cb1e","Type":"ContainerStarted","Data":"4cc0ac6c3160c898105527fb64a83075b38493b15859444544650010fed2a73f"}
Jul 20 19:26:05.378876 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:05.378816    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x" podStartSLOduration=1.324459005 podStartE2EDuration="2.378793468s" totalImagesPullingTime="1.054334463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:26:05.378033933 +0000 UTC m=+651.601661115" watchObservedRunningTime="2026-07-20 19:26:05.378793468 +0000 UTC m=+651.602420648"
Jul 20 19:26:05.675577 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:05.675541    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:26:10.987982 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:10.987945    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:26:14.001768 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:14.001725    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:14.002153 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:14.001813    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:14.014292 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:14.014268    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:14.417535 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:14.417506    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x8l8x"
Jul 20 19:26:15.093484 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:15.093446    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:26:18.402356 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:18.402320    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:26:19.646413 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:26:19.646377    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:08.098787 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:27:08.098702    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:08.194623 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:27:08.194589    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:09.210499 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:27:09.210467    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:09.308171 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:27:09.308136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:27:36.386204 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:27:36.386147    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:27:47.081965 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:27:47.081925    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:27:58.068234 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:27:58.068182    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:29:13.920109 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:29:13.920074    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:15.155259 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:29:15.155224    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:28.555510 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:29:28.555477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:37.572159 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:29:37.572119    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:29:50.374940 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:29:50.374908    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:29:55.861238 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:29:55.861175    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:55.961148 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:29:55.961105    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:29:56.091841 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:29:56.091814    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:02.239068 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:30:02.239030    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:02.300971 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:30:02.300938    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:02.381508 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:30:02.381474    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:02.482248 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:30:02.482212    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:02.635990 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:30:02.635957    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:08.565601 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:30:08.565518    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:08.665842 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:30:08.665800    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:30:14.204889 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:30:14.204862    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:30:14.205453 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:30:14.204966    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:30:24.879688 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:30:24.879654    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:30:32.476749 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:30:32.476714    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:30:43.174829 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:30:43.174787    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:30:50.674717 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:30:50.674683    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:31:00.598168 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:31:00.598133    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:31:06.707810 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:31:06.707777    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:08.579077 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:31:08.579045    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:08.680014 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:31:08.679983    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:31:12.971496 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:31:12.971459    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:31:23.670375 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:31:23.670342    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:31:33.669635 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:31:33.669597    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:31:55.276375 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:31:55.276334    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:32:06.780006 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:32:06.779969    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:32:30.280446 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:32:30.280412    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:32:41.084406 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:32:41.084365    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:32:57.386031 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:32:57.386000    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:33:06.787619 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:33:06.787524    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:33:17.194534 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:33:17.194500    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:33:27.185544 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:33:27.185513    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:33:37.174535 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:33:37.174495    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:33:51.248080 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:33:51.248036    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:35:14.236473 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:35:14.236397    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:35:14.237788 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:35:14.237769    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:35:23.782073 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:35:23.782035    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:35:34.378899 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:35:34.378869    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:35:45.482978 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:35:45.482944    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:35:56.615840 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:35:56.615807    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:36:03.689345 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:36:03.689315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:06.883827 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:36:06.883799    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:36:15.618200 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:36:15.618150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:16.999423 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:36:16.999392    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:36:18.179305 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:36:18.179264    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:36:27.175821 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:36:27.175785    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:36:38.490077 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:36:38.490034    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:36:48.584431 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:36:48.584393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:36:56.684633 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:36:56.684594    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:37:05.986968 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:05.986928    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:37:12.688087 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:12.688047    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:37:34.885138 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:34.885058    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:37:44.077404 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:44.077366    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:37:44.999662 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:44.999626    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"]
Jul 20 19:37:45.002794 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.002776    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.005200 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.005167    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-db1ca7e9-kserve-self-signed-certs\""
Jul 20 19:37:45.036366 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.036325    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"]
Jul 20 19:37:45.041630 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.041594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-model-cache\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.041816 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.041656    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-tmp-dir\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.041816 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.041680    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8fx6\" (UniqueName: \"kubernetes.io/projected/869cb827-bfa7-4f65-bff8-43200c2f2a75-kube-api-access-m8fx6\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.041816 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.041723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/869cb827-bfa7-4f65-bff8-43200c2f2a75-tls-certs\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.041816 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.041772    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-home\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.041816 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.041806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-dshm\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.053846 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.053803    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:45.142933 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.142891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/869cb827-bfa7-4f65-bff8-43200c2f2a75-tls-certs\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.143454 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.142952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-home\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.143454 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.142987    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-dshm\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.143454 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.143032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-model-cache\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.143454 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.143078    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-tmp-dir\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.143454 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.143106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8fx6\" (UniqueName: \"kubernetes.io/projected/869cb827-bfa7-4f65-bff8-43200c2f2a75-kube-api-access-m8fx6\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.143658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.143512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-home\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.143658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.143546    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-model-cache\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.143658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.143554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-tmp-dir\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.145337 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.145316    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-dshm\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.145621 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.145602    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/869cb827-bfa7-4f65-bff8-43200c2f2a75-tls-certs\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.152845 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.152826    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8fx6\" (UniqueName: \"kubernetes.io/projected/869cb827-bfa7-4f65-bff8-43200c2f2a75-kube-api-access-m8fx6\") pod \"e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") " pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.312432 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.312331    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:45.447637 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.447609    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"]
Jul 20 19:37:45.449494 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:37:45.449468    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod869cb827_bfa7_4f65_bff8_43200c2f2a75.slice/crio-c2126bc156e9cf1c7c05960fe84a7168fc1c8022b6742b0d6742d32a3606fc1e WatchSource:0}: Error finding container c2126bc156e9cf1c7c05960fe84a7168fc1c8022b6742b0d6742d32a3606fc1e: Status 404 returned error can't find the container with id c2126bc156e9cf1c7c05960fe84a7168fc1c8022b6742b0d6742d32a3606fc1e
Jul 20 19:37:45.753783 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.753748    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6" event={"ID":"869cb827-bfa7-4f65-bff8-43200c2f2a75","Type":"ContainerStarted","Data":"a34799bddd740f7301abdf14a67a79b505e81bb4621b9b03413675112c8da52e"}
Jul 20 19:37:45.753972 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.753791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6" event={"ID":"869cb827-bfa7-4f65-bff8-43200c2f2a75","Type":"ContainerStarted","Data":"c2126bc156e9cf1c7c05960fe84a7168fc1c8022b6742b0d6742d32a3606fc1e"}
Jul 20 19:37:45.774088 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:45.774038    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6" podStartSLOduration=1.774022461 podStartE2EDuration="1.774022461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:37:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:37:45.773142405 +0000 UTC m=+1351.996769587" watchObservedRunningTime="2026-07-20 19:37:45.774022461 +0000 UTC m=+1351.997649643"
Jul 20 19:37:55.312808 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:55.312708    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:55.312808 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:55.312762    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:55.325332 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:55.325311    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:55.814817 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:55.814785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:37:57.019015 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.018980    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b5d977b76-pgtc6"]
Jul 20 19:37:57.022562 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.022541    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.035139 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.035115    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b5d977b76-pgtc6"]
Jul 20 19:37:57.042098 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.042078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d6729cf-493a-4084-a884-319efb717deb-console-serving-cert\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.042339 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.042117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdbnw\" (UniqueName: \"kubernetes.io/projected/3d6729cf-493a-4084-a884-319efb717deb-kube-api-access-pdbnw\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.042339 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.042142    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d6729cf-493a-4084-a884-319efb717deb-service-ca\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.042339 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.042290    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d6729cf-493a-4084-a884-319efb717deb-console-oauth-config\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.042339 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.042333    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d6729cf-493a-4084-a884-319efb717deb-console-config\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.042565 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.042380    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d6729cf-493a-4084-a884-319efb717deb-oauth-serving-cert\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.042565 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.042414    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d6729cf-493a-4084-a884-319efb717deb-trusted-ca-bundle\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.083354 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.083324    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:57.143836 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.143806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d6729cf-493a-4084-a884-319efb717deb-console-oauth-config\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.144024 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.143843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d6729cf-493a-4084-a884-319efb717deb-console-config\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.144024 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.143860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d6729cf-493a-4084-a884-319efb717deb-oauth-serving-cert\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.144024 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.143882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d6729cf-493a-4084-a884-319efb717deb-trusted-ca-bundle\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.144024 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.143915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d6729cf-493a-4084-a884-319efb717deb-console-serving-cert\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.144024 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.143959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbnw\" (UniqueName: \"kubernetes.io/projected/3d6729cf-493a-4084-a884-319efb717deb-kube-api-access-pdbnw\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.144024 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.144003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d6729cf-493a-4084-a884-319efb717deb-service-ca\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.144737 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.144711    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d6729cf-493a-4084-a884-319efb717deb-oauth-serving-cert\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.144849 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.144733    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d6729cf-493a-4084-a884-319efb717deb-console-config\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.144849 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.144735    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d6729cf-493a-4084-a884-319efb717deb-service-ca\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.145100 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.145079    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d6729cf-493a-4084-a884-319efb717deb-trusted-ca-bundle\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.147061 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.147036    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d6729cf-493a-4084-a884-319efb717deb-console-serving-cert\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.147129 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.147041    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d6729cf-493a-4084-a884-319efb717deb-console-oauth-config\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.153413 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.153391    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdbnw\" (UniqueName: \"kubernetes.io/projected/3d6729cf-493a-4084-a884-319efb717deb-kube-api-access-pdbnw\") pod \"console-5b5d977b76-pgtc6\" (UID: \"3d6729cf-493a-4084-a884-319efb717deb\") " pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.185286 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.185248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:57.284144 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.284054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:57.332301 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.332258    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:37:57.470802 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.470779    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b5d977b76-pgtc6"]
Jul 20 19:37:57.473101 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:37:57.473069    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6729cf_493a_4084_a884_319efb717deb.slice/crio-0015e5d59cc9527618390dd4ae49ad2a4c07bbd3ab408d20795bf2b11806b072 WatchSource:0}: Error finding container 0015e5d59cc9527618390dd4ae49ad2a4c07bbd3ab408d20795bf2b11806b072: Status 404 returned error can't find the container with id 0015e5d59cc9527618390dd4ae49ad2a4c07bbd3ab408d20795bf2b11806b072
Jul 20 19:37:57.811361 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.811276    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:57.815243 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.815213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5d977b76-pgtc6" event={"ID":"3d6729cf-493a-4084-a884-319efb717deb","Type":"ContainerStarted","Data":"8b7bac125f0bfcc20be7bea17eb6f39f17fba5dae0e34b5cc4d041ea2c93c54c"}
Jul 20 19:37:57.815377 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.815297    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5d977b76-pgtc6" event={"ID":"3d6729cf-493a-4084-a884-319efb717deb","Type":"ContainerStarted","Data":"0015e5d59cc9527618390dd4ae49ad2a4c07bbd3ab408d20795bf2b11806b072"}
Jul 20 19:37:57.835200 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.835145    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b5d977b76-pgtc6" podStartSLOduration=1.8351313 podStartE2EDuration="1.8351313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:37:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:37:57.83356316 +0000 UTC m=+1364.057190341" watchObservedRunningTime="2026-07-20 19:37:57.8351313 +0000 UTC m=+1364.058758481"
Jul 20 19:37:57.912454 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:57.912422    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:37:58.682940 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:37:58.682902    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:38:03.495399 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.495361    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"]
Jul 20 19:38:03.498775 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.498757    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.508826 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.508806    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-db1ca7e9-kserve-self-signed-certs\""
Jul 20 19:38:03.516901 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.516872    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"]
Jul 20 19:38:03.604422 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.604385    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-home\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.604422 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.604423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-model-cache\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.604641 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.604451    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brg7v\" (UniqueName: \"kubernetes.io/projected/d3158055-27e1-4270-b080-36a54cd1fae8-kube-api-access-brg7v\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.604641 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.604567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-tmp-dir\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.604641 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.604617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-dshm\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.604738 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.604666    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3158055-27e1-4270-b080-36a54cd1fae8-tls-certs\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.654797 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.654757    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:03.705820 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.705790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-tmp-dir\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.705971 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.705836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-dshm\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.705971 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.705953    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3158055-27e1-4270-b080-36a54cd1fae8-tls-certs\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.706084 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.705997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-home\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.706084 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.706026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-model-cache\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.706211 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.706080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brg7v\" (UniqueName: \"kubernetes.io/projected/d3158055-27e1-4270-b080-36a54cd1fae8-kube-api-access-brg7v\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.706211 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.706148    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-tmp-dir\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.706374 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.706350    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-home\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.706436 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.706381    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-model-cache\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.708251 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.708234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-dshm\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.708612 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.708593    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3158055-27e1-4270-b080-36a54cd1fae8-tls-certs\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.714999 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.714976    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brg7v\" (UniqueName: \"kubernetes.io/projected/d3158055-27e1-4270-b080-36a54cd1fae8-kube-api-access-brg7v\") pod \"e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") " pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.807960 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.807869    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:03.947021 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:03.946996    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"]
Jul 20 19:38:03.948318 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:38:03.948286    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3158055_27e1_4270_b080_36a54cd1fae8.slice/crio-eb10e12e46768f980b19c216ba84c005bc52a7cfe6499557e98c619d381e8dc1 WatchSource:0}: Error finding container eb10e12e46768f980b19c216ba84c005bc52a7cfe6499557e98c619d381e8dc1: Status 404 returned error can't find the container with id eb10e12e46768f980b19c216ba84c005bc52a7cfe6499557e98c619d381e8dc1
Jul 20 19:38:04.851644 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:04.851608    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86" event={"ID":"d3158055-27e1-4270-b080-36a54cd1fae8","Type":"ContainerStarted","Data":"671d4ed0aad9579ae0801f7a514e969c0fa3d461af076123f40404181b7a6c33"}
Jul 20 19:38:04.851644 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:04.851649    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86" event={"ID":"d3158055-27e1-4270-b080-36a54cd1fae8","Type":"ContainerStarted","Data":"eb10e12e46768f980b19c216ba84c005bc52a7cfe6499557e98c619d381e8dc1"}
Jul 20 19:38:04.869729 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:04.869674    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86" podStartSLOduration=1.8696569410000001 podStartE2EDuration="1.869656941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:38:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:38:04.868554438 +0000 UTC m=+1371.092181621" watchObservedRunningTime="2026-07-20 19:38:04.869656941 +0000 UTC m=+1371.093284157"
Jul 20 19:38:07.332855 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:07.332813    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:38:07.333374 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:07.332904    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:38:07.337477 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:07.337454    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:38:07.682704 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:07.682604    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:38:07.869870 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:07.869841    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b5d977b76-pgtc6"
Jul 20 19:38:07.927064 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:07.927028    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c97bbb465-v25vn"]
Jul 20 19:38:08.037999 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:08.037923    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:08.141116 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:08.141082    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:08.243728 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:08.243695    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:13.808143 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:13.808087    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:13.808623 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:13.808162    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:13.820933 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:13.820906    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:13.912119 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:13.912090    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:18.491485 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:18.491451    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:18.548538 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:18.548507    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:32.948394 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:32.948332    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c97bbb465-v25vn" podUID="a5861901-5ca8-4a51-895a-cb96daab3536" containerName="console" containerID="cri-o://8cecae653468e4d19b44d979c392335c2fc6453d084c71ff770dcae901613fba" gracePeriod=15
Jul 20 19:38:33.197852 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.197827    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:38:33.268390 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.268287    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5861901-5ca8-4a51-895a-cb96daab3536-console-serving-cert\") pod \"a5861901-5ca8-4a51-895a-cb96daab3536\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") "
Jul 20 19:38:33.268390 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.268366    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tttf5\" (UniqueName: \"kubernetes.io/projected/a5861901-5ca8-4a51-895a-cb96daab3536-kube-api-access-tttf5\") pod \"a5861901-5ca8-4a51-895a-cb96daab3536\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") "
Jul 20 19:38:33.268614 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.268397    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-service-ca\") pod \"a5861901-5ca8-4a51-895a-cb96daab3536\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") "
Jul 20 19:38:33.268614 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.268424    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-trusted-ca-bundle\") pod \"a5861901-5ca8-4a51-895a-cb96daab3536\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") "
Jul 20 19:38:33.268614 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.268472    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5861901-5ca8-4a51-895a-cb96daab3536-console-oauth-config\") pod \"a5861901-5ca8-4a51-895a-cb96daab3536\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") "
Jul 20 19:38:33.268614 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.268496    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-oauth-serving-cert\") pod \"a5861901-5ca8-4a51-895a-cb96daab3536\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") "
Jul 20 19:38:33.268614 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.268539    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-console-config\") pod \"a5861901-5ca8-4a51-895a-cb96daab3536\" (UID: \"a5861901-5ca8-4a51-895a-cb96daab3536\") "
Jul 20 19:38:33.268891 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.268795    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-service-ca" (OuterVolumeSpecName: "service-ca") pod "a5861901-5ca8-4a51-895a-cb96daab3536" (UID: "a5861901-5ca8-4a51-895a-cb96daab3536"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:38:33.269010 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.268980    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a5861901-5ca8-4a51-895a-cb96daab3536" (UID: "a5861901-5ca8-4a51-895a-cb96daab3536"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:38:33.269087 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.269010    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a5861901-5ca8-4a51-895a-cb96daab3536" (UID: "a5861901-5ca8-4a51-895a-cb96daab3536"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:38:33.269087 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.269031    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-console-config" (OuterVolumeSpecName: "console-config") pod "a5861901-5ca8-4a51-895a-cb96daab3536" (UID: "a5861901-5ca8-4a51-895a-cb96daab3536"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:38:33.270644 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.270620    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5861901-5ca8-4a51-895a-cb96daab3536-kube-api-access-tttf5" (OuterVolumeSpecName: "kube-api-access-tttf5") pod "a5861901-5ca8-4a51-895a-cb96daab3536" (UID: "a5861901-5ca8-4a51-895a-cb96daab3536"). InnerVolumeSpecName "kube-api-access-tttf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:38:33.270770 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.270687    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5861901-5ca8-4a51-895a-cb96daab3536-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a5861901-5ca8-4a51-895a-cb96daab3536" (UID: "a5861901-5ca8-4a51-895a-cb96daab3536"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:38:33.271023 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.271005    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5861901-5ca8-4a51-895a-cb96daab3536-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a5861901-5ca8-4a51-895a-cb96daab3536" (UID: "a5861901-5ca8-4a51-895a-cb96daab3536"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:38:33.369575 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.369536    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5861901-5ca8-4a51-895a-cb96daab3536-console-oauth-config\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:33.369575 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.369569    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-oauth-serving-cert\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:33.369575 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.369578    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-console-config\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:33.369575 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.369587    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5861901-5ca8-4a51-895a-cb96daab3536-console-serving-cert\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:33.369845 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.369595    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tttf5\" (UniqueName: \"kubernetes.io/projected/a5861901-5ca8-4a51-895a-cb96daab3536-kube-api-access-tttf5\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:33.369845 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.369606    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:33.369845 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:33.369613    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5861901-5ca8-4a51-895a-cb96daab3536-trusted-ca-bundle\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:34.001937 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:34.001902    2581 generic.go:356] "Generic (PLEG): container finished" podID="a5861901-5ca8-4a51-895a-cb96daab3536" containerID="8cecae653468e4d19b44d979c392335c2fc6453d084c71ff770dcae901613fba" exitCode=0
Jul 20 19:38:34.002394 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:34.001942    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c97bbb465-v25vn"
Jul 20 19:38:34.002394 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:34.001973    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c97bbb465-v25vn" event={"ID":"a5861901-5ca8-4a51-895a-cb96daab3536","Type":"ContainerDied","Data":"8cecae653468e4d19b44d979c392335c2fc6453d084c71ff770dcae901613fba"}
Jul 20 19:38:34.002394 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:34.002028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c97bbb465-v25vn" event={"ID":"a5861901-5ca8-4a51-895a-cb96daab3536","Type":"ContainerDied","Data":"9908ffcfd3570f5f6eec03577cabc493699e9b624db3b38b49602330781f1cc6"}
Jul 20 19:38:34.002394 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:34.002055    2581 scope.go:117] "RemoveContainer" containerID="8cecae653468e4d19b44d979c392335c2fc6453d084c71ff770dcae901613fba"
Jul 20 19:38:34.012759 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:34.012741    2581 scope.go:117] "RemoveContainer" containerID="8cecae653468e4d19b44d979c392335c2fc6453d084c71ff770dcae901613fba"
Jul 20 19:38:34.013031 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:38:34.013010    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cecae653468e4d19b44d979c392335c2fc6453d084c71ff770dcae901613fba\": container with ID starting with 8cecae653468e4d19b44d979c392335c2fc6453d084c71ff770dcae901613fba not found: ID does not exist" containerID="8cecae653468e4d19b44d979c392335c2fc6453d084c71ff770dcae901613fba"
Jul 20 19:38:34.013093 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:34.013040    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cecae653468e4d19b44d979c392335c2fc6453d084c71ff770dcae901613fba"} err="failed to get container status \"8cecae653468e4d19b44d979c392335c2fc6453d084c71ff770dcae901613fba\": rpc error: code = NotFound desc = could not find container \"8cecae653468e4d19b44d979c392335c2fc6453d084c71ff770dcae901613fba\": container with ID starting with 8cecae653468e4d19b44d979c392335c2fc6453d084c71ff770dcae901613fba not found: ID does not exist"
Jul 20 19:38:34.024048 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:34.024021    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c97bbb465-v25vn"]
Jul 20 19:38:34.028034 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:34.028006    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c97bbb465-v25vn"]
Jul 20 19:38:34.265583 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:34.265504    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5861901-5ca8-4a51-895a-cb96daab3536" path="/var/lib/kubelet/pods/a5861901-5ca8-4a51-895a-cb96daab3536/volumes"
Jul 20 19:38:36.719731 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:36.719692    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"]
Jul 20 19:38:36.745410 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:36.745382    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:37.826288 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:37.826236    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"]
Jul 20 19:38:37.849532 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:37.849505    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:38:41.083083 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:41.083048    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:38:51.740607 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:51.740549    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6" podUID="869cb827-bfa7-4f65-bff8-43200c2f2a75" containerName="main" containerID="cri-o://a34799bddd740f7301abdf14a67a79b505e81bb4621b9b03413675112c8da52e" gracePeriod=45
Jul 20 19:38:51.994006 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:51.993950    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:38:52.036407 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.036378    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-model-cache\") pod \"869cb827-bfa7-4f65-bff8-43200c2f2a75\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") "
Jul 20 19:38:52.036593 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.036441    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8fx6\" (UniqueName: \"kubernetes.io/projected/869cb827-bfa7-4f65-bff8-43200c2f2a75-kube-api-access-m8fx6\") pod \"869cb827-bfa7-4f65-bff8-43200c2f2a75\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") "
Jul 20 19:38:52.036593 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.036466    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-tmp-dir\") pod \"869cb827-bfa7-4f65-bff8-43200c2f2a75\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") "
Jul 20 19:38:52.036593 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.036485    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-dshm\") pod \"869cb827-bfa7-4f65-bff8-43200c2f2a75\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") "
Jul 20 19:38:52.036593 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.036518    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-home\") pod \"869cb827-bfa7-4f65-bff8-43200c2f2a75\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") "
Jul 20 19:38:52.036802 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.036602    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/869cb827-bfa7-4f65-bff8-43200c2f2a75-tls-certs\") pod \"869cb827-bfa7-4f65-bff8-43200c2f2a75\" (UID: \"869cb827-bfa7-4f65-bff8-43200c2f2a75\") "
Jul 20 19:38:52.036802 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.036707    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-model-cache" (OuterVolumeSpecName: "model-cache") pod "869cb827-bfa7-4f65-bff8-43200c2f2a75" (UID: "869cb827-bfa7-4f65-bff8-43200c2f2a75"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:38:52.036933 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.036788    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "869cb827-bfa7-4f65-bff8-43200c2f2a75" (UID: "869cb827-bfa7-4f65-bff8-43200c2f2a75"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:38:52.036933 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.036852    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-home" (OuterVolumeSpecName: "home") pod "869cb827-bfa7-4f65-bff8-43200c2f2a75" (UID: "869cb827-bfa7-4f65-bff8-43200c2f2a75"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:38:52.037008 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.036958    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-model-cache\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:52.037008 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.036979    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-tmp-dir\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:52.037008 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.036993    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-home\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:52.038955 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.038925    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/869cb827-bfa7-4f65-bff8-43200c2f2a75-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "869cb827-bfa7-4f65-bff8-43200c2f2a75" (UID: "869cb827-bfa7-4f65-bff8-43200c2f2a75"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:38:52.039063 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.038992    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/869cb827-bfa7-4f65-bff8-43200c2f2a75-kube-api-access-m8fx6" (OuterVolumeSpecName: "kube-api-access-m8fx6") pod "869cb827-bfa7-4f65-bff8-43200c2f2a75" (UID: "869cb827-bfa7-4f65-bff8-43200c2f2a75"). InnerVolumeSpecName "kube-api-access-m8fx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:38:52.039063 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.038998    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-dshm" (OuterVolumeSpecName: "dshm") pod "869cb827-bfa7-4f65-bff8-43200c2f2a75" (UID: "869cb827-bfa7-4f65-bff8-43200c2f2a75"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:38:52.093827 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.093795    2581 generic.go:356] "Generic (PLEG): container finished" podID="869cb827-bfa7-4f65-bff8-43200c2f2a75" containerID="a34799bddd740f7301abdf14a67a79b505e81bb4621b9b03413675112c8da52e" exitCode=0
Jul 20 19:38:52.093995 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.093832    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"
Jul 20 19:38:52.093995 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.093837    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6" event={"ID":"869cb827-bfa7-4f65-bff8-43200c2f2a75","Type":"ContainerDied","Data":"a34799bddd740f7301abdf14a67a79b505e81bb4621b9b03413675112c8da52e"}
Jul 20 19:38:52.093995 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.093927    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6" event={"ID":"869cb827-bfa7-4f65-bff8-43200c2f2a75","Type":"ContainerDied","Data":"c2126bc156e9cf1c7c05960fe84a7168fc1c8022b6742b0d6742d32a3606fc1e"}
Jul 20 19:38:52.093995 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.093943    2581 scope.go:117] "RemoveContainer" containerID="a34799bddd740f7301abdf14a67a79b505e81bb4621b9b03413675112c8da52e"
Jul 20 19:38:52.103105 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.103090    2581 scope.go:117] "RemoveContainer" containerID="a34799bddd740f7301abdf14a67a79b505e81bb4621b9b03413675112c8da52e"
Jul 20 19:38:52.103366 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:38:52.103347    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a34799bddd740f7301abdf14a67a79b505e81bb4621b9b03413675112c8da52e\": container with ID starting with a34799bddd740f7301abdf14a67a79b505e81bb4621b9b03413675112c8da52e not found: ID does not exist" containerID="a34799bddd740f7301abdf14a67a79b505e81bb4621b9b03413675112c8da52e"
Jul 20 19:38:52.103443 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.103378    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a34799bddd740f7301abdf14a67a79b505e81bb4621b9b03413675112c8da52e"} err="failed to get container status \"a34799bddd740f7301abdf14a67a79b505e81bb4621b9b03413675112c8da52e\": rpc error: code = NotFound desc = could not find container \"a34799bddd740f7301abdf14a67a79b505e81bb4621b9b03413675112c8da52e\": container with ID starting with a34799bddd740f7301abdf14a67a79b505e81bb4621b9b03413675112c8da52e not found: ID does not exist"
Jul 20 19:38:52.116419 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.116392    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"]
Jul 20 19:38:52.123067 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.123045    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-db1ca7e9-kserve-9df9cff47-468r6"]
Jul 20 19:38:52.138198 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.138166    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8fx6\" (UniqueName: \"kubernetes.io/projected/869cb827-bfa7-4f65-bff8-43200c2f2a75-kube-api-access-m8fx6\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:52.138275 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.138222    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/869cb827-bfa7-4f65-bff8-43200c2f2a75-dshm\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:52.138275 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.138237    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/869cb827-bfa7-4f65-bff8-43200c2f2a75-tls-certs\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:52.265912 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.265815    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="869cb827-bfa7-4f65-bff8-43200c2f2a75" path="/var/lib/kubelet/pods/869cb827-bfa7-4f65-bff8-43200c2f2a75/volumes"
Jul 20 19:38:52.846641 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:52.846601    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86" podUID="d3158055-27e1-4270-b080-36a54cd1fae8" containerName="main" containerID="cri-o://671d4ed0aad9579ae0801f7a514e969c0fa3d461af076123f40404181b7a6c33" gracePeriod=45
Jul 20 19:38:53.097591 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.097529    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:53.099265 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.099239    2581 generic.go:356] "Generic (PLEG): container finished" podID="d3158055-27e1-4270-b080-36a54cd1fae8" containerID="671d4ed0aad9579ae0801f7a514e969c0fa3d461af076123f40404181b7a6c33" exitCode=0
Jul 20 19:38:53.099365 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.099275    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"
Jul 20 19:38:53.099365 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.099319    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86" event={"ID":"d3158055-27e1-4270-b080-36a54cd1fae8","Type":"ContainerDied","Data":"671d4ed0aad9579ae0801f7a514e969c0fa3d461af076123f40404181b7a6c33"}
Jul 20 19:38:53.099365 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.099359    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86" event={"ID":"d3158055-27e1-4270-b080-36a54cd1fae8","Type":"ContainerDied","Data":"eb10e12e46768f980b19c216ba84c005bc52a7cfe6499557e98c619d381e8dc1"}
Jul 20 19:38:53.099501 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.099381    2581 scope.go:117] "RemoveContainer" containerID="671d4ed0aad9579ae0801f7a514e969c0fa3d461af076123f40404181b7a6c33"
Jul 20 19:38:53.107692 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.107669    2581 scope.go:117] "RemoveContainer" containerID="671d4ed0aad9579ae0801f7a514e969c0fa3d461af076123f40404181b7a6c33"
Jul 20 19:38:53.107955 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:38:53.107933    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671d4ed0aad9579ae0801f7a514e969c0fa3d461af076123f40404181b7a6c33\": container with ID starting with 671d4ed0aad9579ae0801f7a514e969c0fa3d461af076123f40404181b7a6c33 not found: ID does not exist" containerID="671d4ed0aad9579ae0801f7a514e969c0fa3d461af076123f40404181b7a6c33"
Jul 20 19:38:53.108032 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.107962    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671d4ed0aad9579ae0801f7a514e969c0fa3d461af076123f40404181b7a6c33"} err="failed to get container status \"671d4ed0aad9579ae0801f7a514e969c0fa3d461af076123f40404181b7a6c33\": rpc error: code = NotFound desc = could not find container \"671d4ed0aad9579ae0801f7a514e969c0fa3d461af076123f40404181b7a6c33\": container with ID starting with 671d4ed0aad9579ae0801f7a514e969c0fa3d461af076123f40404181b7a6c33 not found: ID does not exist"
Jul 20 19:38:53.146745 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.146711    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brg7v\" (UniqueName: \"kubernetes.io/projected/d3158055-27e1-4270-b080-36a54cd1fae8-kube-api-access-brg7v\") pod \"d3158055-27e1-4270-b080-36a54cd1fae8\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") "
Jul 20 19:38:53.146927 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.146755    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3158055-27e1-4270-b080-36a54cd1fae8-tls-certs\") pod \"d3158055-27e1-4270-b080-36a54cd1fae8\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") "
Jul 20 19:38:53.146927 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.146795    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-home\") pod \"d3158055-27e1-4270-b080-36a54cd1fae8\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") "
Jul 20 19:38:53.146927 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.146886    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-model-cache\") pod \"d3158055-27e1-4270-b080-36a54cd1fae8\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") "
Jul 20 19:38:53.147102 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.146932    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-tmp-dir\") pod \"d3158055-27e1-4270-b080-36a54cd1fae8\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") "
Jul 20 19:38:53.147102 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.146975    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-dshm\") pod \"d3158055-27e1-4270-b080-36a54cd1fae8\" (UID: \"d3158055-27e1-4270-b080-36a54cd1fae8\") "
Jul 20 19:38:53.147102 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.147067    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-home" (OuterVolumeSpecName: "home") pod "d3158055-27e1-4270-b080-36a54cd1fae8" (UID: "d3158055-27e1-4270-b080-36a54cd1fae8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:38:53.147285 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.147216    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d3158055-27e1-4270-b080-36a54cd1fae8" (UID: "d3158055-27e1-4270-b080-36a54cd1fae8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:38:53.147285 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.147230    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-model-cache" (OuterVolumeSpecName: "model-cache") pod "d3158055-27e1-4270-b080-36a54cd1fae8" (UID: "d3158055-27e1-4270-b080-36a54cd1fae8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:38:53.147378 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.147353    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-home\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:53.147378 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.147370    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-model-cache\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:53.147450 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.147381    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-tmp-dir\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:53.149050 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.149015    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3158055-27e1-4270-b080-36a54cd1fae8-kube-api-access-brg7v" (OuterVolumeSpecName: "kube-api-access-brg7v") pod "d3158055-27e1-4270-b080-36a54cd1fae8" (UID: "d3158055-27e1-4270-b080-36a54cd1fae8"). InnerVolumeSpecName "kube-api-access-brg7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:38:53.149527 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.149511    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-dshm" (OuterVolumeSpecName: "dshm") pod "d3158055-27e1-4270-b080-36a54cd1fae8" (UID: "d3158055-27e1-4270-b080-36a54cd1fae8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:38:53.149584 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.149520    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3158055-27e1-4270-b080-36a54cd1fae8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d3158055-27e1-4270-b080-36a54cd1fae8" (UID: "d3158055-27e1-4270-b080-36a54cd1fae8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:38:53.248130 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.248088    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3158055-27e1-4270-b080-36a54cd1fae8-dshm\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:53.248130 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.248121    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brg7v\" (UniqueName: \"kubernetes.io/projected/d3158055-27e1-4270-b080-36a54cd1fae8-kube-api-access-brg7v\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:53.248130 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.248132    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3158055-27e1-4270-b080-36a54cd1fae8-tls-certs\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:38:53.421901 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.421866    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"]
Jul 20 19:38:53.423720 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:53.423699    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-db1ca7e9-kserve-77757ffdc9-6cj86"]
Jul 20 19:38:54.265912 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:54.265877    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3158055-27e1-4270-b080-36a54cd1fae8" path="/var/lib/kubelet/pods/d3158055-27e1-4270-b080-36a54cd1fae8/volumes"
Jul 20 19:38:54.793476 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:38:54.793443    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:39:01.582567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:39:01.582531    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:39:17.989953 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:39:17.989910    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:39:29.974625 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:39:29.974589    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:39:39.867956 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:39:39.867914    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:39:47.869674 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:39:47.869631    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:39:59.068835 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:39:59.068796    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:40:09.069217 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:40:09.069164    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:40:14.268151 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:40:14.268125    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:40:14.270435 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:40:14.270416    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:40:19.969352 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:40:19.969311    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:40:37.179623 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:40:37.179538    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:40:47.386172 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:40:47.386139    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:40:54.382862 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:40:54.382827    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:41:03.674228 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:41:03.674176    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:41:08.308180 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:41:08.308146    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:41:10.386589 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:41:10.386548    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:41:27.191111 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:41:27.191079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:41:38.982254 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:41:38.982220    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:41:52.072035 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:41:52.071999    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:41:54.825695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:41:54.825659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:02.414839 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:02.414810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:06.171811 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:06.171727    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:42:10.716663 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:10.716629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:14.892281 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:14.892243    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:42:16.218744 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:16.218692    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:19.224270 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:19.224235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:19.312941 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:19.312907    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:19.678974 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:19.678930    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:25.093112 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:25.093071    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:42:25.778778 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:25.778744    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:25.919695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:25.919653    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:26.050859 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:26.050761    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:26.417935 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:26.417903    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:26.752130 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:26.752046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:28.894892 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:28.894855    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:29.043861 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.043826    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:29.051776 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.051745    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"]
Jul 20 19:42:29.052064 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.052053    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3158055-27e1-4270-b080-36a54cd1fae8" containerName="main"
Jul 20 19:42:29.052108 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.052066    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3158055-27e1-4270-b080-36a54cd1fae8" containerName="main"
Jul 20 19:42:29.052108 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.052074    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5861901-5ca8-4a51-895a-cb96daab3536" containerName="console"
Jul 20 19:42:29.052108 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.052079    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5861901-5ca8-4a51-895a-cb96daab3536" containerName="console"
Jul 20 19:42:29.052108 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.052095    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="869cb827-bfa7-4f65-bff8-43200c2f2a75" containerName="main"
Jul 20 19:42:29.052108 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.052100    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="869cb827-bfa7-4f65-bff8-43200c2f2a75" containerName="main"
Jul 20 19:42:29.052277 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.052149    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3158055-27e1-4270-b080-36a54cd1fae8" containerName="main"
Jul 20 19:42:29.052277 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.052159    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="869cb827-bfa7-4f65-bff8-43200c2f2a75" containerName="main"
Jul 20 19:42:29.052277 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.052166    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5861901-5ca8-4a51-895a-cb96daab3536" containerName="console"
Jul 20 19:42:29.055097 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.055082    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:42:29.060167 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.060143    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:42:29.060438 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.060420    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:42:29.060530 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.060421    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-95e08f34-serving-cert\""
Jul 20 19:42:29.060530 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.060424    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hv847\""
Jul 20 19:42:29.068511 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.068479    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"]
Jul 20 19:42:29.157419 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.157318    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-openshift-service-ca\") pod \"maas-api-e2e-ait-95e08f34-8566798759-9fz2w\" (UID: \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:42:29.157419 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.157393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-maas-api-tls\") pod \"maas-api-e2e-ait-95e08f34-8566798759-9fz2w\" (UID: \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:42:29.157637 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.157424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlx9n\" (UniqueName: \"kubernetes.io/projected/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-kube-api-access-jlx9n\") pod \"maas-api-e2e-ait-95e08f34-8566798759-9fz2w\" (UID: \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:42:29.157637 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.157449    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:29.257979 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.257930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlx9n\" (UniqueName: \"kubernetes.io/projected/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-kube-api-access-jlx9n\") pod \"maas-api-e2e-ait-95e08f34-8566798759-9fz2w\" (UID: \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:42:29.258222 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.258000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-openshift-service-ca\") pod \"maas-api-e2e-ait-95e08f34-8566798759-9fz2w\" (UID: \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:42:29.258222 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.258065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-maas-api-tls\") pod \"maas-api-e2e-ait-95e08f34-8566798759-9fz2w\" (UID: \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:42:29.258679 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.258656    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-openshift-service-ca\") pod \"maas-api-e2e-ait-95e08f34-8566798759-9fz2w\" (UID: \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:42:29.260814 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.260789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-maas-api-tls\") pod \"maas-api-e2e-ait-95e08f34-8566798759-9fz2w\" (UID: \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:42:29.273289 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.273259    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlx9n\" (UniqueName: \"kubernetes.io/projected/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-kube-api-access-jlx9n\") pod \"maas-api-e2e-ait-95e08f34-8566798759-9fz2w\" (UID: \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:42:29.296847 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.296815    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:29.365877 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.365850    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:42:29.519136 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.519113    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"]
Jul 20 19:42:29.521254 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:42:29.521228    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63ff4e47_67d6_41a4_b2c6_6bcda97848fe.slice/crio-4d21844d7bf81624f9a242afb14677916fd3272dbb960feec3891b0ad824f137 WatchSource:0}: Error finding container 4d21844d7bf81624f9a242afb14677916fd3272dbb960feec3891b0ad824f137: Status 404 returned error can't find the container with id 4d21844d7bf81624f9a242afb14677916fd3272dbb960feec3891b0ad824f137
Jul 20 19:42:29.522565 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:29.522545    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:42:30.030495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:30.030467    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:30.120479 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:30.120446    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:42:30.164048 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:30.164013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w" event={"ID":"63ff4e47-67d6-41a4-b2c6-6bcda97848fe","Type":"ContainerStarted","Data":"4d21844d7bf81624f9a242afb14677916fd3272dbb960feec3891b0ad824f137"}
Jul 20 19:42:32.176604 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:32.176505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w" event={"ID":"63ff4e47-67d6-41a4-b2c6-6bcda97848fe","Type":"ContainerStarted","Data":"dbbbed2613e8be2b87d359b313a076df8556891c66a382420629c633a06a83df"}
Jul 20 19:42:32.176604 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:32.176568    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:42:36.108856 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:36.108796    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w" podStartSLOduration=4.7364713389999995 podStartE2EDuration="7.108779242s" totalImagesPullingTime="2.372307903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:42:32.2119257 +0000 UTC m=+1638.435552881" watchObservedRunningTime="2026-07-20 19:42:36.108779242 +0000 UTC m=+1642.332406451"
Jul 20 19:42:36.109333 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:36.109000    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:42:38.186697 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:42:38.186665    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:43:04.970973 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:04.970934    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"]
Jul 20 19:43:04.971548 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:04.971208    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w" podUID="63ff4e47-67d6-41a4-b2c6-6bcda97848fe" containerName="maas-api" containerID="cri-o://dbbbed2613e8be2b87d359b313a076df8556891c66a382420629c633a06a83df" gracePeriod=30
Jul 20 19:43:05.033551 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.033519    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:05.212864 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.212841    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:43:05.334636 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.334604    2581 generic.go:356] "Generic (PLEG): container finished" podID="63ff4e47-67d6-41a4-b2c6-6bcda97848fe" containerID="dbbbed2613e8be2b87d359b313a076df8556891c66a382420629c633a06a83df" exitCode=0
Jul 20 19:43:05.334846 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.334652    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"
Jul 20 19:43:05.334846 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.334671    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w" event={"ID":"63ff4e47-67d6-41a4-b2c6-6bcda97848fe","Type":"ContainerDied","Data":"dbbbed2613e8be2b87d359b313a076df8556891c66a382420629c633a06a83df"}
Jul 20 19:43:05.334846 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.334723    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w" event={"ID":"63ff4e47-67d6-41a4-b2c6-6bcda97848fe","Type":"ContainerDied","Data":"4d21844d7bf81624f9a242afb14677916fd3272dbb960feec3891b0ad824f137"}
Jul 20 19:43:05.334846 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.334751    2581 scope.go:117] "RemoveContainer" containerID="dbbbed2613e8be2b87d359b313a076df8556891c66a382420629c633a06a83df"
Jul 20 19:43:05.343147 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.343126    2581 scope.go:117] "RemoveContainer" containerID="dbbbed2613e8be2b87d359b313a076df8556891c66a382420629c633a06a83df"
Jul 20 19:43:05.343402 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:43:05.343383    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbbbed2613e8be2b87d359b313a076df8556891c66a382420629c633a06a83df\": container with ID starting with dbbbed2613e8be2b87d359b313a076df8556891c66a382420629c633a06a83df not found: ID does not exist" containerID="dbbbed2613e8be2b87d359b313a076df8556891c66a382420629c633a06a83df"
Jul 20 19:43:05.343448 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.343412    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbbbed2613e8be2b87d359b313a076df8556891c66a382420629c633a06a83df"} err="failed to get container status \"dbbbed2613e8be2b87d359b313a076df8556891c66a382420629c633a06a83df\": rpc error: code = NotFound desc = could not find container \"dbbbed2613e8be2b87d359b313a076df8556891c66a382420629c633a06a83df\": container with ID starting with dbbbed2613e8be2b87d359b313a076df8556891c66a382420629c633a06a83df not found: ID does not exist"
Jul 20 19:43:05.372693 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.372664    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-openshift-service-ca\") pod \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\" (UID: \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\") "
Jul 20 19:43:05.372788 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.372725    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlx9n\" (UniqueName: \"kubernetes.io/projected/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-kube-api-access-jlx9n\") pod \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\" (UID: \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\") "
Jul 20 19:43:05.372788 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.372750    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-maas-api-tls\") pod \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\" (UID: \"63ff4e47-67d6-41a4-b2c6-6bcda97848fe\") "
Jul 20 19:43:05.373086 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.373060    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "63ff4e47-67d6-41a4-b2c6-6bcda97848fe" (UID: "63ff4e47-67d6-41a4-b2c6-6bcda97848fe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:43:05.373469 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.373429    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-openshift-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:43:05.375146 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.375121    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "63ff4e47-67d6-41a4-b2c6-6bcda97848fe" (UID: "63ff4e47-67d6-41a4-b2c6-6bcda97848fe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:43:05.375146 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.375126    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-kube-api-access-jlx9n" (OuterVolumeSpecName: "kube-api-access-jlx9n") pod "63ff4e47-67d6-41a4-b2c6-6bcda97848fe" (UID: "63ff4e47-67d6-41a4-b2c6-6bcda97848fe"). InnerVolumeSpecName "kube-api-access-jlx9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:43:05.474392 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.474353    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlx9n\" (UniqueName: \"kubernetes.io/projected/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-kube-api-access-jlx9n\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:43:05.474392 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.474387    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63ff4e47-67d6-41a4-b2c6-6bcda97848fe-maas-api-tls\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:43:05.662004 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.661974    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"]
Jul 20 19:43:05.669320 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:05.669291    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95e08f34-8566798759-9fz2w"]
Jul 20 19:43:06.265972 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:06.265928    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63ff4e47-67d6-41a4-b2c6-6bcda97848fe" path="/var/lib/kubelet/pods/63ff4e47-67d6-41a4-b2c6-6bcda97848fe/volumes"
Jul 20 19:43:08.508468 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:08.508432    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:43:09.518387 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:09.518357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:09.726209 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:09.726155    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:09.952537 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:09.952510    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:10.302996 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:10.302915    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:10.570130 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:10.570044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:10.733598 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:10.733561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:11.094382 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:11.094347    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:11.397743 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:11.397662    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:13.354907 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.354869    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:13.444272 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.444236    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"]
Jul 20 19:43:13.444644 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.444629    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ff4e47-67d6-41a4-b2c6-6bcda97848fe" containerName="maas-api"
Jul 20 19:43:13.444713 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.444648    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ff4e47-67d6-41a4-b2c6-6bcda97848fe" containerName="maas-api"
Jul 20 19:43:13.444752 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.444716    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ff4e47-67d6-41a4-b2c6-6bcda97848fe" containerName="maas-api"
Jul 20 19:43:13.447844 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.447823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:13.450411 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.450386    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-01a6b0f7-serving-cert\""
Jul 20 19:43:13.450521 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.450421    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:43:13.450810 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.450795    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:43:13.451508 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.451492    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hv847\""
Jul 20 19:43:13.480671 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.480628    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"]
Jul 20 19:43:13.522918 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.522887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:13.544627 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.544598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371836cd-6c76-487e-82b5-53dcedf69a12-maas-api-tls\") pod \"maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz\" (UID: \"371836cd-6c76-487e-82b5-53dcedf69a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:13.544780 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.544643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/371836cd-6c76-487e-82b5-53dcedf69a12-openshift-service-ca\") pod \"maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz\" (UID: \"371836cd-6c76-487e-82b5-53dcedf69a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:13.544780 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.544664    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbd2s\" (UniqueName: \"kubernetes.io/projected/371836cd-6c76-487e-82b5-53dcedf69a12-kube-api-access-vbd2s\") pod \"maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz\" (UID: \"371836cd-6c76-487e-82b5-53dcedf69a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:13.641646 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.641566    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:13.645750 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.645725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/371836cd-6c76-487e-82b5-53dcedf69a12-openshift-service-ca\") pod \"maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz\" (UID: \"371836cd-6c76-487e-82b5-53dcedf69a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:13.645856 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.645754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbd2s\" (UniqueName: \"kubernetes.io/projected/371836cd-6c76-487e-82b5-53dcedf69a12-kube-api-access-vbd2s\") pod \"maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz\" (UID: \"371836cd-6c76-487e-82b5-53dcedf69a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:13.645856 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.645841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371836cd-6c76-487e-82b5-53dcedf69a12-maas-api-tls\") pod \"maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz\" (UID: \"371836cd-6c76-487e-82b5-53dcedf69a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:13.646490 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.646472    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/371836cd-6c76-487e-82b5-53dcedf69a12-openshift-service-ca\") pod \"maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz\" (UID: \"371836cd-6c76-487e-82b5-53dcedf69a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:13.648381 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.648364    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371836cd-6c76-487e-82b5-53dcedf69a12-maas-api-tls\") pod \"maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz\" (UID: \"371836cd-6c76-487e-82b5-53dcedf69a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:13.661051 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.661020    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbd2s\" (UniqueName: \"kubernetes.io/projected/371836cd-6c76-487e-82b5-53dcedf69a12-kube-api-access-vbd2s\") pod \"maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz\" (UID: \"371836cd-6c76-487e-82b5-53dcedf69a12\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:13.757665 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.757630    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:13.909743 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:13.909715    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"]
Jul 20 19:43:13.911813 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:43:13.911787    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371836cd_6c76_487e_82b5_53dcedf69a12.slice/crio-9f4839af5cde338649194e1205e3bd2cd85c5c8114852465c8e50c018a793fe8 WatchSource:0}: Error finding container 9f4839af5cde338649194e1205e3bd2cd85c5c8114852465c8e50c018a793fe8: Status 404 returned error can't find the container with id 9f4839af5cde338649194e1205e3bd2cd85c5c8114852465c8e50c018a793fe8
Jul 20 19:43:14.128518 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:14.128487    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:14.242673 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:14.242588    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:14.379876 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:14.379844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz" event={"ID":"371836cd-6c76-487e-82b5-53dcedf69a12","Type":"ContainerStarted","Data":"9f4839af5cde338649194e1205e3bd2cd85c5c8114852465c8e50c018a793fe8"}
Jul 20 19:43:15.386437 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:15.386395    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz" event={"ID":"371836cd-6c76-487e-82b5-53dcedf69a12","Type":"ContainerStarted","Data":"505025211f720a75bc836221e7d81f03313a698228eb3226ee14a23b46f17f01"}
Jul 20 19:43:15.386848 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:15.386540    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:15.405484 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:15.405432    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz" podStartSLOduration=1.981658964 podStartE2EDuration="2.405417539s" totalImagesPullingTime="423.758575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:43:15.404527718 +0000 UTC m=+1681.628154903" watchObservedRunningTime="2026-07-20 19:43:15.405417539 +0000 UTC m=+1681.629044719"
Jul 20 19:43:19.374706 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:19.374661    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:43:21.397167 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:21.397137    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:48.878586 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:48.878548    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"]
Jul 20 19:43:48.878949 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:48.878740    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz" podUID="371836cd-6c76-487e-82b5-53dcedf69a12" containerName="maas-api" containerID="cri-o://505025211f720a75bc836221e7d81f03313a698228eb3226ee14a23b46f17f01" gracePeriod=30
Jul 20 19:43:48.894532 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:48.894502    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:49.131231 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.131156    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:49.262968 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.262934    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbd2s\" (UniqueName: \"kubernetes.io/projected/371836cd-6c76-487e-82b5-53dcedf69a12-kube-api-access-vbd2s\") pod \"371836cd-6c76-487e-82b5-53dcedf69a12\" (UID: \"371836cd-6c76-487e-82b5-53dcedf69a12\") "
Jul 20 19:43:49.262968 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.262975    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/371836cd-6c76-487e-82b5-53dcedf69a12-openshift-service-ca\") pod \"371836cd-6c76-487e-82b5-53dcedf69a12\" (UID: \"371836cd-6c76-487e-82b5-53dcedf69a12\") "
Jul 20 19:43:49.263179 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.263015    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371836cd-6c76-487e-82b5-53dcedf69a12-maas-api-tls\") pod \"371836cd-6c76-487e-82b5-53dcedf69a12\" (UID: \"371836cd-6c76-487e-82b5-53dcedf69a12\") "
Jul 20 19:43:49.263395 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.263368    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/371836cd-6c76-487e-82b5-53dcedf69a12-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "371836cd-6c76-487e-82b5-53dcedf69a12" (UID: "371836cd-6c76-487e-82b5-53dcedf69a12"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:43:49.265178 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.265146    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/371836cd-6c76-487e-82b5-53dcedf69a12-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "371836cd-6c76-487e-82b5-53dcedf69a12" (UID: "371836cd-6c76-487e-82b5-53dcedf69a12"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:43:49.265178 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.265162    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/371836cd-6c76-487e-82b5-53dcedf69a12-kube-api-access-vbd2s" (OuterVolumeSpecName: "kube-api-access-vbd2s") pod "371836cd-6c76-487e-82b5-53dcedf69a12" (UID: "371836cd-6c76-487e-82b5-53dcedf69a12"). InnerVolumeSpecName "kube-api-access-vbd2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:43:49.364270 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.364234    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/371836cd-6c76-487e-82b5-53dcedf69a12-maas-api-tls\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:43:49.364270 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.364264    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbd2s\" (UniqueName: \"kubernetes.io/projected/371836cd-6c76-487e-82b5-53dcedf69a12-kube-api-access-vbd2s\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:43:49.364270 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.364277    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/371836cd-6c76-487e-82b5-53dcedf69a12-openshift-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:43:49.553380 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.553286    2581 generic.go:356] "Generic (PLEG): container finished" podID="371836cd-6c76-487e-82b5-53dcedf69a12" containerID="505025211f720a75bc836221e7d81f03313a698228eb3226ee14a23b46f17f01" exitCode=0
Jul 20 19:43:49.553380 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.553324    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"
Jul 20 19:43:49.553617 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.553367    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz" event={"ID":"371836cd-6c76-487e-82b5-53dcedf69a12","Type":"ContainerDied","Data":"505025211f720a75bc836221e7d81f03313a698228eb3226ee14a23b46f17f01"}
Jul 20 19:43:49.553617 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.553427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz" event={"ID":"371836cd-6c76-487e-82b5-53dcedf69a12","Type":"ContainerDied","Data":"9f4839af5cde338649194e1205e3bd2cd85c5c8114852465c8e50c018a793fe8"}
Jul 20 19:43:49.553617 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.553454    2581 scope.go:117] "RemoveContainer" containerID="505025211f720a75bc836221e7d81f03313a698228eb3226ee14a23b46f17f01"
Jul 20 19:43:49.564720 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.564702    2581 scope.go:117] "RemoveContainer" containerID="505025211f720a75bc836221e7d81f03313a698228eb3226ee14a23b46f17f01"
Jul 20 19:43:49.564972 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:43:49.564951    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"505025211f720a75bc836221e7d81f03313a698228eb3226ee14a23b46f17f01\": container with ID starting with 505025211f720a75bc836221e7d81f03313a698228eb3226ee14a23b46f17f01 not found: ID does not exist" containerID="505025211f720a75bc836221e7d81f03313a698228eb3226ee14a23b46f17f01"
Jul 20 19:43:49.565023 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.564982    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"505025211f720a75bc836221e7d81f03313a698228eb3226ee14a23b46f17f01"} err="failed to get container status \"505025211f720a75bc836221e7d81f03313a698228eb3226ee14a23b46f17f01\": rpc error: code = NotFound desc = could not find container \"505025211f720a75bc836221e7d81f03313a698228eb3226ee14a23b46f17f01\": container with ID starting with 505025211f720a75bc836221e7d81f03313a698228eb3226ee14a23b46f17f01 not found: ID does not exist"
Jul 20 19:43:49.578601 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.578569    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"]
Jul 20 19:43:49.583177 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:49.583150    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-01a6b0f7-cd7dbb989-ff4wz"]
Jul 20 19:43:50.266122 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:50.266083    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="371836cd-6c76-487e-82b5-53dcedf69a12" path="/var/lib/kubelet/pods/371836cd-6c76-487e-82b5-53dcedf69a12/volumes"
Jul 20 19:43:51.678432 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:51.678400    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:43:53.517625 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:53.517575    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:53.870910 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:53.870882    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:54.617687 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:54.617657    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:55.056300 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:55.056207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:55.444224 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:55.444171    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:55.517974 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:55.517932    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:58.433037 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.433003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:58.533240 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.533206    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:58.691138 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.691055    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"]
Jul 20 19:43:58.691407 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.691394    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="371836cd-6c76-487e-82b5-53dcedf69a12" containerName="maas-api"
Jul 20 19:43:58.691455 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.691409    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="371836cd-6c76-487e-82b5-53dcedf69a12" containerName="maas-api"
Jul 20 19:43:58.691490 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.691471    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="371836cd-6c76-487e-82b5-53dcedf69a12" containerName="maas-api"
Jul 20 19:43:58.695880 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.695860    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:43:58.699107 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.699077    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:43:58.699107 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.699092    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-709e15b3-serving-cert\""
Jul 20 19:43:58.699885 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.699868    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hv847\""
Jul 20 19:43:58.699954 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.699900    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:43:58.708877 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.708850    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"]
Jul 20 19:43:58.741613 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.741586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:58.741885 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.741867    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96859cc2-b158-4543-b209-ce169094e566-openshift-service-ca\") pod \"maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh\" (UID: \"96859cc2-b158-4543-b209-ce169094e566\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:43:58.741946 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.741902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-477pt\" (UniqueName: \"kubernetes.io/projected/96859cc2-b158-4543-b209-ce169094e566-kube-api-access-477pt\") pod \"maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh\" (UID: \"96859cc2-b158-4543-b209-ce169094e566\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:43:58.741946 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.741925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96859cc2-b158-4543-b209-ce169094e566-maas-api-tls\") pod \"maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh\" (UID: \"96859cc2-b158-4543-b209-ce169094e566\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:43:58.843131 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.843094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96859cc2-b158-4543-b209-ce169094e566-openshift-service-ca\") pod \"maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh\" (UID: \"96859cc2-b158-4543-b209-ce169094e566\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:43:58.843358 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.843138    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-477pt\" (UniqueName: \"kubernetes.io/projected/96859cc2-b158-4543-b209-ce169094e566-kube-api-access-477pt\") pod \"maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh\" (UID: \"96859cc2-b158-4543-b209-ce169094e566\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:43:58.843358 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.843163    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96859cc2-b158-4543-b209-ce169094e566-maas-api-tls\") pod \"maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh\" (UID: \"96859cc2-b158-4543-b209-ce169094e566\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:43:58.843358 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:43:58.843297    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-serving-cert: secret "maas-api-e2e-ait-709e15b3-serving-cert" not found
Jul 20 19:43:58.843538 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:43:58.843385    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96859cc2-b158-4543-b209-ce169094e566-maas-api-tls podName:96859cc2-b158-4543-b209-ce169094e566 nodeName:}" failed. No retries permitted until 2026-07-20 19:43:59.343361707 +0000 UTC m=+1725.566988871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/96859cc2-b158-4543-b209-ce169094e566-maas-api-tls") pod "maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh" (UID: "96859cc2-b158-4543-b209-ce169094e566") : secret "maas-api-e2e-ait-709e15b3-serving-cert" not found
Jul 20 19:43:58.843776 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.843757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96859cc2-b158-4543-b209-ce169094e566-openshift-service-ca\") pod \"maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh\" (UID: \"96859cc2-b158-4543-b209-ce169094e566\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:43:58.855233 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:58.855177    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-477pt\" (UniqueName: \"kubernetes.io/projected/96859cc2-b158-4543-b209-ce169094e566-kube-api-access-477pt\") pod \"maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh\" (UID: \"96859cc2-b158-4543-b209-ce169094e566\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:43:59.250110 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:59.250080    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:59.347451 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:59.347420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96859cc2-b158-4543-b209-ce169094e566-maas-api-tls\") pod \"maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh\" (UID: \"96859cc2-b158-4543-b209-ce169094e566\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:43:59.349930 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:59.349910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96859cc2-b158-4543-b209-ce169094e566-maas-api-tls\") pod \"maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh\" (UID: \"96859cc2-b158-4543-b209-ce169094e566\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:43:59.351367 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:59.351344    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:43:59.605585 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:59.605557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:43:59.751441 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:43:59.751417    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"]
Jul 20 19:43:59.753794 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:43:59.753766    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96859cc2_b158_4543_b209_ce169094e566.slice/crio-42cb806a92318d16ce3323b93aa13ba3b04852d7127df52d6e786feca4c0b97e WatchSource:0}: Error finding container 42cb806a92318d16ce3323b93aa13ba3b04852d7127df52d6e786feca4c0b97e: Status 404 returned error can't find the container with id 42cb806a92318d16ce3323b93aa13ba3b04852d7127df52d6e786feca4c0b97e
Jul 20 19:44:00.608899 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:00.608866    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh" event={"ID":"96859cc2-b158-4543-b209-ce169094e566","Type":"ContainerStarted","Data":"1e1c9b5639181f365f3d4212dd29f4c93407599e5e8eb8b80d47baeb6e89a9a1"}
Jul 20 19:44:00.609316 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:00.608917    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:44:00.609316 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:00.608934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh" event={"ID":"96859cc2-b158-4543-b209-ce169094e566","Type":"ContainerStarted","Data":"42cb806a92318d16ce3323b93aa13ba3b04852d7127df52d6e786feca4c0b97e"}
Jul 20 19:44:00.631053 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:00.630988    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh" podStartSLOduration=2.267673295 podStartE2EDuration="2.630969986s" totalImagesPullingTime="363.296691ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:43:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:44:00.628772798 +0000 UTC m=+1726.852399980" watchObservedRunningTime="2026-07-20 19:44:00.630969986 +0000 UTC m=+1726.854597167"
Jul 20 19:44:02.794757 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:02.794726    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:44:06.619671 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:06.619645    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:44:09.836504 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:09.836470    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:09.891027 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:09.890994    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:35.136400 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.136364    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"]
Jul 20 19:44:35.136934 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.136582    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh" podUID="96859cc2-b158-4543-b209-ce169094e566" containerName="maas-api" containerID="cri-o://1e1c9b5639181f365f3d4212dd29f4c93407599e5e8eb8b80d47baeb6e89a9a1" gracePeriod=30
Jul 20 19:44:35.167607 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.167576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:35.387351 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.387295    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:44:35.565533 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.565488    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96859cc2-b158-4543-b209-ce169094e566-maas-api-tls\") pod \"96859cc2-b158-4543-b209-ce169094e566\" (UID: \"96859cc2-b158-4543-b209-ce169094e566\") "
Jul 20 19:44:35.565731 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.565585    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96859cc2-b158-4543-b209-ce169094e566-openshift-service-ca\") pod \"96859cc2-b158-4543-b209-ce169094e566\" (UID: \"96859cc2-b158-4543-b209-ce169094e566\") "
Jul 20 19:44:35.565731 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.565626    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-477pt\" (UniqueName: \"kubernetes.io/projected/96859cc2-b158-4543-b209-ce169094e566-kube-api-access-477pt\") pod \"96859cc2-b158-4543-b209-ce169094e566\" (UID: \"96859cc2-b158-4543-b209-ce169094e566\") "
Jul 20 19:44:35.566057 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.566017    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96859cc2-b158-4543-b209-ce169094e566-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "96859cc2-b158-4543-b209-ce169094e566" (UID: "96859cc2-b158-4543-b209-ce169094e566"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:44:35.567995 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.567958    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96859cc2-b158-4543-b209-ce169094e566-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "96859cc2-b158-4543-b209-ce169094e566" (UID: "96859cc2-b158-4543-b209-ce169094e566"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:44:35.567995 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.567978    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96859cc2-b158-4543-b209-ce169094e566-kube-api-access-477pt" (OuterVolumeSpecName: "kube-api-access-477pt") pod "96859cc2-b158-4543-b209-ce169094e566" (UID: "96859cc2-b158-4543-b209-ce169094e566"). InnerVolumeSpecName "kube-api-access-477pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:44:35.667121 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.667027    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96859cc2-b158-4543-b209-ce169094e566-maas-api-tls\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:44:35.667121 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.667060    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96859cc2-b158-4543-b209-ce169094e566-openshift-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:44:35.667121 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.667070    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-477pt\" (UniqueName: \"kubernetes.io/projected/96859cc2-b158-4543-b209-ce169094e566-kube-api-access-477pt\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:44:35.781324 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.781286    2581 generic.go:356] "Generic (PLEG): container finished" podID="96859cc2-b158-4543-b209-ce169094e566" containerID="1e1c9b5639181f365f3d4212dd29f4c93407599e5e8eb8b80d47baeb6e89a9a1" exitCode=0
Jul 20 19:44:35.781495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.781351    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"
Jul 20 19:44:35.781495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.781375    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh" event={"ID":"96859cc2-b158-4543-b209-ce169094e566","Type":"ContainerDied","Data":"1e1c9b5639181f365f3d4212dd29f4c93407599e5e8eb8b80d47baeb6e89a9a1"}
Jul 20 19:44:35.781495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.781456    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh" event={"ID":"96859cc2-b158-4543-b209-ce169094e566","Type":"ContainerDied","Data":"42cb806a92318d16ce3323b93aa13ba3b04852d7127df52d6e786feca4c0b97e"}
Jul 20 19:44:35.781495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.781479    2581 scope.go:117] "RemoveContainer" containerID="1e1c9b5639181f365f3d4212dd29f4c93407599e5e8eb8b80d47baeb6e89a9a1"
Jul 20 19:44:35.790980 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.790965    2581 scope.go:117] "RemoveContainer" containerID="1e1c9b5639181f365f3d4212dd29f4c93407599e5e8eb8b80d47baeb6e89a9a1"
Jul 20 19:44:35.791257 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:44:35.791234    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e1c9b5639181f365f3d4212dd29f4c93407599e5e8eb8b80d47baeb6e89a9a1\": container with ID starting with 1e1c9b5639181f365f3d4212dd29f4c93407599e5e8eb8b80d47baeb6e89a9a1 not found: ID does not exist" containerID="1e1c9b5639181f365f3d4212dd29f4c93407599e5e8eb8b80d47baeb6e89a9a1"
Jul 20 19:44:35.791314 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.791272    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e1c9b5639181f365f3d4212dd29f4c93407599e5e8eb8b80d47baeb6e89a9a1"} err="failed to get container status \"1e1c9b5639181f365f3d4212dd29f4c93407599e5e8eb8b80d47baeb6e89a9a1\": rpc error: code = NotFound desc = could not find container \"1e1c9b5639181f365f3d4212dd29f4c93407599e5e8eb8b80d47baeb6e89a9a1\": container with ID starting with 1e1c9b5639181f365f3d4212dd29f4c93407599e5e8eb8b80d47baeb6e89a9a1 not found: ID does not exist"
Jul 20 19:44:35.801755 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.801733    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"]
Jul 20 19:44:35.805427 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:35.805407    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-709e15b3-9f6c85869-gzjrh"]
Jul 20 19:44:36.266615 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:36.266584    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96859cc2-b158-4543-b209-ce169094e566" path="/var/lib/kubelet/pods/96859cc2-b158-4543-b209-ce169094e566/volumes"
Jul 20 19:44:37.506597 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:37.506566    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:37.607322 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:37.607289    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:37.974024 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:37.973990    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:44:39.658229 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:39.658170    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:40.831357 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:40.831321    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:41.061919 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:41.061887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:41.283066 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:41.282952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:41.657716 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:41.657673    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:42.283413 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:42.283382    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:43.733371 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.733327    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:43.815480 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.815451    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"]
Jul 20 19:44:43.815775 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.815765    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96859cc2-b158-4543-b209-ce169094e566" containerName="maas-api"
Jul 20 19:44:43.815820 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.815777    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="96859cc2-b158-4543-b209-ce169094e566" containerName="maas-api"
Jul 20 19:44:43.815854 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.815825    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="96859cc2-b158-4543-b209-ce169094e566" containerName="maas-api"
Jul 20 19:44:43.818806 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.818783    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:43.822111 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.822090    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:44:43.822279 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.822085    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-77ee2bb7-serving-cert\""
Jul 20 19:44:43.822426 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.822410    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hv847\""
Jul 20 19:44:43.822780 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.822765    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:44:43.832697 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.832670    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"]
Jul 20 19:44:43.832970 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.832952    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf7k9\" (UniqueName: \"kubernetes.io/projected/6019ec34-4663-443d-85b3-16b137fe356f-kube-api-access-kf7k9\") pod \"maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:43.833030 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.832988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6019ec34-4663-443d-85b3-16b137fe356f-maas-api-tls\") pod \"maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:43.833030 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.833020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6019ec34-4663-443d-85b3-16b137fe356f-openshift-service-ca\") pod \"maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:43.834716 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.834690    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:43.931094 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.931058    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:43.934266 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.934243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf7k9\" (UniqueName: \"kubernetes.io/projected/6019ec34-4663-443d-85b3-16b137fe356f-kube-api-access-kf7k9\") pod \"maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:43.934347 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.934286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6019ec34-4663-443d-85b3-16b137fe356f-maas-api-tls\") pod \"maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:43.934347 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.934322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6019ec34-4663-443d-85b3-16b137fe356f-openshift-service-ca\") pod \"maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:43.934475 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:44:43.934459    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-serving-cert: secret "maas-api-e2e-derive-77ee2bb7-serving-cert" not found
Jul 20 19:44:43.934554 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:44:43.934541    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6019ec34-4663-443d-85b3-16b137fe356f-maas-api-tls podName:6019ec34-4663-443d-85b3-16b137fe356f nodeName:}" failed. No retries permitted until 2026-07-20 19:44:44.434520289 +0000 UTC m=+1770.658147451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6019ec34-4663-443d-85b3-16b137fe356f-maas-api-tls") pod "maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz" (UID: "6019ec34-4663-443d-85b3-16b137fe356f") : secret "maas-api-e2e-derive-77ee2bb7-serving-cert" not found
Jul 20 19:44:43.935015 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.934996    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6019ec34-4663-443d-85b3-16b137fe356f-openshift-service-ca\") pod \"maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:43.947315 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:43.947282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf7k9\" (UniqueName: \"kubernetes.io/projected/6019ec34-4663-443d-85b3-16b137fe356f-kube-api-access-kf7k9\") pod \"maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:44.440089 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:44.440057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6019ec34-4663-443d-85b3-16b137fe356f-maas-api-tls\") pod \"maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:44.440289 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:44:44.440232    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-serving-cert: secret "maas-api-e2e-derive-77ee2bb7-serving-cert" not found
Jul 20 19:44:44.440340 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:44:44.440304    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6019ec34-4663-443d-85b3-16b137fe356f-maas-api-tls podName:6019ec34-4663-443d-85b3-16b137fe356f nodeName:}" failed. No retries permitted until 2026-07-20 19:44:45.440290016 +0000 UTC m=+1771.663917178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6019ec34-4663-443d-85b3-16b137fe356f-maas-api-tls") pod "maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz" (UID: "6019ec34-4663-443d-85b3-16b137fe356f") : secret "maas-api-e2e-derive-77ee2bb7-serving-cert" not found
Jul 20 19:44:44.442212 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:44.442170    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:44.544047 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:44.544013    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:44.643338 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:44.643302    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:44:45.449695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:45.449657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6019ec34-4663-443d-85b3-16b137fe356f-maas-api-tls\") pod \"maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:45.452216 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:45.452173    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6019ec34-4663-443d-85b3-16b137fe356f-maas-api-tls\") pod \"maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:45.629369 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:45.629334    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:45.770211 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:45.770160    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"]
Jul 20 19:44:45.772390 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:44:45.772359    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6019ec34_4663_443d_85b3_16b137fe356f.slice/crio-d6d976f03ab8ec1804fde7dc5376c6084c923aa59ed6e9327076b922b0b7d409 WatchSource:0}: Error finding container d6d976f03ab8ec1804fde7dc5376c6084c923aa59ed6e9327076b922b0b7d409: Status 404 returned error can't find the container with id d6d976f03ab8ec1804fde7dc5376c6084c923aa59ed6e9327076b922b0b7d409
Jul 20 19:44:45.832658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:45.832622    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz" event={"ID":"6019ec34-4663-443d-85b3-16b137fe356f","Type":"ContainerStarted","Data":"d6d976f03ab8ec1804fde7dc5376c6084c923aa59ed6e9327076b922b0b7d409"}
Jul 20 19:44:46.839565 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:46.839533    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz" event={"ID":"6019ec34-4663-443d-85b3-16b137fe356f","Type":"ContainerStarted","Data":"5e9bdb5b27ac78d09eb2f53bb914b2109a4b263ce9700168dc9fa8c94a6cb6ec"}
Jul 20 19:44:46.839958 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:46.839672    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:44:46.857692 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:46.857646    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz" podStartSLOduration=3.363252462 podStartE2EDuration="3.857628236s" totalImagesPullingTime="494.375774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:44:46.856503399 +0000 UTC m=+1773.080130580" watchObservedRunningTime="2026-07-20 19:44:46.857628236 +0000 UTC m=+1773.081255417"
Jul 20 19:44:49.078949 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:49.078916    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:44:52.850566 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:44:52.850540    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:45:00.130224 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:00.130162    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w"]
Jul 20 19:45:00.133660 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:00.133642    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742945-8z2zg"]
Jul 20 19:45:00.133785 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:00.133764    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w"
Jul 20 19:45:00.136861 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:00.136837    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-8z2zg"
Jul 20 19:45:00.137030 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:00.136838    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\""
Jul 20 19:45:00.137730 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:00.137708    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742945-8z2zg"]
Jul 20 19:45:00.141025 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:00.141002    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w"]
Jul 20 19:45:00.148129 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:00.148106    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w"
Jul 20 19:45:00.155468 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:00.155446    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-8z2zg"
Jul 20 19:45:00.306338 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:00.306309    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w"]
Jul 20 19:45:00.308374 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:45:00.308336    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c441e3_8f1b_4030_9164_7095829e1b4c.slice/crio-a48ae96c57b5f8ee32cd53914f009a1b16b2ab9492f20f08104febfef95300e5 WatchSource:0}: Error finding container a48ae96c57b5f8ee32cd53914f009a1b16b2ab9492f20f08104febfef95300e5: Status 404 returned error can't find the container with id a48ae96c57b5f8ee32cd53914f009a1b16b2ab9492f20f08104febfef95300e5
Jul 20 19:45:00.329331 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:00.329308    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742945-8z2zg"]
Jul 20 19:45:00.331756 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:45:00.331732    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c7cf9b_30d5_4187_87dc_c608e0d2a601.slice/crio-a10a211dbfd07535cb30b1a6f3b9a2812ec7eff4167ed2bd8f3c440b38936d80 WatchSource:0}: Error finding container a10a211dbfd07535cb30b1a6f3b9a2812ec7eff4167ed2bd8f3c440b38936d80: Status 404 returned error can't find the container with id a10a211dbfd07535cb30b1a6f3b9a2812ec7eff4167ed2bd8f3c440b38936d80
Jul 20 19:45:00.907929 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:00.907894    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-8z2zg" event={"ID":"b8c7cf9b-30d5-4187-87dc-c608e0d2a601","Type":"ContainerStarted","Data":"a10a211dbfd07535cb30b1a6f3b9a2812ec7eff4167ed2bd8f3c440b38936d80"}
Jul 20 19:45:00.909059 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:00.909037    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w" event={"ID":"a7c441e3-8f1b-4030-9164-7095829e1b4c","Type":"ContainerStarted","Data":"a48ae96c57b5f8ee32cd53914f009a1b16b2ab9492f20f08104febfef95300e5"}
Jul 20 19:45:03.927978 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:03.927938    2581 generic.go:356] "Generic (PLEG): container finished" podID="b8c7cf9b-30d5-4187-87dc-c608e0d2a601" containerID="93e52f377f4cf0ab8e4920027ee1b4cbb9795ee75bce31e3caddad57a5fa2a11" exitCode=0
Jul 20 19:45:03.928428 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:03.928031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-8z2zg" event={"ID":"b8c7cf9b-30d5-4187-87dc-c608e0d2a601","Type":"ContainerDied","Data":"93e52f377f4cf0ab8e4920027ee1b4cbb9795ee75bce31e3caddad57a5fa2a11"}
Jul 20 19:45:03.929639 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:03.929612    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w" event={"ID":"a7c441e3-8f1b-4030-9164-7095829e1b4c","Type":"ContainerStarted","Data":"8b35f5c3fc0ccdc8fd4a5489c46420119ae478f01e2432a39e402e208b995bbd"}
Jul 20 19:45:03.956796 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:03.956743    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w" podStartSLOduration=1.357037319 podStartE2EDuration="3.956725992s" totalImagesPullingTime="2.599688673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:45:03.954411337 +0000 UTC m=+1790.178038511" watchObservedRunningTime="2026-07-20 19:45:03.956725992 +0000 UTC m=+1790.180353209"
Jul 20 19:45:04.936427 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:04.936388    2581 generic.go:356] "Generic (PLEG): container finished" podID="a7c441e3-8f1b-4030-9164-7095829e1b4c" containerID="8b35f5c3fc0ccdc8fd4a5489c46420119ae478f01e2432a39e402e208b995bbd" exitCode=0
Jul 20 19:45:04.936886 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:04.936481    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w" event={"ID":"a7c441e3-8f1b-4030-9164-7095829e1b4c","Type":"ContainerDied","Data":"8b35f5c3fc0ccdc8fd4a5489c46420119ae478f01e2432a39e402e208b995bbd"}
Jul 20 19:45:05.072652 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:05.072621    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-8z2zg"
Jul 20 19:45:05.943287 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:05.943258    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-8z2zg"
Jul 20 19:45:05.943758 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:05.943257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-8z2zg" event={"ID":"b8c7cf9b-30d5-4187-87dc-c608e0d2a601","Type":"ContainerDied","Data":"a10a211dbfd07535cb30b1a6f3b9a2812ec7eff4167ed2bd8f3c440b38936d80"}
Jul 20 19:45:05.943758 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:05.943379    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a10a211dbfd07535cb30b1a6f3b9a2812ec7eff4167ed2bd8f3c440b38936d80"
Jul 20 19:45:06.082318 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:06.082294    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w"
Jul 20 19:45:06.950465 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:06.950437    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w"
Jul 20 19:45:06.950896 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:06.950467    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w" event={"ID":"a7c441e3-8f1b-4030-9164-7095829e1b4c","Type":"ContainerDied","Data":"a48ae96c57b5f8ee32cd53914f009a1b16b2ab9492f20f08104febfef95300e5"}
Jul 20 19:45:06.950896 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:06.950509    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a48ae96c57b5f8ee32cd53914f009a1b16b2ab9492f20f08104febfef95300e5"
Jul 20 19:45:14.298816 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:14.298792    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:45:14.303034 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:14.303012    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:45:18.952177 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:18.952137    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"]
Jul 20 19:45:18.952571 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:18.952423    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz" podUID="6019ec34-4663-443d-85b3-16b137fe356f" containerName="maas-api" containerID="cri-o://5e9bdb5b27ac78d09eb2f53bb914b2109a4b263ce9700168dc9fa8c94a6cb6ec" gracePeriod=30
Jul 20 19:45:18.965720 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:18.965686    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w"]
Jul 20 19:45:18.968386 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:18.968361    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-77ee2bb7-29742945-8h26w"]
Jul 20 19:45:18.972494 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:18.972469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:19.225725 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:19.225699    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:45:19.347470 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:19.347431    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6019ec34-4663-443d-85b3-16b137fe356f-maas-api-tls\") pod \"6019ec34-4663-443d-85b3-16b137fe356f\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") "
Jul 20 19:45:19.347649 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:19.347486    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6019ec34-4663-443d-85b3-16b137fe356f-openshift-service-ca\") pod \"6019ec34-4663-443d-85b3-16b137fe356f\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") "
Jul 20 19:45:19.347649 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:19.347524    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf7k9\" (UniqueName: \"kubernetes.io/projected/6019ec34-4663-443d-85b3-16b137fe356f-kube-api-access-kf7k9\") pod \"6019ec34-4663-443d-85b3-16b137fe356f\" (UID: \"6019ec34-4663-443d-85b3-16b137fe356f\") "
Jul 20 19:45:19.347952 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:19.347920    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6019ec34-4663-443d-85b3-16b137fe356f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6019ec34-4663-443d-85b3-16b137fe356f" (UID: "6019ec34-4663-443d-85b3-16b137fe356f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:45:19.349725 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:19.349699    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6019ec34-4663-443d-85b3-16b137fe356f-kube-api-access-kf7k9" (OuterVolumeSpecName: "kube-api-access-kf7k9") pod "6019ec34-4663-443d-85b3-16b137fe356f" (UID: "6019ec34-4663-443d-85b3-16b137fe356f"). InnerVolumeSpecName "kube-api-access-kf7k9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:19.349789 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:19.349726    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6019ec34-4663-443d-85b3-16b137fe356f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6019ec34-4663-443d-85b3-16b137fe356f" (UID: "6019ec34-4663-443d-85b3-16b137fe356f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:45:19.448486 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:19.448445    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6019ec34-4663-443d-85b3-16b137fe356f-openshift-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:45:19.448486 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:19.448478    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf7k9\" (UniqueName: \"kubernetes.io/projected/6019ec34-4663-443d-85b3-16b137fe356f-kube-api-access-kf7k9\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:45:19.448486 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:19.448491    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6019ec34-4663-443d-85b3-16b137fe356f-maas-api-tls\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:45:20.018844 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:20.018812    2581 generic.go:356] "Generic (PLEG): container finished" podID="6019ec34-4663-443d-85b3-16b137fe356f" containerID="5e9bdb5b27ac78d09eb2f53bb914b2109a4b263ce9700168dc9fa8c94a6cb6ec" exitCode=0
Jul 20 19:45:20.019309 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:20.018855    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"
Jul 20 19:45:20.019309 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:20.018869    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz" event={"ID":"6019ec34-4663-443d-85b3-16b137fe356f","Type":"ContainerDied","Data":"5e9bdb5b27ac78d09eb2f53bb914b2109a4b263ce9700168dc9fa8c94a6cb6ec"}
Jul 20 19:45:20.019309 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:20.018919    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz" event={"ID":"6019ec34-4663-443d-85b3-16b137fe356f","Type":"ContainerDied","Data":"d6d976f03ab8ec1804fde7dc5376c6084c923aa59ed6e9327076b922b0b7d409"}
Jul 20 19:45:20.019309 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:20.018941    2581 scope.go:117] "RemoveContainer" containerID="5e9bdb5b27ac78d09eb2f53bb914b2109a4b263ce9700168dc9fa8c94a6cb6ec"
Jul 20 19:45:20.028641 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:20.028623    2581 scope.go:117] "RemoveContainer" containerID="5e9bdb5b27ac78d09eb2f53bb914b2109a4b263ce9700168dc9fa8c94a6cb6ec"
Jul 20 19:45:20.028924 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:45:20.028907    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e9bdb5b27ac78d09eb2f53bb914b2109a4b263ce9700168dc9fa8c94a6cb6ec\": container with ID starting with 5e9bdb5b27ac78d09eb2f53bb914b2109a4b263ce9700168dc9fa8c94a6cb6ec not found: ID does not exist" containerID="5e9bdb5b27ac78d09eb2f53bb914b2109a4b263ce9700168dc9fa8c94a6cb6ec"
Jul 20 19:45:20.028972 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:20.028934    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e9bdb5b27ac78d09eb2f53bb914b2109a4b263ce9700168dc9fa8c94a6cb6ec"} err="failed to get container status \"5e9bdb5b27ac78d09eb2f53bb914b2109a4b263ce9700168dc9fa8c94a6cb6ec\": rpc error: code = NotFound desc = could not find container \"5e9bdb5b27ac78d09eb2f53bb914b2109a4b263ce9700168dc9fa8c94a6cb6ec\": container with ID starting with 5e9bdb5b27ac78d09eb2f53bb914b2109a4b263ce9700168dc9fa8c94a6cb6ec not found: ID does not exist"
Jul 20 19:45:20.052288 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:20.052256    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"]
Jul 20 19:45:20.058400 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:20.058375    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-77ee2bb7-7b4d89c68f-ndcfz"]
Jul 20 19:45:20.266954 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:20.266921    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6019ec34-4663-443d-85b3-16b137fe356f" path="/var/lib/kubelet/pods/6019ec34-4663-443d-85b3-16b137fe356f/volumes"
Jul 20 19:45:20.267223 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:20.267209    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7c441e3-8f1b-4030-9164-7095829e1b4c" path="/var/lib/kubelet/pods/a7c441e3-8f1b-4030-9164-7095829e1b4c/volumes"
Jul 20 19:45:22.088053 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:22.088022    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:45:23.573799 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:23.573760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:23.727658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:23.727624    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:23.958570 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:23.958528    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:24.523663 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:24.523631    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:24.664271 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:24.664239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:26.101366 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:26.101336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:32.103495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:32.103463    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:32.180576 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:32.180538    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:32.307197 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:32.307152    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:32.403519 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:32.403445    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:32.832855 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:32.832828    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:45:58.788461 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:45:58.788428    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:05.055682 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:05.055644    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:05.159887 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:05.159850    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:05.260378 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:05.260344    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:21.133707 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:21.133670    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:26.878400 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:26.878362    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:26.944796 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:26.944750    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:27.032527 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:27.032491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:27.149411 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:27.149330    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:37.636659 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:37.636564    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:38.459339 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:38.459310    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:44.606387 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:44.606352    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:44.711035 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:44.711003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:44.807849 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:44.807819    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:44.907160 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:44.907074    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:45.649307 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:45.649279    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:45.826161 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:45.826128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:45.944304 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:45.944205    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:49.080045 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:49.080013    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:46:52.540396 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:52.540365    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:58.382512 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:58.382477    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:46:58.480027 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:58.479989    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:46:59.937866 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:46:59.937827    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:04.884153 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:04.884120    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:04.961801 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:04.961752    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:05.191629 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:05.191548    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:05.493869 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:05.493791    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:05.594624 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:05.594586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:05.804476 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:05.804396    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:07.871314 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:07.871284    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:47:08.158272 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.158178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:08.244575 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.244547    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:08.252009 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.251982    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"]
Jul 20 19:47:08.252322 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.252309    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7c441e3-8f1b-4030-9164-7095829e1b4c" containerName="cleanup"
Jul 20 19:47:08.252373 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.252323    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7c441e3-8f1b-4030-9164-7095829e1b4c" containerName="cleanup"
Jul 20 19:47:08.252373 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.252332    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c7cf9b-30d5-4187-87dc-c608e0d2a601" containerName="cleanup"
Jul 20 19:47:08.252373 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.252338    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c7cf9b-30d5-4187-87dc-c608e0d2a601" containerName="cleanup"
Jul 20 19:47:08.252373 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.252351    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6019ec34-4663-443d-85b3-16b137fe356f" containerName="maas-api"
Jul 20 19:47:08.252373 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.252357    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6019ec34-4663-443d-85b3-16b137fe356f" containerName="maas-api"
Jul 20 19:47:08.252531 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.252409    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7c441e3-8f1b-4030-9164-7095829e1b4c" containerName="cleanup"
Jul 20 19:47:08.252531 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.252417    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6019ec34-4663-443d-85b3-16b137fe356f" containerName="maas-api"
Jul 20 19:47:08.252531 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.252425    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8c7cf9b-30d5-4187-87dc-c608e0d2a601" containerName="cleanup"
Jul 20 19:47:08.255290 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.255270    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:08.257652 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.257628    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:47:08.258526 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.258503    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:47:08.258526 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.258521    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-561ddcc3-serving-cert\""
Jul 20 19:47:08.258679 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.258504    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hv847\""
Jul 20 19:47:08.267555 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.267532    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"]
Jul 20 19:47:08.313774 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.313744    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:08.366039 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.366007    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffdfa7ce-3617-4a93-b714-771e77e080fa-openshift-service-ca\") pod \"maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq\" (UID: \"ffdfa7ce-3617-4a93-b714-771e77e080fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:08.366234 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.366090    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffdfa7ce-3617-4a93-b714-771e77e080fa-maas-api-tls\") pod \"maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq\" (UID: \"ffdfa7ce-3617-4a93-b714-771e77e080fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:08.366234 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.366144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jrq6\" (UniqueName: \"kubernetes.io/projected/ffdfa7ce-3617-4a93-b714-771e77e080fa-kube-api-access-2jrq6\") pod \"maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq\" (UID: \"ffdfa7ce-3617-4a93-b714-771e77e080fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:08.467313 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.467215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffdfa7ce-3617-4a93-b714-771e77e080fa-openshift-service-ca\") pod \"maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq\" (UID: \"ffdfa7ce-3617-4a93-b714-771e77e080fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:08.467495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.467314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffdfa7ce-3617-4a93-b714-771e77e080fa-maas-api-tls\") pod \"maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq\" (UID: \"ffdfa7ce-3617-4a93-b714-771e77e080fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:08.467495 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.467371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jrq6\" (UniqueName: \"kubernetes.io/projected/ffdfa7ce-3617-4a93-b714-771e77e080fa-kube-api-access-2jrq6\") pod \"maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq\" (UID: \"ffdfa7ce-3617-4a93-b714-771e77e080fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:08.467495 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:47:08.467455    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-serving-cert: secret "maas-api-e2e-mt-561ddcc3-serving-cert" not found
Jul 20 19:47:08.467654 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:47:08.467527    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffdfa7ce-3617-4a93-b714-771e77e080fa-maas-api-tls podName:ffdfa7ce-3617-4a93-b714-771e77e080fa nodeName:}" failed. No retries permitted until 2026-07-20 19:47:08.967510518 +0000 UTC m=+1915.191137678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ffdfa7ce-3617-4a93-b714-771e77e080fa-maas-api-tls") pod "maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq" (UID: "ffdfa7ce-3617-4a93-b714-771e77e080fa") : secret "maas-api-e2e-mt-561ddcc3-serving-cert" not found
Jul 20 19:47:08.467786 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.467767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffdfa7ce-3617-4a93-b714-771e77e080fa-openshift-service-ca\") pod \"maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq\" (UID: \"ffdfa7ce-3617-4a93-b714-771e77e080fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:08.476236 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.476209    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jrq6\" (UniqueName: \"kubernetes.io/projected/ffdfa7ce-3617-4a93-b714-771e77e080fa-kube-api-access-2jrq6\") pod \"maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq\" (UID: \"ffdfa7ce-3617-4a93-b714-771e77e080fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:08.971150 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.971112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffdfa7ce-3617-4a93-b714-771e77e080fa-maas-api-tls\") pod \"maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq\" (UID: \"ffdfa7ce-3617-4a93-b714-771e77e080fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:08.973796 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:08.973769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffdfa7ce-3617-4a93-b714-771e77e080fa-maas-api-tls\") pod \"maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq\" (UID: \"ffdfa7ce-3617-4a93-b714-771e77e080fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:09.082155 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:09.082108    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:09.167718 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:09.167687    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:09.184459 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:09.184433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:09.308017 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:09.307980    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"]
Jul 20 19:47:09.310649 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:47:09.310622    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffdfa7ce_3617_4a93_b714_771e77e080fa.slice/crio-381bf02e317f5773999200564c46b2091f9e58fc017d4fe1f30aa45a6a8ec67d WatchSource:0}: Error finding container 381bf02e317f5773999200564c46b2091f9e58fc017d4fe1f30aa45a6a8ec67d: Status 404 returned error can't find the container with id 381bf02e317f5773999200564c46b2091f9e58fc017d4fe1f30aa45a6a8ec67d
Jul 20 19:47:09.555410 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:09.555316    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq" event={"ID":"ffdfa7ce-3617-4a93-b714-771e77e080fa","Type":"ContainerStarted","Data":"381bf02e317f5773999200564c46b2091f9e58fc017d4fe1f30aa45a6a8ec67d"}
Jul 20 19:47:10.561474 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:10.561425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq" event={"ID":"ffdfa7ce-3617-4a93-b714-771e77e080fa","Type":"ContainerStarted","Data":"a2485a009d983ab2db34ba188b53985cb53d001da1e47a28e8c25b33b662914c"}
Jul 20 19:47:10.561874 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:10.561551    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:10.581364 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:10.581312    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq" podStartSLOduration=2.085469552 podStartE2EDuration="2.581294403s" totalImagesPullingTime="495.824851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:47:10.579557835 +0000 UTC m=+1916.803185020" watchObservedRunningTime="2026-07-20 19:47:10.581294403 +0000 UTC m=+1916.804921583"
Jul 20 19:47:12.638999 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:12.638965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:13.289061 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:13.289020    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:13.388709 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:13.388659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:13.699949 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:13.699915    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:16.571712 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:16.571681    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:16.788591 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:16.788555    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:47:19.405958 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:19.405921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:19.475639 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:19.475610    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:19.754119 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:19.754032    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd"]
Jul 20 19:47:19.757332 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:19.757315    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd"
Jul 20 19:47:19.759882 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:19.759864    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\""
Jul 20 19:47:19.761037 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:19.761012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e98d6c-1ece-4186-9ee1-94bf80bb5257-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd\" (UID: \"66e98d6c-1ece-4186-9ee1-94bf80bb5257\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd"
Jul 20 19:47:19.765321 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:19.765296    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd"]
Jul 20 19:47:19.862159 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:19.862125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e98d6c-1ece-4186-9ee1-94bf80bb5257-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd\" (UID: \"66e98d6c-1ece-4186-9ee1-94bf80bb5257\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd"
Jul 20 19:47:19.862747 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:19.862729    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e98d6c-1ece-4186-9ee1-94bf80bb5257-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd\" (UID: \"66e98d6c-1ece-4186-9ee1-94bf80bb5257\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd"
Jul 20 19:47:20.068913 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:20.068821    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd"
Jul 20 19:47:20.203547 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:20.203521    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd"]
Jul 20 19:47:20.205564 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:47:20.205539    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e98d6c_1ece_4186_9ee1_94bf80bb5257.slice/crio-121cf83666b69dd630ae0069f724e42228ed794225381bed9dc7c4a7e6f28edd WatchSource:0}: Error finding container 121cf83666b69dd630ae0069f724e42228ed794225381bed9dc7c4a7e6f28edd: Status 404 returned error can't find the container with id 121cf83666b69dd630ae0069f724e42228ed794225381bed9dc7c4a7e6f28edd
Jul 20 19:47:20.613718 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:20.613685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd" event={"ID":"66e98d6c-1ece-4186-9ee1-94bf80bb5257","Type":"ContainerStarted","Data":"6c2e91cfd48bdad2c9de194f0bdea150bf0c611e8e0ec8488fb5b5a6a6f517f9"}
Jul 20 19:47:20.614120 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:20.613743    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd" event={"ID":"66e98d6c-1ece-4186-9ee1-94bf80bb5257","Type":"ContainerStarted","Data":"121cf83666b69dd630ae0069f724e42228ed794225381bed9dc7c4a7e6f28edd"}
Jul 20 19:47:20.631433 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:20.631380    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd" podStartSLOduration=1.63136416 podStartE2EDuration="1.63136416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:47:20.628633517 +0000 UTC m=+1926.852260698" watchObservedRunningTime="2026-07-20 19:47:20.63136416 +0000 UTC m=+1926.854991340"
Jul 20 19:47:21.620203 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:21.620147    2581 generic.go:356] "Generic (PLEG): container finished" podID="66e98d6c-1ece-4186-9ee1-94bf80bb5257" containerID="6c2e91cfd48bdad2c9de194f0bdea150bf0c611e8e0ec8488fb5b5a6a6f517f9" exitCode=0
Jul 20 19:47:21.620630 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:21.620215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd" event={"ID":"66e98d6c-1ece-4186-9ee1-94bf80bb5257","Type":"ContainerDied","Data":"6c2e91cfd48bdad2c9de194f0bdea150bf0c611e8e0ec8488fb5b5a6a6f517f9"}
Jul 20 19:47:22.754575 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:22.754551    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd"
Jul 20 19:47:22.786156 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:22.786130    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e98d6c-1ece-4186-9ee1-94bf80bb5257-maas-api-service-ca\") pod \"66e98d6c-1ece-4186-9ee1-94bf80bb5257\" (UID: \"66e98d6c-1ece-4186-9ee1-94bf80bb5257\") "
Jul 20 19:47:22.786524 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:22.786495    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e98d6c-1ece-4186-9ee1-94bf80bb5257-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "66e98d6c-1ece-4186-9ee1-94bf80bb5257" (UID: "66e98d6c-1ece-4186-9ee1-94bf80bb5257"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:47:22.887429 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:22.887337    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e98d6c-1ece-4186-9ee1-94bf80bb5257-maas-api-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:47:23.631343 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:23.631316    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd"
Jul 20 19:47:23.631502 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:23.631324    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd" event={"ID":"66e98d6c-1ece-4186-9ee1-94bf80bb5257","Type":"ContainerDied","Data":"121cf83666b69dd630ae0069f724e42228ed794225381bed9dc7c4a7e6f28edd"}
Jul 20 19:47:23.631502 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:23.631435    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="121cf83666b69dd630ae0069f724e42228ed794225381bed9dc7c4a7e6f28edd"
Jul 20 19:47:29.814684 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:29.814652    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"]
Jul 20 19:47:29.815210 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:29.814863    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq" podUID="ffdfa7ce-3617-4a93-b714-771e77e080fa" containerName="maas-api" containerID="cri-o://a2485a009d983ab2db34ba188b53985cb53d001da1e47a28e8c25b33b662914c" gracePeriod=30
Jul 20 19:47:29.846795 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:29.846761    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:30.068662 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.068607    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:30.149114 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.149073    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffdfa7ce-3617-4a93-b714-771e77e080fa-openshift-service-ca\") pod \"ffdfa7ce-3617-4a93-b714-771e77e080fa\" (UID: \"ffdfa7ce-3617-4a93-b714-771e77e080fa\") "
Jul 20 19:47:30.149114 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.149111    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffdfa7ce-3617-4a93-b714-771e77e080fa-maas-api-tls\") pod \"ffdfa7ce-3617-4a93-b714-771e77e080fa\" (UID: \"ffdfa7ce-3617-4a93-b714-771e77e080fa\") "
Jul 20 19:47:30.149397 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.149129    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jrq6\" (UniqueName: \"kubernetes.io/projected/ffdfa7ce-3617-4a93-b714-771e77e080fa-kube-api-access-2jrq6\") pod \"ffdfa7ce-3617-4a93-b714-771e77e080fa\" (UID: \"ffdfa7ce-3617-4a93-b714-771e77e080fa\") "
Jul 20 19:47:30.149538 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.149515    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffdfa7ce-3617-4a93-b714-771e77e080fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ffdfa7ce-3617-4a93-b714-771e77e080fa" (UID: "ffdfa7ce-3617-4a93-b714-771e77e080fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:47:30.151439 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.151405    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffdfa7ce-3617-4a93-b714-771e77e080fa-kube-api-access-2jrq6" (OuterVolumeSpecName: "kube-api-access-2jrq6") pod "ffdfa7ce-3617-4a93-b714-771e77e080fa" (UID: "ffdfa7ce-3617-4a93-b714-771e77e080fa"). InnerVolumeSpecName "kube-api-access-2jrq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:47:30.151439 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.151428    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffdfa7ce-3617-4a93-b714-771e77e080fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ffdfa7ce-3617-4a93-b714-771e77e080fa" (UID: "ffdfa7ce-3617-4a93-b714-771e77e080fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:47:30.250280 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.250240    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffdfa7ce-3617-4a93-b714-771e77e080fa-openshift-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:47:30.250280 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.250274    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffdfa7ce-3617-4a93-b714-771e77e080fa-maas-api-tls\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:47:30.250280 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.250284    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jrq6\" (UniqueName: \"kubernetes.io/projected/ffdfa7ce-3617-4a93-b714-771e77e080fa-kube-api-access-2jrq6\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:47:30.667278 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.667245    2581 generic.go:356] "Generic (PLEG): container finished" podID="ffdfa7ce-3617-4a93-b714-771e77e080fa" containerID="a2485a009d983ab2db34ba188b53985cb53d001da1e47a28e8c25b33b662914c" exitCode=0
Jul 20 19:47:30.667278 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.667290    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"
Jul 20 19:47:30.667534 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.667334    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq" event={"ID":"ffdfa7ce-3617-4a93-b714-771e77e080fa","Type":"ContainerDied","Data":"a2485a009d983ab2db34ba188b53985cb53d001da1e47a28e8c25b33b662914c"}
Jul 20 19:47:30.667534 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.667392    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq" event={"ID":"ffdfa7ce-3617-4a93-b714-771e77e080fa","Type":"ContainerDied","Data":"381bf02e317f5773999200564c46b2091f9e58fc017d4fe1f30aa45a6a8ec67d"}
Jul 20 19:47:30.667534 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.667421    2581 scope.go:117] "RemoveContainer" containerID="a2485a009d983ab2db34ba188b53985cb53d001da1e47a28e8c25b33b662914c"
Jul 20 19:47:30.676581 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.676561    2581 scope.go:117] "RemoveContainer" containerID="a2485a009d983ab2db34ba188b53985cb53d001da1e47a28e8c25b33b662914c"
Jul 20 19:47:30.676864 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:47:30.676847    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2485a009d983ab2db34ba188b53985cb53d001da1e47a28e8c25b33b662914c\": container with ID starting with a2485a009d983ab2db34ba188b53985cb53d001da1e47a28e8c25b33b662914c not found: ID does not exist" containerID="a2485a009d983ab2db34ba188b53985cb53d001da1e47a28e8c25b33b662914c"
Jul 20 19:47:30.676923 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.676873    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2485a009d983ab2db34ba188b53985cb53d001da1e47a28e8c25b33b662914c"} err="failed to get container status \"a2485a009d983ab2db34ba188b53985cb53d001da1e47a28e8c25b33b662914c\": rpc error: code = NotFound desc = could not find container \"a2485a009d983ab2db34ba188b53985cb53d001da1e47a28e8c25b33b662914c\": container with ID starting with a2485a009d983ab2db34ba188b53985cb53d001da1e47a28e8c25b33b662914c not found: ID does not exist"
Jul 20 19:47:30.684650 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.684614    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"]
Jul 20 19:47:30.688740 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:30.688712    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-561ddcc3-7448564cf7-fcqwq"]
Jul 20 19:47:32.265575 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:32.265542    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffdfa7ce-3617-4a93-b714-771e77e080fa" path="/var/lib/kubelet/pods/ffdfa7ce-3617-4a93-b714-771e77e080fa/volumes"
Jul 20 19:47:32.678264 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:32.678230    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:47:34.832701 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:34.832663    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:34.833108 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:34.832817    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd"]
Jul 20 19:47:34.837689 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:34.837660    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-561ddcc3-s92nd"]
Jul 20 19:47:35.199358 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:35.199278    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:36.266371 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:36.266340    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66e98d6c-1ece-4186-9ee1-94bf80bb5257" path="/var/lib/kubelet/pods/66e98d6c-1ece-4186-9ee1-94bf80bb5257/volumes"
Jul 20 19:47:40.953496 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:40.953436    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:41.051866 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:41.051823    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:41.237392 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:41.237299    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:41.446075 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:41.446048    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:41.581638 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:41.581605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:41.679567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:41.679526    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:41.799881 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:41.799827    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:47.679892 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:47.679858    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:47.790618 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:47.790588    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:47.880447 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:47.880416    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:48.026411 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:48.026327    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:53.735573 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:53.735538    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:47:53.834020 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:47:53.833988    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:00.567119 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:00.567082    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:01.041714 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:01.041661    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:01.289518 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:01.289483    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:04.273625 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.273542    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:04.362660 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.362622    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"]
Jul 20 19:48:04.362974 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.362961    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffdfa7ce-3617-4a93-b714-771e77e080fa" containerName="maas-api"
Jul 20 19:48:04.363020 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.362976    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffdfa7ce-3617-4a93-b714-771e77e080fa" containerName="maas-api"
Jul 20 19:48:04.363020 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.362989    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66e98d6c-1ece-4186-9ee1-94bf80bb5257" containerName="revoke-keys"
Jul 20 19:48:04.363020 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.362995    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e98d6c-1ece-4186-9ee1-94bf80bb5257" containerName="revoke-keys"
Jul 20 19:48:04.363112 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.363050    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffdfa7ce-3617-4a93-b714-771e77e080fa" containerName="maas-api"
Jul 20 19:48:04.363112 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.363059    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="66e98d6c-1ece-4186-9ee1-94bf80bb5257" containerName="revoke-keys"
Jul 20 19:48:04.364806 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.364781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:04.366171 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.366152    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:04.368443 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.368419    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:48:04.368565 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.368552    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a730d34e-serving-cert\""
Jul 20 19:48:04.368618 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.368554    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hv847\""
Jul 20 19:48:04.369442 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.369402    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:48:04.377398 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.377375    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"]
Jul 20 19:48:04.434640 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.434604    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:04.552983 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.552893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28b75853-3012-4cd8-a2b4-74eabeff4f7a-openshift-service-ca\") pod \"maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9\" (UID: \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:04.552983 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.552932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28b75853-3012-4cd8-a2b4-74eabeff4f7a-maas-api-tls\") pod \"maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9\" (UID: \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:04.553179 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.553029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2lgv\" (UniqueName: \"kubernetes.io/projected/28b75853-3012-4cd8-a2b4-74eabeff4f7a-kube-api-access-d2lgv\") pod \"maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9\" (UID: \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:04.654272 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.654229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28b75853-3012-4cd8-a2b4-74eabeff4f7a-openshift-service-ca\") pod \"maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9\" (UID: \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:04.654272 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.654274    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28b75853-3012-4cd8-a2b4-74eabeff4f7a-maas-api-tls\") pod \"maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9\" (UID: \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:04.654503 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.654346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2lgv\" (UniqueName: \"kubernetes.io/projected/28b75853-3012-4cd8-a2b4-74eabeff4f7a-kube-api-access-d2lgv\") pod \"maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9\" (UID: \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:04.654503 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:48:04.654454    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-serving-cert: secret "maas-api-e2e-mt-a730d34e-serving-cert" not found
Jul 20 19:48:04.654580 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:48:04.654521    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28b75853-3012-4cd8-a2b4-74eabeff4f7a-maas-api-tls podName:28b75853-3012-4cd8-a2b4-74eabeff4f7a nodeName:}" failed. No retries permitted until 2026-07-20 19:48:05.154503185 +0000 UTC m=+1971.378130353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/28b75853-3012-4cd8-a2b4-74eabeff4f7a-maas-api-tls") pod "maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9" (UID: "28b75853-3012-4cd8-a2b4-74eabeff4f7a") : secret "maas-api-e2e-mt-a730d34e-serving-cert" not found
Jul 20 19:48:04.654955 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.654935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28b75853-3012-4cd8-a2b4-74eabeff4f7a-openshift-service-ca\") pod \"maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9\" (UID: \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:04.663257 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.663234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2lgv\" (UniqueName: \"kubernetes.io/projected/28b75853-3012-4cd8-a2b4-74eabeff4f7a-kube-api-access-d2lgv\") pod \"maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9\" (UID: \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:04.925107 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:04.925057    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:05.056387 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:05.056355    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:05.157064 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:05.157033    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:05.159202 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:05.159165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28b75853-3012-4cd8-a2b4-74eabeff4f7a-maas-api-tls\") pod \"maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9\" (UID: \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:05.161767 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:05.161750    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28b75853-3012-4cd8-a2b4-74eabeff4f7a-maas-api-tls\") pod \"maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9\" (UID: \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:05.277464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:05.277373    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:05.417360 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:05.417307    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"]
Jul 20 19:48:05.419563 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:48:05.419525    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b75853_3012_4cd8_a2b4_74eabeff4f7a.slice/crio-cf3922154362ac0d7d70d4a6798dff4528b431b556d2cf3b4af075ed09ae40d9 WatchSource:0}: Error finding container cf3922154362ac0d7d70d4a6798dff4528b431b556d2cf3b4af075ed09ae40d9: Status 404 returned error can't find the container with id cf3922154362ac0d7d70d4a6798dff4528b431b556d2cf3b4af075ed09ae40d9
Jul 20 19:48:05.420941 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:05.420920    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:48:05.841949 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:05.841915    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9" event={"ID":"28b75853-3012-4cd8-a2b4-74eabeff4f7a","Type":"ContainerStarted","Data":"cf3922154362ac0d7d70d4a6798dff4528b431b556d2cf3b4af075ed09ae40d9"}
Jul 20 19:48:06.848406 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:06.848370    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9" event={"ID":"28b75853-3012-4cd8-a2b4-74eabeff4f7a","Type":"ContainerStarted","Data":"57e77e42ee196c9c55404b19aca44aa5774936e8b37b543b562678e12a49edfa"}
Jul 20 19:48:06.848791 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:06.848433    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:06.866227 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:06.866158    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9" podStartSLOduration=2.091149286 podStartE2EDuration="2.86614218s" totalImagesPullingTime="774.992894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:48:06.864550505 +0000 UTC m=+1973.088177688" watchObservedRunningTime="2026-07-20 19:48:06.86614218 +0000 UTC m=+1973.089769361"
Jul 20 19:48:08.582768 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:08.582726    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:48:08.760081 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:08.760044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:12.859278 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:12.859251    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:16.783477 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.783446    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"]
Jul 20 19:48:16.786674 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.786651    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.791239 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.791212    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a730d34e\"/\"default-dockercfg-6zvs7\""
Jul 20 19:48:16.791239 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.791232    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a730d34e\"/\"openshift-service-ca.crt\""
Jul 20 19:48:16.791239 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.791234    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a730d34e\"/\"e2e-lifecycle-model-a730d34e-kserve-self-signed-certs\""
Jul 20 19:48:16.791450 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.791283    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a730d34e\"/\"kube-root-ca.crt\""
Jul 20 19:48:16.797580 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.797555    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"]
Jul 20 19:48:16.805475 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.805453    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:16.850832 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.850800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-home\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.850832 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.850838    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-756jq\" (UniqueName: \"kubernetes.io/projected/fec4c566-3210-45a8-a372-ecd7c187694f-kube-api-access-756jq\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.851086 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.850883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-tmp-dir\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.851086 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.850906    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-dshm\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.851086 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.850928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec4c566-3210-45a8-a372-ecd7c187694f-tls-certs\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.851086 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.851024    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-model-cache\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.951616 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.951577    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-tmp-dir\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.951827 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.951629    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-dshm\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.951827 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.951662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec4c566-3210-45a8-a372-ecd7c187694f-tls-certs\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.951827 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.951707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-model-cache\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.951827 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.951751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-home\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.951827 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.951773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-756jq\" (UniqueName: \"kubernetes.io/projected/fec4c566-3210-45a8-a372-ecd7c187694f-kube-api-access-756jq\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.952080 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.952036    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-tmp-dir\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.952080 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.952066    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-model-cache\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.952210 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.952164    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-home\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.954263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.954244    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-dshm\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.954354 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.954337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec4c566-3210-45a8-a372-ecd7c187694f-tls-certs\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:16.960566 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:16.960544    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-756jq\" (UniqueName: \"kubernetes.io/projected/fec4c566-3210-45a8-a372-ecd7c187694f-kube-api-access-756jq\") pod \"e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") " pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:17.095921 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:17.095885    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:17.234643 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:17.234619    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"]
Jul 20 19:48:17.236626 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:48:17.236596    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec4c566_3210_45a8_a372_ecd7c187694f.slice/crio-db59bbe40f3668178a980fdea3232979b4ffc79531bc416fb6ad82cc3390ac38 WatchSource:0}: Error finding container db59bbe40f3668178a980fdea3232979b4ffc79531bc416fb6ad82cc3390ac38: Status 404 returned error can't find the container with id db59bbe40f3668178a980fdea3232979b4ffc79531bc416fb6ad82cc3390ac38
Jul 20 19:48:17.903926 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:17.903885    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh" event={"ID":"fec4c566-3210-45a8-a372-ecd7c187694f","Type":"ContainerStarted","Data":"ccb8ef453ceb2b0783c86363dd718224e0ed8599b35b70d52a843af81485161b"}
Jul 20 19:48:17.903926 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:17.903933    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh" event={"ID":"fec4c566-3210-45a8-a372-ecd7c187694f","Type":"ContainerStarted","Data":"db59bbe40f3668178a980fdea3232979b4ffc79531bc416fb6ad82cc3390ac38"}
Jul 20 19:48:17.921558 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:17.921501    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh" podStartSLOduration=1.921482792 podStartE2EDuration="1.921482792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:48:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:48:17.920385185 +0000 UTC m=+1984.144012367" watchObservedRunningTime="2026-07-20 19:48:17.921482792 +0000 UTC m=+1984.145109973"
Jul 20 19:48:19.996122 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:19.996079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:48:27.096324 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:27.096275    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:27.096727 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:27.096345    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:27.109061 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:27.109033    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:27.964823 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:27.964795    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:48:33.583500 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:33.583459    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:48:51.084811 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:51.084772    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:48:52.649756 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:52.649724    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"]
Jul 20 19:48:52.650215 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:52.649922    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9" podUID="28b75853-3012-4cd8-a2b4-74eabeff4f7a" containerName="maas-api" containerID="cri-o://57e77e42ee196c9c55404b19aca44aa5774936e8b37b543b562678e12a49edfa" gracePeriod=30
Jul 20 19:48:52.678232 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:52.678165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:52.897404 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:52.897382    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:53.073728 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.073645    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2lgv\" (UniqueName: \"kubernetes.io/projected/28b75853-3012-4cd8-a2b4-74eabeff4f7a-kube-api-access-d2lgv\") pod \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\" (UID: \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\") "
Jul 20 19:48:53.073728 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.073698    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28b75853-3012-4cd8-a2b4-74eabeff4f7a-maas-api-tls\") pod \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\" (UID: \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\") "
Jul 20 19:48:53.073914 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.073736    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28b75853-3012-4cd8-a2b4-74eabeff4f7a-openshift-service-ca\") pod \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\" (UID: \"28b75853-3012-4cd8-a2b4-74eabeff4f7a\") "
Jul 20 19:48:53.074151 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.074117    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b75853-3012-4cd8-a2b4-74eabeff4f7a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28b75853-3012-4cd8-a2b4-74eabeff4f7a" (UID: "28b75853-3012-4cd8-a2b4-74eabeff4f7a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:48:53.075900 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.075869    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b75853-3012-4cd8-a2b4-74eabeff4f7a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28b75853-3012-4cd8-a2b4-74eabeff4f7a" (UID: "28b75853-3012-4cd8-a2b4-74eabeff4f7a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:48:53.076000 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.075898    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b75853-3012-4cd8-a2b4-74eabeff4f7a-kube-api-access-d2lgv" (OuterVolumeSpecName: "kube-api-access-d2lgv") pod "28b75853-3012-4cd8-a2b4-74eabeff4f7a" (UID: "28b75853-3012-4cd8-a2b4-74eabeff4f7a"). InnerVolumeSpecName "kube-api-access-d2lgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:48:53.083219 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.083171    2581 generic.go:356] "Generic (PLEG): container finished" podID="28b75853-3012-4cd8-a2b4-74eabeff4f7a" containerID="57e77e42ee196c9c55404b19aca44aa5774936e8b37b543b562678e12a49edfa" exitCode=0
Jul 20 19:48:53.083338 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.083223    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9" event={"ID":"28b75853-3012-4cd8-a2b4-74eabeff4f7a","Type":"ContainerDied","Data":"57e77e42ee196c9c55404b19aca44aa5774936e8b37b543b562678e12a49edfa"}
Jul 20 19:48:53.083338 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.083257    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"
Jul 20 19:48:53.083338 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.083276    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9" event={"ID":"28b75853-3012-4cd8-a2b4-74eabeff4f7a","Type":"ContainerDied","Data":"cf3922154362ac0d7d70d4a6798dff4528b431b556d2cf3b4af075ed09ae40d9"}
Jul 20 19:48:53.083338 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.083297    2581 scope.go:117] "RemoveContainer" containerID="57e77e42ee196c9c55404b19aca44aa5774936e8b37b543b562678e12a49edfa"
Jul 20 19:48:53.092062 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.092047    2581 scope.go:117] "RemoveContainer" containerID="57e77e42ee196c9c55404b19aca44aa5774936e8b37b543b562678e12a49edfa"
Jul 20 19:48:53.092345 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:48:53.092324    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57e77e42ee196c9c55404b19aca44aa5774936e8b37b543b562678e12a49edfa\": container with ID starting with 57e77e42ee196c9c55404b19aca44aa5774936e8b37b543b562678e12a49edfa not found: ID does not exist" containerID="57e77e42ee196c9c55404b19aca44aa5774936e8b37b543b562678e12a49edfa"
Jul 20 19:48:53.092417 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.092351    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57e77e42ee196c9c55404b19aca44aa5774936e8b37b543b562678e12a49edfa"} err="failed to get container status \"57e77e42ee196c9c55404b19aca44aa5774936e8b37b543b562678e12a49edfa\": rpc error: code = NotFound desc = could not find container \"57e77e42ee196c9c55404b19aca44aa5774936e8b37b543b562678e12a49edfa\": container with ID starting with 57e77e42ee196c9c55404b19aca44aa5774936e8b37b543b562678e12a49edfa not found: ID does not exist"
Jul 20 19:48:53.104253 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.104225    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"]
Jul 20 19:48:53.110617 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.110595    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9"]
Jul 20 19:48:53.174860 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.174818    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2lgv\" (UniqueName: \"kubernetes.io/projected/28b75853-3012-4cd8-a2b4-74eabeff4f7a-kube-api-access-d2lgv\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:48:53.174860 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.174857    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28b75853-3012-4cd8-a2b4-74eabeff4f7a-maas-api-tls\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:48:53.175065 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:53.174872    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28b75853-3012-4cd8-a2b4-74eabeff4f7a-openshift-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:48:54.265381 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:54.265345    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28b75853-3012-4cd8-a2b4-74eabeff4f7a" path="/var/lib/kubelet/pods/28b75853-3012-4cd8-a2b4-74eabeff4f7a/volumes"
Jul 20 19:48:55.854411 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:55.854352    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a730d34e-54b44d8569-gf4j9" podUID="28b75853-3012-4cd8-a2b4-74eabeff4f7a" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.47:8443/health\": context deadline exceeded"
Jul 20 19:48:57.013659 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:57.013624    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:48:59.287881 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:48:59.287847    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:00.515250 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:00.515210    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:49:04.272325 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:04.272291    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"]
Jul 20 19:49:04.367065 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:04.367027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:19.292640 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.292597    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh" podUID="fec4c566-3210-45a8-a372-ecd7c187694f" containerName="main" containerID="cri-o://ccb8ef453ceb2b0783c86363dd718224e0ed8599b35b70d52a843af81485161b" gracePeriod=45
Jul 20 19:49:19.546987 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.546932    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:49:19.595230 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.595199    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-home\") pod \"fec4c566-3210-45a8-a372-ecd7c187694f\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") "
Jul 20 19:49:19.595415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.595242    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-model-cache\") pod \"fec4c566-3210-45a8-a372-ecd7c187694f\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") "
Jul 20 19:49:19.595415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.595285    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-756jq\" (UniqueName: \"kubernetes.io/projected/fec4c566-3210-45a8-a372-ecd7c187694f-kube-api-access-756jq\") pod \"fec4c566-3210-45a8-a372-ecd7c187694f\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") "
Jul 20 19:49:19.595415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.595315    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-dshm\") pod \"fec4c566-3210-45a8-a372-ecd7c187694f\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") "
Jul 20 19:49:19.595415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.595336    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-tmp-dir\") pod \"fec4c566-3210-45a8-a372-ecd7c187694f\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") "
Jul 20 19:49:19.595415 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.595383    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec4c566-3210-45a8-a372-ecd7c187694f-tls-certs\") pod \"fec4c566-3210-45a8-a372-ecd7c187694f\" (UID: \"fec4c566-3210-45a8-a372-ecd7c187694f\") "
Jul 20 19:49:19.595658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.595445    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-home" (OuterVolumeSpecName: "home") pod "fec4c566-3210-45a8-a372-ecd7c187694f" (UID: "fec4c566-3210-45a8-a372-ecd7c187694f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:49:19.595658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.595514    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-model-cache" (OuterVolumeSpecName: "model-cache") pod "fec4c566-3210-45a8-a372-ecd7c187694f" (UID: "fec4c566-3210-45a8-a372-ecd7c187694f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:49:19.595658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.595649    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fec4c566-3210-45a8-a372-ecd7c187694f" (UID: "fec4c566-3210-45a8-a372-ecd7c187694f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:49:19.595816 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.595728    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-home\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:49:19.595816 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.595752    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-model-cache\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:49:19.597632 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.597586    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec4c566-3210-45a8-a372-ecd7c187694f-kube-api-access-756jq" (OuterVolumeSpecName: "kube-api-access-756jq") pod "fec4c566-3210-45a8-a372-ecd7c187694f" (UID: "fec4c566-3210-45a8-a372-ecd7c187694f"). InnerVolumeSpecName "kube-api-access-756jq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:49:19.597744 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.597687    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec4c566-3210-45a8-a372-ecd7c187694f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fec4c566-3210-45a8-a372-ecd7c187694f" (UID: "fec4c566-3210-45a8-a372-ecd7c187694f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:49:19.597744 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.597716    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-dshm" (OuterVolumeSpecName: "dshm") pod "fec4c566-3210-45a8-a372-ecd7c187694f" (UID: "fec4c566-3210-45a8-a372-ecd7c187694f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:49:19.696371 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.696336    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-756jq\" (UniqueName: \"kubernetes.io/projected/fec4c566-3210-45a8-a372-ecd7c187694f-kube-api-access-756jq\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:49:19.696371 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.696364    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-dshm\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:49:19.696371 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.696375    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec4c566-3210-45a8-a372-ecd7c187694f-tmp-dir\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:49:19.696599 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:19.696389    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec4c566-3210-45a8-a372-ecd7c187694f-tls-certs\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:49:20.220162 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:20.220124    2581 generic.go:356] "Generic (PLEG): container finished" podID="fec4c566-3210-45a8-a372-ecd7c187694f" containerID="ccb8ef453ceb2b0783c86363dd718224e0ed8599b35b70d52a843af81485161b" exitCode=0
Jul 20 19:49:20.220396 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:20.220169    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"
Jul 20 19:49:20.220396 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:20.220216    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh" event={"ID":"fec4c566-3210-45a8-a372-ecd7c187694f","Type":"ContainerDied","Data":"ccb8ef453ceb2b0783c86363dd718224e0ed8599b35b70d52a843af81485161b"}
Jul 20 19:49:20.220396 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:20.220265    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh" event={"ID":"fec4c566-3210-45a8-a372-ecd7c187694f","Type":"ContainerDied","Data":"db59bbe40f3668178a980fdea3232979b4ffc79531bc416fb6ad82cc3390ac38"}
Jul 20 19:49:20.220396 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:20.220292    2581 scope.go:117] "RemoveContainer" containerID="ccb8ef453ceb2b0783c86363dd718224e0ed8599b35b70d52a843af81485161b"
Jul 20 19:49:20.230003 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:20.229986    2581 scope.go:117] "RemoveContainer" containerID="ccb8ef453ceb2b0783c86363dd718224e0ed8599b35b70d52a843af81485161b"
Jul 20 19:49:20.230323 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:49:20.230305    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccb8ef453ceb2b0783c86363dd718224e0ed8599b35b70d52a843af81485161b\": container with ID starting with ccb8ef453ceb2b0783c86363dd718224e0ed8599b35b70d52a843af81485161b not found: ID does not exist" containerID="ccb8ef453ceb2b0783c86363dd718224e0ed8599b35b70d52a843af81485161b"
Jul 20 19:49:20.230391 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:20.230335    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb8ef453ceb2b0783c86363dd718224e0ed8599b35b70d52a843af81485161b"} err="failed to get container status \"ccb8ef453ceb2b0783c86363dd718224e0ed8599b35b70d52a843af81485161b\": rpc error: code = NotFound desc = could not find container \"ccb8ef453ceb2b0783c86363dd718224e0ed8599b35b70d52a843af81485161b\": container with ID starting with ccb8ef453ceb2b0783c86363dd718224e0ed8599b35b70d52a843af81485161b not found: ID does not exist"
Jul 20 19:49:20.241006 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:20.240978    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"]
Jul 20 19:49:20.244761 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:20.244736    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a730d34e/e2e-lifecycle-model-a730d34e-kserve-55466bf7ff-28txh"]
Jul 20 19:49:20.265883 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:20.265854    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fec4c566-3210-45a8-a372-ecd7c187694f" path="/var/lib/kubelet/pods/fec4c566-3210-45a8-a372-ecd7c187694f/volumes"
Jul 20 19:49:38.302916 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:38.302836    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:38.402514 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:38.402478    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:41.404336 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:41.404271    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:41.638970 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:41.638945    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:47.324942 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:47.324898    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:52.997870 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:52.997816    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:53.062847 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:53.062816    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:53.276974 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:53.276884    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:53.512900 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:53.512867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:54.614453 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:54.614422    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:54.710687 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:54.710648    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:54.811683 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:54.811651    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:55.517950 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:55.517922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:55.607196 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:55.607154    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:55.708877 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:55.708852    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:49:57.080003 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:57.079968    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:49:57.112001 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:49:57.111972    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:03.161142 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:03.161099    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:03.239793 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:03.239760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:04.041250 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:04.041212    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:09.594854 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:09.594819    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:50:10.097689 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:10.097658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:10.202148 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:10.202114    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:10.300744 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:10.300705    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:14.328678 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:14.328639    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:50:14.334961 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:14.334943    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:50:20.819121 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:20.819089    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:21.152914 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:21.152883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:42.129837 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:42.129804    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:48.906219 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:48.906170    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:48.981238 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:48.981172    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:49.295106 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:49.295029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:49.566604 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:49.566509    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:49.786852 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:49.786821    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:52.296704 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.296670    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:52.391031 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.390994    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"]
Jul 20 19:50:52.391517 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.391500    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec4c566-3210-45a8-a372-ecd7c187694f" containerName="main"
Jul 20 19:50:52.391567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.391521    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec4c566-3210-45a8-a372-ecd7c187694f" containerName="main"
Jul 20 19:50:52.391567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.391539    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b75853-3012-4cd8-a2b4-74eabeff4f7a" containerName="maas-api"
Jul 20 19:50:52.391567 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.391550    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b75853-3012-4cd8-a2b4-74eabeff4f7a" containerName="maas-api"
Jul 20 19:50:52.391681 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.391638    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b75853-3012-4cd8-a2b4-74eabeff4f7a" containerName="maas-api"
Jul 20 19:50:52.391681 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.391653    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fec4c566-3210-45a8-a372-ecd7c187694f" containerName="main"
Jul 20 19:50:52.395594 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.395568    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:50:52.396351 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.395724    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:52.399062 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.399037    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hv847\""
Jul 20 19:50:52.399385 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.399365    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:50:52.399947 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.399921    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-aae264-serving-cert\""
Jul 20 19:50:52.400136 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.400118    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:50:52.408604 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.408581    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"]
Jul 20 19:50:52.471711 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.471679    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:52.473868 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.473845    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-maas-api-tls\") pod \"maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22\" (UID: \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:50:52.473976 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.473911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22\" (UID: \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:50:52.474024 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.473989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdhtp\" (UniqueName: \"kubernetes.io/projected/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-kube-api-access-fdhtp\") pod \"maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22\" (UID: \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:50:52.574527 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.574448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22\" (UID: \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:50:52.574527 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.574485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdhtp\" (UniqueName: \"kubernetes.io/projected/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-kube-api-access-fdhtp\") pod \"maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22\" (UID: \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:50:52.574723 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.574540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-maas-api-tls\") pod \"maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22\" (UID: \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:50:52.575380 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.575223    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22\" (UID: \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:50:52.577127 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.577106    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-maas-api-tls\") pod \"maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22\" (UID: \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:50:52.586360 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.586338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdhtp\" (UniqueName: \"kubernetes.io/projected/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-kube-api-access-fdhtp\") pod \"maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22\" (UID: \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:50:52.611284 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.611255    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:52.710205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.710169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:50:52.850505 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:52.850481    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"]
Jul 20 19:50:52.852874 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:50:52.852847    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e09a16_bc15_49d8_901a_d16d1ebd7cc0.slice/crio-eea907c15e527798b38744eafd8eafe940fdf58e99ae5ff12d7c58a16c274a02 WatchSource:0}: Error finding container eea907c15e527798b38744eafd8eafe940fdf58e99ae5ff12d7c58a16c274a02: Status 404 returned error can't find the container with id eea907c15e527798b38744eafd8eafe940fdf58e99ae5ff12d7c58a16c274a02
Jul 20 19:50:53.039109 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:53.039074    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:53.141378 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:53.141297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:53.689968 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:53.689938    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22" event={"ID":"52e09a16-bc15-49d8-901a-d16d1ebd7cc0","Type":"ContainerStarted","Data":"eea907c15e527798b38744eafd8eafe940fdf58e99ae5ff12d7c58a16c274a02"}
Jul 20 19:50:54.697055 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:54.697017    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22" event={"ID":"52e09a16-bc15-49d8-901a-d16d1ebd7cc0","Type":"ContainerStarted","Data":"586476df800425519ee232cd8080852c4c73349b99312e3229164dbce3a636e9"}
Jul 20 19:50:54.697490 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:54.697126    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:50:54.716324 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:54.716260    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22" podStartSLOduration=1.244471497 podStartE2EDuration="2.716244601s" totalImagesPullingTime="1.471773104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:50:54.714220483 +0000 UTC m=+2140.937847661" watchObservedRunningTime="2026-07-20 19:50:54.716244601 +0000 UTC m=+2140.939871781"
Jul 20 19:50:56.783565 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:56.783537    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:57.111624 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:57.111581    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:57.433983 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:57.433900    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:57.529095 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:57.529068    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:50:58.465417 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:50:58.465383    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:51:00.442920 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.442887    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"]
Jul 20 19:51:00.446090 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.446075    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:51:00.448761 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.448740    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-2fb506-serving-cert\""
Jul 20 19:51:00.465235 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.465210    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"]
Jul 20 19:51:00.539979 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.539950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm\" (UID: \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:51:00.540153 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.539991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-maas-api-tls\") pod \"maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm\" (UID: \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:51:00.540153 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.540046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv7hw\" (UniqueName: \"kubernetes.io/projected/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-kube-api-access-mv7hw\") pod \"maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm\" (UID: \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:51:00.640716 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.640681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm\" (UID: \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:51:00.640924 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.640725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-maas-api-tls\") pod \"maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm\" (UID: \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:51:00.640924 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.640752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv7hw\" (UniqueName: \"kubernetes.io/projected/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-kube-api-access-mv7hw\") pod \"maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm\" (UID: \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:51:00.641428 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.641404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm\" (UID: \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:51:00.643593 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.643571    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-maas-api-tls\") pod \"maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm\" (UID: \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:51:00.650015 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.649992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv7hw\" (UniqueName: \"kubernetes.io/projected/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-kube-api-access-mv7hw\") pod \"maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm\" (UID: \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:51:00.707826 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.707750    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:51:00.756389 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.756356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:51:00.896126 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:00.896102    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"]
Jul 20 19:51:00.898914 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:51:00.898882    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56f5ef3c_ce9a_406a_bd40_cc208d8d727f.slice/crio-e270688aea6b50c7167e2767ab360e85381a2feb59d1157795b86331ab858255 WatchSource:0}: Error finding container e270688aea6b50c7167e2767ab360e85381a2feb59d1157795b86331ab858255: Status 404 returned error can't find the container with id e270688aea6b50c7167e2767ab360e85381a2feb59d1157795b86331ab858255
Jul 20 19:51:01.052240 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:01.052139    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:51:01.150620 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:01.150579    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:51:01.733978 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:01.733945    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm" event={"ID":"56f5ef3c-ce9a-406a-bd40-cc208d8d727f","Type":"ContainerStarted","Data":"e270688aea6b50c7167e2767ab360e85381a2feb59d1157795b86331ab858255"}
Jul 20 19:51:02.739850 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:02.739815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm" event={"ID":"56f5ef3c-ce9a-406a-bd40-cc208d8d727f","Type":"ContainerStarted","Data":"f56c6265fa0975bc9444b9f4d505788a69f4914138b553fb4334a9199653cc9a"}
Jul 20 19:51:02.740257 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:02.739929    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:51:02.759629 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:02.759583    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm" podStartSLOduration=1.532848931 podStartE2EDuration="2.759567682s" totalImagesPullingTime="1.226718751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:51:02.758528821 +0000 UTC m=+2148.982156012" watchObservedRunningTime="2026-07-20 19:51:02.759567682 +0000 UTC m=+2148.983194902"
Jul 20 19:51:04.811871 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:04.811779    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:51:08.751315 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:08.751282    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:51:10.393408 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:10.393372    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:51:13.861798 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:13.861767    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:51:13.963779 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:13.963730    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:51:14.429269 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:14.429241    2581 scope.go:117] "RemoveContainer" containerID="8b35f5c3fc0ccdc8fd4a5489c46420119ae478f01e2432a39e402e208b995bbd"
Jul 20 19:51:21.936062 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:21.936017    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:51:22.034129 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.034098    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:51:22.092403 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.092373    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"]
Jul 20 19:51:22.095546 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.095531    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.098107 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.098086    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-aae264\"/\"openshift-service-ca.crt\""
Jul 20 19:51:22.099173 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.099156    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-aae264\"/\"default-dockercfg-snhdx\""
Jul 20 19:51:22.099290 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.099228    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-aae264\"/\"test-model-aae264-kserve-self-signed-certs\""
Jul 20 19:51:22.099290 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.099257    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-aae264\"/\"kube-root-ca.crt\""
Jul 20 19:51:22.106777 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.106758    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"]
Jul 20 19:51:22.126581 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.126541    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:51:22.230284 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.230176    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-tls-certs\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.230284 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.230236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-home\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.230484 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.230304    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-dshm\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.230484 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.230343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b45h4\" (UniqueName: \"kubernetes.io/projected/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-kube-api-access-b45h4\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.230484 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.230410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-model-cache\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.230484 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.230442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-tmp-dir\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.331774 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.331737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-model-cache\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.331964 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.331791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-tmp-dir\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.331964 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.331837    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-tls-certs\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.331964 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.331861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-home\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.331964 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.331900    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-dshm\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.331964 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.331930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b45h4\" (UniqueName: \"kubernetes.io/projected/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-kube-api-access-b45h4\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.332266 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.332228    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-model-cache\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.332266 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.332255    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-tmp-dir\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.332363 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.332274    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-home\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.334238 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.334219    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-dshm\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.334421 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.334405    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-tls-certs\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.341676 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.341642    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b45h4\" (UniqueName: \"kubernetes.io/projected/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-kube-api-access-b45h4\") pod \"test-model-aae264-kserve-9d6bd9b7-b4khx\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") " pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.405313 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.405279    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:22.541885 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.541856    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"]
Jul 20 19:51:22.543994 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:51:22.543965    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b2eb7ec_b9f1_4448_be93_f5f24a6fc1cf.slice/crio-138adee16f35486918cacdf3accd623c123bafea0c60577d0c2c65257e1a226e WatchSource:0}: Error finding container 138adee16f35486918cacdf3accd623c123bafea0c60577d0c2c65257e1a226e: Status 404 returned error can't find the container with id 138adee16f35486918cacdf3accd623c123bafea0c60577d0c2c65257e1a226e
Jul 20 19:51:22.842097 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.842057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx" event={"ID":"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf","Type":"ContainerStarted","Data":"c48745559e1aac7f08edaeaaa1e5cf9d1a84c4ef0da99d873c4c33db1b5858d4"}
Jul 20 19:51:22.842295 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.842104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx" event={"ID":"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf","Type":"ContainerStarted","Data":"138adee16f35486918cacdf3accd623c123bafea0c60577d0c2c65257e1a226e"}
Jul 20 19:51:22.864637 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:22.864588    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx" podStartSLOduration=0.864570247 podStartE2EDuration="864.570247ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:51:22.862103986 +0000 UTC m=+2169.085731166" watchObservedRunningTime="2026-07-20 19:51:22.864570247 +0000 UTC m=+2169.088197459"
Jul 20 19:51:25.571724 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:25.571684    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:51:32.405808 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:32.405773    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:32.405808 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:32.405817    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:32.418346 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:32.418325    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:32.908141 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:32.908110    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:51:36.690792 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:36.690754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:51:47.588913 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:47.588881    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:51:50.541909 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:50.541867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:51:51.979678 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:51:51.979636    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:52:04.077867 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:04.077827    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:52:20.896782 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:20.896745    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:29.734332 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:29.734300    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"]
Jul 20 19:52:29.766073 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:29.766036    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:30.688290 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:30.688252    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:30.794668 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:30.794631    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc"]
Jul 20 19:52:30.797986 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:30.797969    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc"
Jul 20 19:52:30.800406 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:30.800380    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\""
Jul 20 19:52:30.805673 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:30.805648    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc"]
Jul 20 19:52:30.910426 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:30.910391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc\" (UID: \"b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc"
Jul 20 19:52:31.011794 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:31.011713    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc\" (UID: \"b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc"
Jul 20 19:52:31.012378 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:31.012358    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc\" (UID: \"b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc"
Jul 20 19:52:31.111039 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:31.111009    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc"
Jul 20 19:52:31.250357 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:31.250296    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc"]
Jul 20 19:52:31.252789 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:52:31.252759    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f2cb4b_f78b_4d06_b7bc_92dd048d71bf.slice/crio-46571a7683cb76bc45bc3bd2ea15a4f8d841c8460e41f3193d2929ec7969d34d WatchSource:0}: Error finding container 46571a7683cb76bc45bc3bd2ea15a4f8d841c8460e41f3193d2929ec7969d34d: Status 404 returned error can't find the container with id 46571a7683cb76bc45bc3bd2ea15a4f8d841c8460e41f3193d2929ec7969d34d
Jul 20 19:52:31.453133 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:31.453102    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:31.559667 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:31.559641    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:32.198160 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:32.198069    2581 generic.go:356] "Generic (PLEG): container finished" podID="b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf" containerID="072eff1db460f743dcfc339aa7b561a60523e0289a2689efaf8520753f636031" exitCode=0
Jul 20 19:52:32.198160 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:32.198129    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc" event={"ID":"b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf","Type":"ContainerDied","Data":"072eff1db460f743dcfc339aa7b561a60523e0289a2689efaf8520753f636031"}
Jul 20 19:52:32.198578 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:32.198169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc" event={"ID":"b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf","Type":"ContainerStarted","Data":"46571a7683cb76bc45bc3bd2ea15a4f8d841c8460e41f3193d2929ec7969d34d"}
Jul 20 19:52:33.331565 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:33.331543    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc"
Jul 20 19:52:33.433913 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:33.433883    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf-maas-api-service-ca\") pod \"b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf\" (UID: \"b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf\") "
Jul 20 19:52:33.434287 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:33.434263    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf" (UID: "b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:52:33.534826 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:33.534747    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf-maas-api-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:52:34.209277 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:34.209179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc" event={"ID":"b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf","Type":"ContainerDied","Data":"46571a7683cb76bc45bc3bd2ea15a4f8d841c8460e41f3193d2929ec7969d34d"}
Jul 20 19:52:34.209277 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:34.209235    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc"
Jul 20 19:52:34.209277 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:34.209248    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46571a7683cb76bc45bc3bd2ea15a4f8d841c8460e41f3193d2929ec7969d34d"
Jul 20 19:52:34.481249 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:34.481151    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:52:41.231005 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:41.230965    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"]
Jul 20 19:52:41.231588 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:41.231228    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22" podUID="52e09a16-bc15-49d8-901a-d16d1ebd7cc0" containerName="maas-api" containerID="cri-o://586476df800425519ee232cd8080852c4c73349b99312e3229164dbce3a636e9" gracePeriod=30
Jul 20 19:52:41.255080 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:41.255048    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:41.486126 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:41.486055    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:52:41.606708 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:41.606679    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-maas-api-tls\") pod \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\" (UID: \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\") "
Jul 20 19:52:41.606877 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:41.606722    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-openshift-service-ca\") pod \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\" (UID: \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\") "
Jul 20 19:52:41.606877 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:41.606804    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdhtp\" (UniqueName: \"kubernetes.io/projected/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-kube-api-access-fdhtp\") pod \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\" (UID: \"52e09a16-bc15-49d8-901a-d16d1ebd7cc0\") "
Jul 20 19:52:41.607156 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:41.607126    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "52e09a16-bc15-49d8-901a-d16d1ebd7cc0" (UID: "52e09a16-bc15-49d8-901a-d16d1ebd7cc0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:52:41.609056 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:41.609035    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-kube-api-access-fdhtp" (OuterVolumeSpecName: "kube-api-access-fdhtp") pod "52e09a16-bc15-49d8-901a-d16d1ebd7cc0" (UID: "52e09a16-bc15-49d8-901a-d16d1ebd7cc0"). InnerVolumeSpecName "kube-api-access-fdhtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:52:41.609146 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:41.609078    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "52e09a16-bc15-49d8-901a-d16d1ebd7cc0" (UID: "52e09a16-bc15-49d8-901a-d16d1ebd7cc0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:52:41.707861 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:41.707820    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdhtp\" (UniqueName: \"kubernetes.io/projected/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-kube-api-access-fdhtp\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:52:41.707861 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:41.707853    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-maas-api-tls\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:52:41.707861 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:41.707864    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52e09a16-bc15-49d8-901a-d16d1ebd7cc0-openshift-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:52:42.255285 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:42.255242    2581 generic.go:356] "Generic (PLEG): container finished" podID="52e09a16-bc15-49d8-901a-d16d1ebd7cc0" containerID="586476df800425519ee232cd8080852c4c73349b99312e3229164dbce3a636e9" exitCode=0
Jul 20 19:52:42.255719 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:42.255301    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"
Jul 20 19:52:42.255719 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:42.255318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22" event={"ID":"52e09a16-bc15-49d8-901a-d16d1ebd7cc0","Type":"ContainerDied","Data":"586476df800425519ee232cd8080852c4c73349b99312e3229164dbce3a636e9"}
Jul 20 19:52:42.255719 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:42.255377    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22" event={"ID":"52e09a16-bc15-49d8-901a-d16d1ebd7cc0","Type":"ContainerDied","Data":"eea907c15e527798b38744eafd8eafe940fdf58e99ae5ff12d7c58a16c274a02"}
Jul 20 19:52:42.255719 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:42.255412    2581 scope.go:117] "RemoveContainer" containerID="586476df800425519ee232cd8080852c4c73349b99312e3229164dbce3a636e9"
Jul 20 19:52:42.265305 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:42.265276    2581 scope.go:117] "RemoveContainer" containerID="586476df800425519ee232cd8080852c4c73349b99312e3229164dbce3a636e9"
Jul 20 19:52:42.265568 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:52:42.265548    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"586476df800425519ee232cd8080852c4c73349b99312e3229164dbce3a636e9\": container with ID starting with 586476df800425519ee232cd8080852c4c73349b99312e3229164dbce3a636e9 not found: ID does not exist" containerID="586476df800425519ee232cd8080852c4c73349b99312e3229164dbce3a636e9"
Jul 20 19:52:42.265630 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:42.265576    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"586476df800425519ee232cd8080852c4c73349b99312e3229164dbce3a636e9"} err="failed to get container status \"586476df800425519ee232cd8080852c4c73349b99312e3229164dbce3a636e9\": rpc error: code = NotFound desc = could not find container \"586476df800425519ee232cd8080852c4c73349b99312e3229164dbce3a636e9\": container with ID starting with 586476df800425519ee232cd8080852c4c73349b99312e3229164dbce3a636e9 not found: ID does not exist"
Jul 20 19:52:42.279452 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:42.279421    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"]
Jul 20 19:52:42.284521 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:42.284500    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-aae264-7df844d9f9-4jm22"]
Jul 20 19:52:44.266018 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:44.265975    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52e09a16-bc15-49d8-901a-d16d1ebd7cc0" path="/var/lib/kubelet/pods/52e09a16-bc15-49d8-901a-d16d1ebd7cc0/volumes"
Jul 20 19:52:44.755280 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:44.755239    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx" podUID="8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf" containerName="main" containerID="cri-o://c48745559e1aac7f08edaeaaa1e5cf9d1a84c4ef0da99d873c4c33db1b5858d4" gracePeriod=45
Jul 20 19:52:45.013581 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.013522    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:52:45.039941 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.039914    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b45h4\" (UniqueName: \"kubernetes.io/projected/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-kube-api-access-b45h4\") pod \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") "
Jul 20 19:52:45.040103 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.039971    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-tmp-dir\") pod \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") "
Jul 20 19:52:45.040103 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.040017    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-home\") pod \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") "
Jul 20 19:52:45.040103 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.040048    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-tls-certs\") pod \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") "
Jul 20 19:52:45.040103 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.040075    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-dshm\") pod \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") "
Jul 20 19:52:45.040370 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.040306    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf" (UID: "8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:52:45.040370 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.040320    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-home" (OuterVolumeSpecName: "home") pod "8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf" (UID: "8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:52:45.042400 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.042373    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf" (UID: "8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:52:45.042808 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.042783    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-kube-api-access-b45h4" (OuterVolumeSpecName: "kube-api-access-b45h4") pod "8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf" (UID: "8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf"). InnerVolumeSpecName "kube-api-access-b45h4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:52:45.042808 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.042784    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-dshm" (OuterVolumeSpecName: "dshm") pod "8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf" (UID: "8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:52:45.141461 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.141427    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-model-cache\") pod \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\" (UID: \"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf\") "
Jul 20 19:52:45.141638 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.141627    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b45h4\" (UniqueName: \"kubernetes.io/projected/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-kube-api-access-b45h4\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:52:45.141683 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.141640    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-tmp-dir\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:52:45.141683 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.141651    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-home\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:52:45.141683 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.141659    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-tls-certs\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:52:45.141683 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.141667    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-dshm\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:52:45.141808 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.141705    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-model-cache" (OuterVolumeSpecName: "model-cache") pod "8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf" (UID: "8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:52:45.242523 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.242490    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf-model-cache\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:52:45.272758 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.272678    2581 generic.go:356] "Generic (PLEG): container finished" podID="8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf" containerID="c48745559e1aac7f08edaeaaa1e5cf9d1a84c4ef0da99d873c4c33db1b5858d4" exitCode=0
Jul 20 19:52:45.272758 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.272722    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"
Jul 20 19:52:45.272758 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.272741    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx" event={"ID":"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf","Type":"ContainerDied","Data":"c48745559e1aac7f08edaeaaa1e5cf9d1a84c4ef0da99d873c4c33db1b5858d4"}
Jul 20 19:52:45.273222 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.272780    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx" event={"ID":"8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf","Type":"ContainerDied","Data":"138adee16f35486918cacdf3accd623c123bafea0c60577d0c2c65257e1a226e"}
Jul 20 19:52:45.273222 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.272799    2581 scope.go:117] "RemoveContainer" containerID="c48745559e1aac7f08edaeaaa1e5cf9d1a84c4ef0da99d873c4c33db1b5858d4"
Jul 20 19:52:45.281966 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.281947    2581 scope.go:117] "RemoveContainer" containerID="c48745559e1aac7f08edaeaaa1e5cf9d1a84c4ef0da99d873c4c33db1b5858d4"
Jul 20 19:52:45.282270 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:52:45.282252    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c48745559e1aac7f08edaeaaa1e5cf9d1a84c4ef0da99d873c4c33db1b5858d4\": container with ID starting with c48745559e1aac7f08edaeaaa1e5cf9d1a84c4ef0da99d873c4c33db1b5858d4 not found: ID does not exist" containerID="c48745559e1aac7f08edaeaaa1e5cf9d1a84c4ef0da99d873c4c33db1b5858d4"
Jul 20 19:52:45.282340 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.282287    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48745559e1aac7f08edaeaaa1e5cf9d1a84c4ef0da99d873c4c33db1b5858d4"} err="failed to get container status \"c48745559e1aac7f08edaeaaa1e5cf9d1a84c4ef0da99d873c4c33db1b5858d4\": rpc error: code = NotFound desc = could not find container \"c48745559e1aac7f08edaeaaa1e5cf9d1a84c4ef0da99d873c4c33db1b5858d4\": container with ID starting with c48745559e1aac7f08edaeaaa1e5cf9d1a84c4ef0da99d873c4c33db1b5858d4 not found: ID does not exist"
Jul 20 19:52:45.293536 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.293516    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"]
Jul 20 19:52:45.299424 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.299404    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-aae264/test-model-aae264-kserve-9d6bd9b7-b4khx"]
Jul 20 19:52:45.890749 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.890716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:45.907717 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.907690    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc"]
Jul 20 19:52:45.909919 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:45.909894    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-aae264-7nkpc"]
Jul 20 19:52:46.266381 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:46.266296    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf" path="/var/lib/kubelet/pods/8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf/volumes"
Jul 20 19:52:46.266661 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:46.266647    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf" path="/var/lib/kubelet/pods/b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf/volumes"
Jul 20 19:52:46.292952 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:46.292926    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:50.775653 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:50.775620    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:52:52.105314 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.105280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:52.170112 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.170081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:52.368613 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.368535    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:52.611378 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.611349    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:52.720464 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.720382    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c"]
Jul 20 19:52:52.720719 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.720705    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52e09a16-bc15-49d8-901a-d16d1ebd7cc0" containerName="maas-api"
Jul 20 19:52:52.720760 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.720721    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="52e09a16-bc15-49d8-901a-d16d1ebd7cc0" containerName="maas-api"
Jul 20 19:52:52.720760 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.720735    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf" containerName="revoke-keys"
Jul 20 19:52:52.720760 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.720740    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf" containerName="revoke-keys"
Jul 20 19:52:52.720760 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.720753    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf" containerName="main"
Jul 20 19:52:52.720760 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.720758    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf" containerName="main"
Jul 20 19:52:52.720915 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.720807    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8f2cb4b-f78b-4d06-b7bc-92dd048d71bf" containerName="revoke-keys"
Jul 20 19:52:52.720915 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.720817    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b2eb7ec-b9f1-4448-be93-f5f24a6fc1cf" containerName="main"
Jul 20 19:52:52.720915 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.720823    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="52e09a16-bc15-49d8-901a-d16d1ebd7cc0" containerName="maas-api"
Jul 20 19:52:52.723888 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.723872    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c"
Jul 20 19:52:52.726214 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.726176    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\""
Jul 20 19:52:52.731694 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.731674    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c"]
Jul 20 19:52:52.802561 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.802534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12bed2d0-4234-4047-b44c-0a927bedd607-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c\" (UID: \"12bed2d0-4234-4047-b44c-0a927bedd607\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c"
Jul 20 19:52:52.903792 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.903752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12bed2d0-4234-4047-b44c-0a927bedd607-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c\" (UID: \"12bed2d0-4234-4047-b44c-0a927bedd607\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c"
Jul 20 19:52:52.904428 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:52.904406    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12bed2d0-4234-4047-b44c-0a927bedd607-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c\" (UID: \"12bed2d0-4234-4047-b44c-0a927bedd607\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c"
Jul 20 19:52:53.035854 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:53.035758    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c"
Jul 20 19:52:53.170106 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:53.170059    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c"]
Jul 20 19:52:53.172648 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:52:53.172627    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12bed2d0_4234_4047_b44c_0a927bedd607.slice/crio-b0578c1418248fd0a88894f0512d52c8868e4793ed2130ed73eb470dbd431d56 WatchSource:0}: Error finding container b0578c1418248fd0a88894f0512d52c8868e4793ed2130ed73eb470dbd431d56: Status 404 returned error can't find the container with id b0578c1418248fd0a88894f0512d52c8868e4793ed2130ed73eb470dbd431d56
Jul 20 19:52:53.285690 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:53.285658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:53.315170 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:53.315090    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c" event={"ID":"12bed2d0-4234-4047-b44c-0a927bedd607","Type":"ContainerStarted","Data":"b0578c1418248fd0a88894f0512d52c8868e4793ed2130ed73eb470dbd431d56"}
Jul 20 19:52:53.385274 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:53.385221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:52:54.321039 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:54.320946    2581 generic.go:356] "Generic (PLEG): container finished" podID="12bed2d0-4234-4047-b44c-0a927bedd607" containerID="0b0799e01f4c813462f4d7420e8ad32f40f61030e3424cb68c7a92188f57096c" exitCode=0
Jul 20 19:52:54.321039 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:54.321021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c" event={"ID":"12bed2d0-4234-4047-b44c-0a927bedd607","Type":"ContainerDied","Data":"0b0799e01f4c813462f4d7420e8ad32f40f61030e3424cb68c7a92188f57096c"}
Jul 20 19:52:55.454570 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:55.454546    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c"
Jul 20 19:52:55.525232 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:55.525172    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12bed2d0-4234-4047-b44c-0a927bedd607-maas-api-service-ca\") pod \"12bed2d0-4234-4047-b44c-0a927bedd607\" (UID: \"12bed2d0-4234-4047-b44c-0a927bedd607\") "
Jul 20 19:52:55.525510 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:55.525488    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12bed2d0-4234-4047-b44c-0a927bedd607-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "12bed2d0-4234-4047-b44c-0a927bedd607" (UID: "12bed2d0-4234-4047-b44c-0a927bedd607"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:52:55.625978 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:55.625941    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12bed2d0-4234-4047-b44c-0a927bedd607-maas-api-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:52:56.332848 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:56.332821    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c"
Jul 20 19:52:56.332848 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:56.332826    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c" event={"ID":"12bed2d0-4234-4047-b44c-0a927bedd607","Type":"ContainerDied","Data":"b0578c1418248fd0a88894f0512d52c8868e4793ed2130ed73eb470dbd431d56"}
Jul 20 19:52:56.333076 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:52:56.332874    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0578c1418248fd0a88894f0512d52c8868e4793ed2130ed73eb470dbd431d56"
Jul 20 19:53:03.337702 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:03.337666    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"]
Jul 20 19:53:03.338099 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:03.337920    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm" podUID="56f5ef3c-ce9a-406a-bd40-cc208d8d727f" containerName="maas-api" containerID="cri-o://f56c6265fa0975bc9444b9f4d505788a69f4914138b553fb4334a9199653cc9a" gracePeriod=30
Jul 20 19:53:03.364600 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:03.364574    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:03.591963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:03.591898    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:53:03.701456 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:03.701418    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-maas-api-tls\") pod \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\" (UID: \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\") "
Jul 20 19:53:03.701456 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:03.701465    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv7hw\" (UniqueName: \"kubernetes.io/projected/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-kube-api-access-mv7hw\") pod \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\" (UID: \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\") "
Jul 20 19:53:03.701721 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:03.701493    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-openshift-service-ca\") pod \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\" (UID: \"56f5ef3c-ce9a-406a-bd40-cc208d8d727f\") "
Jul 20 19:53:03.701923 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:03.701888    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56f5ef3c-ce9a-406a-bd40-cc208d8d727f" (UID: "56f5ef3c-ce9a-406a-bd40-cc208d8d727f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:53:03.703680 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:03.703654    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56f5ef3c-ce9a-406a-bd40-cc208d8d727f" (UID: "56f5ef3c-ce9a-406a-bd40-cc208d8d727f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:53:03.703794 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:03.703745    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-kube-api-access-mv7hw" (OuterVolumeSpecName: "kube-api-access-mv7hw") pod "56f5ef3c-ce9a-406a-bd40-cc208d8d727f" (UID: "56f5ef3c-ce9a-406a-bd40-cc208d8d727f"). InnerVolumeSpecName "kube-api-access-mv7hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:53:03.802547 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:03.802508    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-maas-api-tls\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:53:03.802547 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:03.802542    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv7hw\" (UniqueName: \"kubernetes.io/projected/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-kube-api-access-mv7hw\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:53:03.802547 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:03.802551    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f5ef3c-ce9a-406a-bd40-cc208d8d727f-openshift-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:53:04.375290 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:04.375257    2581 generic.go:356] "Generic (PLEG): container finished" podID="56f5ef3c-ce9a-406a-bd40-cc208d8d727f" containerID="f56c6265fa0975bc9444b9f4d505788a69f4914138b553fb4334a9199653cc9a" exitCode=0
Jul 20 19:53:04.375684 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:04.375307    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"
Jul 20 19:53:04.375684 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:04.375351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm" event={"ID":"56f5ef3c-ce9a-406a-bd40-cc208d8d727f","Type":"ContainerDied","Data":"f56c6265fa0975bc9444b9f4d505788a69f4914138b553fb4334a9199653cc9a"}
Jul 20 19:53:04.375684 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:04.375406    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm" event={"ID":"56f5ef3c-ce9a-406a-bd40-cc208d8d727f","Type":"ContainerDied","Data":"e270688aea6b50c7167e2767ab360e85381a2feb59d1157795b86331ab858255"}
Jul 20 19:53:04.375684 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:04.375431    2581 scope.go:117] "RemoveContainer" containerID="f56c6265fa0975bc9444b9f4d505788a69f4914138b553fb4334a9199653cc9a"
Jul 20 19:53:04.385082 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:04.384769    2581 scope.go:117] "RemoveContainer" containerID="f56c6265fa0975bc9444b9f4d505788a69f4914138b553fb4334a9199653cc9a"
Jul 20 19:53:04.385338 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:53:04.385304    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f56c6265fa0975bc9444b9f4d505788a69f4914138b553fb4334a9199653cc9a\": container with ID starting with f56c6265fa0975bc9444b9f4d505788a69f4914138b553fb4334a9199653cc9a not found: ID does not exist" containerID="f56c6265fa0975bc9444b9f4d505788a69f4914138b553fb4334a9199653cc9a"
Jul 20 19:53:04.385411 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:04.385350    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56c6265fa0975bc9444b9f4d505788a69f4914138b553fb4334a9199653cc9a"} err="failed to get container status \"f56c6265fa0975bc9444b9f4d505788a69f4914138b553fb4334a9199653cc9a\": rpc error: code = NotFound desc = could not find container \"f56c6265fa0975bc9444b9f4d505788a69f4914138b553fb4334a9199653cc9a\": container with ID starting with f56c6265fa0975bc9444b9f4d505788a69f4914138b553fb4334a9199653cc9a not found: ID does not exist"
Jul 20 19:53:04.393555 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:04.393526    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"]
Jul 20 19:53:04.396370 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:04.396346    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2fb506-7cf88d67dd-5nrfm"]
Jul 20 19:53:06.265757 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:06.265722    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56f5ef3c-ce9a-406a-bd40-cc208d8d727f" path="/var/lib/kubelet/pods/56f5ef3c-ce9a-406a-bd40-cc208d8d727f/volumes"
Jul 20 19:53:06.390762 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:06.390734    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:53:07.807395 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:07.807344    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c"]
Jul 20 19:53:07.809359 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:07.809336    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2fb506-mvc4c"]
Jul 20 19:53:07.810929 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:07.810893    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:08.211205 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:08.211151    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:08.265479 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:08.265450    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12bed2d0-4234-4047-b44c-0a927bedd607" path="/var/lib/kubelet/pods/12bed2d0-4234-4047-b44c-0a927bedd607/volumes"
Jul 20 19:53:13.986440 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:13.986386    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:14.058100 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:14.058065    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:14.258701 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:14.258622    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:14.484827 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:14.484803    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:14.839558 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:14.839528    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:15.225556 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:15.225483    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:15.354204 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:15.354154    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:18.059914 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.059875    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:18.154498 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.154466    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:18.166550 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.164174    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"]
Jul 20 19:53:18.166550 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.164872    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12bed2d0-4234-4047-b44c-0a927bedd607" containerName="revoke-keys"
Jul 20 19:53:18.166550 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.164889    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="12bed2d0-4234-4047-b44c-0a927bedd607" containerName="revoke-keys"
Jul 20 19:53:18.166550 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.164914    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56f5ef3c-ce9a-406a-bd40-cc208d8d727f" containerName="maas-api"
Jul 20 19:53:18.166550 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.164923    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="56f5ef3c-ce9a-406a-bd40-cc208d8d727f" containerName="maas-api"
Jul 20 19:53:18.166550 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.165055    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="12bed2d0-4234-4047-b44c-0a927bedd607" containerName="revoke-keys"
Jul 20 19:53:18.166550 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.165073    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="56f5ef3c-ce9a-406a-bd40-cc208d8d727f" containerName="maas-api"
Jul 20 19:53:18.168647 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.168616    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:18.171119 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.171099    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-9d91b9-serving-cert\""
Jul 20 19:53:18.171282 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.171262    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hv847\""
Jul 20 19:53:18.171411 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.171390    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:53:18.172120 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.172105    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:53:18.181676 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.181655    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"]
Jul 20 19:53:18.228440 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.228405    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:18.333236 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.333170    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-openshift-service-ca\") pod \"maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz\" (UID: \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:18.333420 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.333247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f22z\" (UniqueName: \"kubernetes.io/projected/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-kube-api-access-5f22z\") pod \"maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz\" (UID: \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:18.333420 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.333381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-maas-api-tls\") pod \"maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz\" (UID: \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:18.360837 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.360808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:18.434500 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.434454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-maas-api-tls\") pod \"maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz\" (UID: \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:18.434641 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.434505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-openshift-service-ca\") pod \"maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz\" (UID: \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:18.434641 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.434534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f22z\" (UniqueName: \"kubernetes.io/projected/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-kube-api-access-5f22z\") pod \"maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz\" (UID: \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:18.435146 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.435114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-openshift-service-ca\") pod \"maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz\" (UID: \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:18.437259 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.437237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-maas-api-tls\") pod \"maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz\" (UID: \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:18.442967 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.442930    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f22z\" (UniqueName: \"kubernetes.io/projected/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-kube-api-access-5f22z\") pod \"maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz\" (UID: \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:18.478677 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.478641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:18.615861 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.615835    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"]
Jul 20 19:53:18.617587 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:53:18.617563    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33444a4_39b4_40e1_9bf4_4bd442a5fe93.slice/crio-886c272b34bf97febd32f423d893f2f7edccedcb4b2f56a272f8c92b961dc9e3 WatchSource:0}: Error finding container 886c272b34bf97febd32f423d893f2f7edccedcb4b2f56a272f8c92b961dc9e3: Status 404 returned error can't find the container with id 886c272b34bf97febd32f423d893f2f7edccedcb4b2f56a272f8c92b961dc9e3
Jul 20 19:53:18.618922 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.618906    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:53:18.730859 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.730828    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:18.828945 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:18.828907    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:19.460335 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:19.460219    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz" event={"ID":"b33444a4-39b4-40e1-9bf4-4bd442a5fe93","Type":"ContainerStarted","Data":"6d4962e166523beb43c1b55bd83b88aa1a77c433f69adecf4980268355ce1ed2"}
Jul 20 19:53:19.460335 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:19.460278    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:19.460335 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:19.460307    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz" event={"ID":"b33444a4-39b4-40e1-9bf4-4bd442a5fe93","Type":"ContainerStarted","Data":"886c272b34bf97febd32f423d893f2f7edccedcb4b2f56a272f8c92b961dc9e3"}
Jul 20 19:53:19.476488 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:19.476428    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz" podStartSLOduration=0.938458112 podStartE2EDuration="1.476404911s" totalImagesPullingTime="537.946799ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:53:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:53:19.475935613 +0000 UTC m=+2285.699562832" watchObservedRunningTime="2026-07-20 19:53:19.476404911 +0000 UTC m=+2285.700032093"
Jul 20 19:53:20.868901 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:20.868861    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:53:22.549010 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:22.548977    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:23.031920 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:23.031886    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:23.401470 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:23.401432    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:23.599993 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:23.599942    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:25.470774 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:25.470743    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:26.123701 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.123669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:26.201381 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.201346    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"]
Jul 20 19:53:26.204853 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.204835    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:53:26.207245 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.207222    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-920350-serving-cert\""
Jul 20 19:53:26.215815 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.215791    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"]
Jul 20 19:53:26.225710 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.225685    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:26.299849 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.299817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2ps6\" (UniqueName: \"kubernetes.io/projected/e08d8365-5a18-4e46-b754-562eb957cad5-kube-api-access-r2ps6\") pod \"maas-api-e2e-api-b-920350-5d6df59d77-4kcqz\" (UID: \"e08d8365-5a18-4e46-b754-562eb957cad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:53:26.300023 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.299865    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e08d8365-5a18-4e46-b754-562eb957cad5-maas-api-tls\") pod \"maas-api-e2e-api-b-920350-5d6df59d77-4kcqz\" (UID: \"e08d8365-5a18-4e46-b754-562eb957cad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:53:26.300023 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.299883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e08d8365-5a18-4e46-b754-562eb957cad5-openshift-service-ca\") pod \"maas-api-e2e-api-b-920350-5d6df59d77-4kcqz\" (UID: \"e08d8365-5a18-4e46-b754-562eb957cad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:53:26.301928 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.301904    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:26.400482 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.400393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2ps6\" (UniqueName: \"kubernetes.io/projected/e08d8365-5a18-4e46-b754-562eb957cad5-kube-api-access-r2ps6\") pod \"maas-api-e2e-api-b-920350-5d6df59d77-4kcqz\" (UID: \"e08d8365-5a18-4e46-b754-562eb957cad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:53:26.400482 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.400438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e08d8365-5a18-4e46-b754-562eb957cad5-maas-api-tls\") pod \"maas-api-e2e-api-b-920350-5d6df59d77-4kcqz\" (UID: \"e08d8365-5a18-4e46-b754-562eb957cad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:53:26.400482 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.400472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e08d8365-5a18-4e46-b754-562eb957cad5-openshift-service-ca\") pod \"maas-api-e2e-api-b-920350-5d6df59d77-4kcqz\" (UID: \"e08d8365-5a18-4e46-b754-562eb957cad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:53:26.401115 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.401096    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e08d8365-5a18-4e46-b754-562eb957cad5-openshift-service-ca\") pod \"maas-api-e2e-api-b-920350-5d6df59d77-4kcqz\" (UID: \"e08d8365-5a18-4e46-b754-562eb957cad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:53:26.402950 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.402931    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e08d8365-5a18-4e46-b754-562eb957cad5-maas-api-tls\") pod \"maas-api-e2e-api-b-920350-5d6df59d77-4kcqz\" (UID: \"e08d8365-5a18-4e46-b754-562eb957cad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:53:26.406154 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.406136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:26.410776 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.410753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2ps6\" (UniqueName: \"kubernetes.io/projected/e08d8365-5a18-4e46-b754-562eb957cad5-kube-api-access-r2ps6\") pod \"maas-api-e2e-api-b-920350-5d6df59d77-4kcqz\" (UID: \"e08d8365-5a18-4e46-b754-562eb957cad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:53:26.516245 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.516177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:53:26.844330 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.844287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:26.855002 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.854982    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"]
Jul 20 19:53:26.857604 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:53:26.857573    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08d8365_5a18_4e46_b754_562eb957cad5.slice/crio-84ce0bc0f3f1bed59cdcfe485d055cbcf7650f2b8c4acd44e9f63d0d0a8a314d WatchSource:0}: Error finding container 84ce0bc0f3f1bed59cdcfe485d055cbcf7650f2b8c4acd44e9f63d0d0a8a314d: Status 404 returned error can't find the container with id 84ce0bc0f3f1bed59cdcfe485d055cbcf7650f2b8c4acd44e9f63d0d0a8a314d
Jul 20 19:53:26.945252 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:26.945208    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:27.501564 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:27.501478    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz" event={"ID":"e08d8365-5a18-4e46-b754-562eb957cad5","Type":"ContainerStarted","Data":"8e36a5f7b88207f73ae245bf1f13db8a83d24b810025a25bee4a7d83db3c22e8"}
Jul 20 19:53:27.501564 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:27.501532    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz" event={"ID":"e08d8365-5a18-4e46-b754-562eb957cad5","Type":"ContainerStarted","Data":"84ce0bc0f3f1bed59cdcfe485d055cbcf7650f2b8c4acd44e9f63d0d0a8a314d"}
Jul 20 19:53:27.501564 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:27.501560    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:53:27.517654 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:27.517594    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz" podStartSLOduration=1.136329608 podStartE2EDuration="1.51757444s" totalImagesPullingTime="381.244832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:53:27.517251856 +0000 UTC m=+2293.740879038" watchObservedRunningTime="2026-07-20 19:53:27.51757444 +0000 UTC m=+2293.741201628"
Jul 20 19:53:30.588900 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:30.588873    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:33.183791 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:33.183752    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:53:33.512137 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:33.512059    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:53:38.695330 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:38.695295    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc"]
Jul 20 19:53:38.698759 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:38.698742    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc"
Jul 20 19:53:38.701988 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:38.701971    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\""
Jul 20 19:53:38.708145 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:38.708125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5118a0a6-b268-46dc-acdd-ddfb9ea1d730-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9d91b9-486tc\" (UID: \"5118a0a6-b268-46dc-acdd-ddfb9ea1d730\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc"
Jul 20 19:53:38.711365 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:38.711340    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc"]
Jul 20 19:53:38.809174 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:38.809140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5118a0a6-b268-46dc-acdd-ddfb9ea1d730-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9d91b9-486tc\" (UID: \"5118a0a6-b268-46dc-acdd-ddfb9ea1d730\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc"
Jul 20 19:53:38.809799 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:38.809778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5118a0a6-b268-46dc-acdd-ddfb9ea1d730-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9d91b9-486tc\" (UID: \"5118a0a6-b268-46dc-acdd-ddfb9ea1d730\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc"
Jul 20 19:53:39.009051 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:39.008970    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc"
Jul 20 19:53:39.143364 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:53:39.143324    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5118a0a6_b268_46dc_acdd_ddfb9ea1d730.slice/crio-00523143edba9680b42cb1314c7fc2365481b8c7f5a50a671eb6bf69ddfe7626 WatchSource:0}: Error finding container 00523143edba9680b42cb1314c7fc2365481b8c7f5a50a671eb6bf69ddfe7626: Status 404 returned error can't find the container with id 00523143edba9680b42cb1314c7fc2365481b8c7f5a50a671eb6bf69ddfe7626
Jul 20 19:53:39.143730 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:39.143708    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc"]
Jul 20 19:53:39.328674 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:39.328644    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:39.429651 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:39.429620    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:39.565981 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:39.565946    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc" event={"ID":"5118a0a6-b268-46dc-acdd-ddfb9ea1d730","Type":"ContainerStarted","Data":"b7bf39c735285067b478a63753ff75001ba808ec703df96f2f22492ae02548ea"}
Jul 20 19:53:39.566167 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:39.565994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc" event={"ID":"5118a0a6-b268-46dc-acdd-ddfb9ea1d730","Type":"ContainerStarted","Data":"00523143edba9680b42cb1314c7fc2365481b8c7f5a50a671eb6bf69ddfe7626"}
Jul 20 19:53:39.587774 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:39.587675    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc" podStartSLOduration=1.5876601940000001 podStartE2EDuration="1.587660194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:53:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:53:39.58538886 +0000 UTC m=+2305.809016040" watchObservedRunningTime="2026-07-20 19:53:39.587660194 +0000 UTC m=+2305.811287353"
Jul 20 19:53:40.578381 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:40.578343    2581 generic.go:356] "Generic (PLEG): container finished" podID="5118a0a6-b268-46dc-acdd-ddfb9ea1d730" containerID="b7bf39c735285067b478a63753ff75001ba808ec703df96f2f22492ae02548ea" exitCode=0
Jul 20 19:53:40.578764 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:40.578429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc" event={"ID":"5118a0a6-b268-46dc-acdd-ddfb9ea1d730","Type":"ContainerDied","Data":"b7bf39c735285067b478a63753ff75001ba808ec703df96f2f22492ae02548ea"}
Jul 20 19:53:41.714521 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:41.714500    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc"
Jul 20 19:53:41.730512 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:41.730124    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5118a0a6-b268-46dc-acdd-ddfb9ea1d730-maas-api-service-ca\") pod \"5118a0a6-b268-46dc-acdd-ddfb9ea1d730\" (UID: \"5118a0a6-b268-46dc-acdd-ddfb9ea1d730\") "
Jul 20 19:53:41.730765 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:41.730722    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5118a0a6-b268-46dc-acdd-ddfb9ea1d730-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5118a0a6-b268-46dc-acdd-ddfb9ea1d730" (UID: "5118a0a6-b268-46dc-acdd-ddfb9ea1d730"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:53:41.831397 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:41.831368    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5118a0a6-b268-46dc-acdd-ddfb9ea1d730-maas-api-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:53:42.589209 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:42.589157    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc"
Jul 20 19:53:42.589209 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:42.589164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc" event={"ID":"5118a0a6-b268-46dc-acdd-ddfb9ea1d730","Type":"ContainerDied","Data":"00523143edba9680b42cb1314c7fc2365481b8c7f5a50a671eb6bf69ddfe7626"}
Jul 20 19:53:42.589428 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:42.589243    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00523143edba9680b42cb1314c7fc2365481b8c7f5a50a671eb6bf69ddfe7626"
Jul 20 19:53:47.742704 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:47.742661    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:47.853083 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:47.853048    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:49.499465 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:49.499427    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:49.650536 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:49.650497    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:55.031275 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.031239    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"]
Jul 20 19:53:55.031694 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.031435    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz" podUID="b33444a4-39b4-40e1-9bf4-4bd442a5fe93" containerName="maas-api" containerID="cri-o://6d4962e166523beb43c1b55bd83b88aa1a77c433f69adecf4980268355ce1ed2" gracePeriod=30
Jul 20 19:53:55.080062 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.080035    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:55.277061 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.277035    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:55.344570 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.344539    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f22z\" (UniqueName: \"kubernetes.io/projected/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-kube-api-access-5f22z\") pod \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\" (UID: \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\") "
Jul 20 19:53:55.344570 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.344573    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-openshift-service-ca\") pod \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\" (UID: \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\") "
Jul 20 19:53:55.344777 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.344669    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-maas-api-tls\") pod \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\" (UID: \"b33444a4-39b4-40e1-9bf4-4bd442a5fe93\") "
Jul 20 19:53:55.344978 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.344956    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b33444a4-39b4-40e1-9bf4-4bd442a5fe93" (UID: "b33444a4-39b4-40e1-9bf4-4bd442a5fe93"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:53:55.346747 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.346719    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b33444a4-39b4-40e1-9bf4-4bd442a5fe93" (UID: "b33444a4-39b4-40e1-9bf4-4bd442a5fe93"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:53:55.346879 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.346776    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-kube-api-access-5f22z" (OuterVolumeSpecName: "kube-api-access-5f22z") pod "b33444a4-39b4-40e1-9bf4-4bd442a5fe93" (UID: "b33444a4-39b4-40e1-9bf4-4bd442a5fe93"). InnerVolumeSpecName "kube-api-access-5f22z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:53:55.445437 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.445407    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-maas-api-tls\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:53:55.445437 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.445433    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f22z\" (UniqueName: \"kubernetes.io/projected/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-kube-api-access-5f22z\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:53:55.445437 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.445444    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b33444a4-39b4-40e1-9bf4-4bd442a5fe93-openshift-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:53:55.659223 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.659118    2581 generic.go:356] "Generic (PLEG): container finished" podID="b33444a4-39b4-40e1-9bf4-4bd442a5fe93" containerID="6d4962e166523beb43c1b55bd83b88aa1a77c433f69adecf4980268355ce1ed2" exitCode=0
Jul 20 19:53:55.659223 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.659158    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"
Jul 20 19:53:55.659223 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.659207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz" event={"ID":"b33444a4-39b4-40e1-9bf4-4bd442a5fe93","Type":"ContainerDied","Data":"6d4962e166523beb43c1b55bd83b88aa1a77c433f69adecf4980268355ce1ed2"}
Jul 20 19:53:55.659466 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.659257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz" event={"ID":"b33444a4-39b4-40e1-9bf4-4bd442a5fe93","Type":"ContainerDied","Data":"886c272b34bf97febd32f423d893f2f7edccedcb4b2f56a272f8c92b961dc9e3"}
Jul 20 19:53:55.659466 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.659279    2581 scope.go:117] "RemoveContainer" containerID="6d4962e166523beb43c1b55bd83b88aa1a77c433f69adecf4980268355ce1ed2"
Jul 20 19:53:55.668523 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.668507    2581 scope.go:117] "RemoveContainer" containerID="6d4962e166523beb43c1b55bd83b88aa1a77c433f69adecf4980268355ce1ed2"
Jul 20 19:53:55.668785 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:53:55.668766    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d4962e166523beb43c1b55bd83b88aa1a77c433f69adecf4980268355ce1ed2\": container with ID starting with 6d4962e166523beb43c1b55bd83b88aa1a77c433f69adecf4980268355ce1ed2 not found: ID does not exist" containerID="6d4962e166523beb43c1b55bd83b88aa1a77c433f69adecf4980268355ce1ed2"
Jul 20 19:53:55.668844 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.668796    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d4962e166523beb43c1b55bd83b88aa1a77c433f69adecf4980268355ce1ed2"} err="failed to get container status \"6d4962e166523beb43c1b55bd83b88aa1a77c433f69adecf4980268355ce1ed2\": rpc error: code = NotFound desc = could not find container \"6d4962e166523beb43c1b55bd83b88aa1a77c433f69adecf4980268355ce1ed2\": container with ID starting with 6d4962e166523beb43c1b55bd83b88aa1a77c433f69adecf4980268355ce1ed2 not found: ID does not exist"
Jul 20 19:53:55.682931 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.682899    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"]
Jul 20 19:53:55.692181 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:55.692156    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9d91b9-6c76649f79-5j9wz"]
Jul 20 19:53:56.265402 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:56.265367    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b33444a4-39b4-40e1-9bf4-4bd442a5fe93" path="/var/lib/kubelet/pods/b33444a4-39b4-40e1-9bf4-4bd442a5fe93/volumes"
Jul 20 19:53:57.081905 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:57.081867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:58.791684 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:58.791635    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc"]
Jul 20 19:53:58.792864 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:58.792837    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:53:58.794066 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:58.794046    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9d91b9-486tc"]
Jul 20 19:53:59.189980 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:53:59.189947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:00.270729 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:00.270692    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5118a0a6-b268-46dc-acdd-ddfb9ea1d730" path="/var/lib/kubelet/pods/5118a0a6-b268-46dc-acdd-ddfb9ea1d730/volumes"
Jul 20 19:54:01.398926 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:01.398884    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:54:05.370821 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:05.370744    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:05.472245 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:05.472214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:05.677789 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:05.677701    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:05.948543 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:05.948444    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:06.131147 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.131113    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs"]
Jul 20 19:54:06.131456 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.131444    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b33444a4-39b4-40e1-9bf4-4bd442a5fe93" containerName="maas-api"
Jul 20 19:54:06.131509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.131458    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b33444a4-39b4-40e1-9bf4-4bd442a5fe93" containerName="maas-api"
Jul 20 19:54:06.131509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.131471    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5118a0a6-b268-46dc-acdd-ddfb9ea1d730" containerName="revoke-keys"
Jul 20 19:54:06.131509 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.131476    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5118a0a6-b268-46dc-acdd-ddfb9ea1d730" containerName="revoke-keys"
Jul 20 19:54:06.131621 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.131536    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5118a0a6-b268-46dc-acdd-ddfb9ea1d730" containerName="revoke-keys"
Jul 20 19:54:06.131621 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.131546    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b33444a4-39b4-40e1-9bf4-4bd442a5fe93" containerName="maas-api"
Jul 20 19:54:06.135778 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.135761    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs"
Jul 20 19:54:06.138637 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.138613    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\""
Jul 20 19:54:06.155581 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.155551    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs"]
Jul 20 19:54:06.237119 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.237031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-920350-g6qqs\" (UID: \"1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs"
Jul 20 19:54:06.338346 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.338305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-920350-g6qqs\" (UID: \"1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs"
Jul 20 19:54:06.338921 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.338902    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-920350-g6qqs\" (UID: \"1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs"
Jul 20 19:54:06.445572 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.445532    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs"
Jul 20 19:54:06.598992 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.598937    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs"]
Jul 20 19:54:06.599232 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:54:06.599182    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd1a2c1_e3c2_4c91_8652_01c24ae61f8c.slice/crio-ab1c3e2db2b73555a3b74d088f6804004f51c1c7deaa6fb5bdcac4a4c4d29acd WatchSource:0}: Error finding container ab1c3e2db2b73555a3b74d088f6804004f51c1c7deaa6fb5bdcac4a4c4d29acd: Status 404 returned error can't find the container with id ab1c3e2db2b73555a3b74d088f6804004f51c1c7deaa6fb5bdcac4a4c4d29acd
Jul 20 19:54:06.715852 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.715814    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs" event={"ID":"1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c","Type":"ContainerStarted","Data":"ab1c3e2db2b73555a3b74d088f6804004f51c1c7deaa6fb5bdcac4a4c4d29acd"}
Jul 20 19:54:06.931859 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:06.931821    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:07.033258 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:07.033129    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:07.721924 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:07.721885    2581 generic.go:356] "Generic (PLEG): container finished" podID="1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c" containerID="867ccffc3c3131f715dfee542fce073f652de0daeb735f83e33521250eeb2fa8" exitCode=0
Jul 20 19:54:07.722362 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:07.721969    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs" event={"ID":"1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c","Type":"ContainerDied","Data":"867ccffc3c3131f715dfee542fce073f652de0daeb735f83e33521250eeb2fa8"}
Jul 20 19:54:08.860269 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:08.860241    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs"
Jul 20 19:54:08.961278 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:08.961240    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c-maas-api-service-ca\") pod \"1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c\" (UID: \"1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c\") "
Jul 20 19:54:08.961610 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:08.961587    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c" (UID: "1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:54:09.062046 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:09.061959    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c-maas-api-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:54:09.732664 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:09.732629    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs" event={"ID":"1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c","Type":"ContainerDied","Data":"ab1c3e2db2b73555a3b74d088f6804004f51c1c7deaa6fb5bdcac4a4c4d29acd"}
Jul 20 19:54:09.732664 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:09.732669    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs"
Jul 20 19:54:09.732964 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:09.732681    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab1c3e2db2b73555a3b74d088f6804004f51c1c7deaa6fb5bdcac4a4c4d29acd"
Jul 20 19:54:14.478463 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:14.478431    2581 scope.go:117] "RemoveContainer" containerID="6c2e91cfd48bdad2c9de194f0bdea150bf0c611e8e0ec8488fb5b5a6a6f517f9"
Jul 20 19:54:21.738213 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:21.738150    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"]
Jul 20 19:54:21.738610 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:21.738422    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz" podUID="e08d8365-5a18-4e46-b754-562eb957cad5" containerName="maas-api" containerID="cri-o://8e36a5f7b88207f73ae245bf1f13db8a83d24b810025a25bee4a7d83db3c22e8" gracePeriod=30
Jul 20 19:54:21.775043 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:21.775019    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:21.991518 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:21.991452    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:54:22.073909 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.073877    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2ps6\" (UniqueName: \"kubernetes.io/projected/e08d8365-5a18-4e46-b754-562eb957cad5-kube-api-access-r2ps6\") pod \"e08d8365-5a18-4e46-b754-562eb957cad5\" (UID: \"e08d8365-5a18-4e46-b754-562eb957cad5\") "
Jul 20 19:54:22.074081 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.073942    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e08d8365-5a18-4e46-b754-562eb957cad5-maas-api-tls\") pod \"e08d8365-5a18-4e46-b754-562eb957cad5\" (UID: \"e08d8365-5a18-4e46-b754-562eb957cad5\") "
Jul 20 19:54:22.074081 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.074057    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e08d8365-5a18-4e46-b754-562eb957cad5-openshift-service-ca\") pod \"e08d8365-5a18-4e46-b754-562eb957cad5\" (UID: \"e08d8365-5a18-4e46-b754-562eb957cad5\") "
Jul 20 19:54:22.074439 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.074409    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e08d8365-5a18-4e46-b754-562eb957cad5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e08d8365-5a18-4e46-b754-562eb957cad5" (UID: "e08d8365-5a18-4e46-b754-562eb957cad5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:54:22.076174 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.076156    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e08d8365-5a18-4e46-b754-562eb957cad5-kube-api-access-r2ps6" (OuterVolumeSpecName: "kube-api-access-r2ps6") pod "e08d8365-5a18-4e46-b754-562eb957cad5" (UID: "e08d8365-5a18-4e46-b754-562eb957cad5"). InnerVolumeSpecName "kube-api-access-r2ps6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:54:22.076295 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.076206    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e08d8365-5a18-4e46-b754-562eb957cad5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e08d8365-5a18-4e46-b754-562eb957cad5" (UID: "e08d8365-5a18-4e46-b754-562eb957cad5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:54:22.175430 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.175394    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e08d8365-5a18-4e46-b754-562eb957cad5-maas-api-tls\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:54:22.175430 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.175421    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e08d8365-5a18-4e46-b754-562eb957cad5-openshift-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:54:22.175430 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.175430    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2ps6\" (UniqueName: \"kubernetes.io/projected/e08d8365-5a18-4e46-b754-562eb957cad5-kube-api-access-r2ps6\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:54:22.801247 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.801211    2581 generic.go:356] "Generic (PLEG): container finished" podID="e08d8365-5a18-4e46-b754-562eb957cad5" containerID="8e36a5f7b88207f73ae245bf1f13db8a83d24b810025a25bee4a7d83db3c22e8" exitCode=0
Jul 20 19:54:22.801652 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.801264    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"
Jul 20 19:54:22.801652 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.801272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz" event={"ID":"e08d8365-5a18-4e46-b754-562eb957cad5","Type":"ContainerDied","Data":"8e36a5f7b88207f73ae245bf1f13db8a83d24b810025a25bee4a7d83db3c22e8"}
Jul 20 19:54:22.801652 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.801320    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz" event={"ID":"e08d8365-5a18-4e46-b754-562eb957cad5","Type":"ContainerDied","Data":"84ce0bc0f3f1bed59cdcfe485d055cbcf7650f2b8c4acd44e9f63d0d0a8a314d"}
Jul 20 19:54:22.801652 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.801342    2581 scope.go:117] "RemoveContainer" containerID="8e36a5f7b88207f73ae245bf1f13db8a83d24b810025a25bee4a7d83db3c22e8"
Jul 20 19:54:22.809997 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.809979    2581 scope.go:117] "RemoveContainer" containerID="8e36a5f7b88207f73ae245bf1f13db8a83d24b810025a25bee4a7d83db3c22e8"
Jul 20 19:54:22.810287 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:54:22.810265    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e36a5f7b88207f73ae245bf1f13db8a83d24b810025a25bee4a7d83db3c22e8\": container with ID starting with 8e36a5f7b88207f73ae245bf1f13db8a83d24b810025a25bee4a7d83db3c22e8 not found: ID does not exist" containerID="8e36a5f7b88207f73ae245bf1f13db8a83d24b810025a25bee4a7d83db3c22e8"
Jul 20 19:54:22.810355 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.810297    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e36a5f7b88207f73ae245bf1f13db8a83d24b810025a25bee4a7d83db3c22e8"} err="failed to get container status \"8e36a5f7b88207f73ae245bf1f13db8a83d24b810025a25bee4a7d83db3c22e8\": rpc error: code = NotFound desc = could not find container \"8e36a5f7b88207f73ae245bf1f13db8a83d24b810025a25bee4a7d83db3c22e8\": container with ID starting with 8e36a5f7b88207f73ae245bf1f13db8a83d24b810025a25bee4a7d83db3c22e8 not found: ID does not exist"
Jul 20 19:54:22.825999 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.825974    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"]
Jul 20 19:54:22.829665 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:22.829645    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-920350-5d6df59d77-4kcqz"]
Jul 20 19:54:24.265436 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:24.265404    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e08d8365-5a18-4e46-b754-562eb957cad5" path="/var/lib/kubelet/pods/e08d8365-5a18-4e46-b754-562eb957cad5/volumes"
Jul 20 19:54:26.251934 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:26.251900    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs"]
Jul 20 19:54:26.256852 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:26.256797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:26.265555 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:26.265532    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-920350-g6qqs"]
Jul 20 19:54:26.669412 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:26.669373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:27.092148 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:27.092111    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:54:28.265233 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:28.265178    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c" path="/var/lib/kubelet/pods/1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c/volumes"
Jul 20 19:54:32.729376 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:32.729336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:32.810171 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:32.810137    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:33.056650 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:33.056568    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:33.267544 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:33.267514    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:33.643706 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:33.643672    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:34.030643 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:34.030566    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:34.172692 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:34.172656    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:36.653966 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.653932    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:36.784337 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.784304    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"]
Jul 20 19:54:36.784612 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.784600    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c" containerName="revoke-keys"
Jul 20 19:54:36.784658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.784614    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c" containerName="revoke-keys"
Jul 20 19:54:36.784658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.784630    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e08d8365-5a18-4e46-b754-562eb957cad5" containerName="maas-api"
Jul 20 19:54:36.784658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.784636    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e08d8365-5a18-4e46-b754-562eb957cad5" containerName="maas-api"
Jul 20 19:54:36.784756 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.784690    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e08d8365-5a18-4e46-b754-562eb957cad5" containerName="maas-api"
Jul 20 19:54:36.784756 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.784698    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dd1a2c1-e3c2-4c91-8652-01c24ae61f8c" containerName="revoke-keys"
Jul 20 19:54:36.788979 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.788957    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:36.789636 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.789617    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:36.793102 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.793083    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:54:36.793899 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.793884    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:54:36.793954 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.793884    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-710890-serving-cert\""
Jul 20 19:54:36.793954 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.793917    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hv847\""
Jul 20 19:54:36.800619 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.800600    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0171621d-8650-401e-84e2-b13bd9f57fa0-maas-api-tls\") pod \"maas-api-e2e-shared-a-710890-779f74c447-hwr9t\" (UID: \"0171621d-8650-401e-84e2-b13bd9f57fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:36.800726 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.800661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0171621d-8650-401e-84e2-b13bd9f57fa0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-710890-779f74c447-hwr9t\" (UID: \"0171621d-8650-401e-84e2-b13bd9f57fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:36.800726 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.800718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t42vs\" (UniqueName: \"kubernetes.io/projected/0171621d-8650-401e-84e2-b13bd9f57fa0-kube-api-access-t42vs\") pod \"maas-api-e2e-shared-a-710890-779f74c447-hwr9t\" (UID: \"0171621d-8650-401e-84e2-b13bd9f57fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:36.806676 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.806655    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"]
Jul 20 19:54:36.901329 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.901295    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0171621d-8650-401e-84e2-b13bd9f57fa0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-710890-779f74c447-hwr9t\" (UID: \"0171621d-8650-401e-84e2-b13bd9f57fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:36.901556 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.901366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t42vs\" (UniqueName: \"kubernetes.io/projected/0171621d-8650-401e-84e2-b13bd9f57fa0-kube-api-access-t42vs\") pod \"maas-api-e2e-shared-a-710890-779f74c447-hwr9t\" (UID: \"0171621d-8650-401e-84e2-b13bd9f57fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:36.901556 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.901422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0171621d-8650-401e-84e2-b13bd9f57fa0-maas-api-tls\") pod \"maas-api-e2e-shared-a-710890-779f74c447-hwr9t\" (UID: \"0171621d-8650-401e-84e2-b13bd9f57fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:36.901556 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:54:36.901532    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-serving-cert: secret "maas-api-e2e-shared-a-710890-serving-cert" not found
Jul 20 19:54:36.901725 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:54:36.901600    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0171621d-8650-401e-84e2-b13bd9f57fa0-maas-api-tls podName:0171621d-8650-401e-84e2-b13bd9f57fa0 nodeName:}" failed. No retries permitted until 2026-07-20 19:54:37.401580236 +0000 UTC m=+2363.625207412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0171621d-8650-401e-84e2-b13bd9f57fa0-maas-api-tls") pod "maas-api-e2e-shared-a-710890-779f74c447-hwr9t" (UID: "0171621d-8650-401e-84e2-b13bd9f57fa0") : secret "maas-api-e2e-shared-a-710890-serving-cert" not found
Jul 20 19:54:36.902150 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.902111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0171621d-8650-401e-84e2-b13bd9f57fa0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-710890-779f74c447-hwr9t\" (UID: \"0171621d-8650-401e-84e2-b13bd9f57fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:36.902319 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.902223    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:36.915253 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:36.915203    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t42vs\" (UniqueName: \"kubernetes.io/projected/0171621d-8650-401e-84e2-b13bd9f57fa0-kube-api-access-t42vs\") pod \"maas-api-e2e-shared-a-710890-779f74c447-hwr9t\" (UID: \"0171621d-8650-401e-84e2-b13bd9f57fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:37.060333 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:37.060292    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:37.405236 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:37.405173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0171621d-8650-401e-84e2-b13bd9f57fa0-maas-api-tls\") pod \"maas-api-e2e-shared-a-710890-779f74c447-hwr9t\" (UID: \"0171621d-8650-401e-84e2-b13bd9f57fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:37.407946 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:37.407919    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0171621d-8650-401e-84e2-b13bd9f57fa0-maas-api-tls\") pod \"maas-api-e2e-shared-a-710890-779f74c447-hwr9t\" (UID: \"0171621d-8650-401e-84e2-b13bd9f57fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:37.541968 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:37.541928    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:37.638594 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:37.638565    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:37.698772 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:37.698644    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:37.841491 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:37.841306    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"]
Jul 20 19:54:37.844321 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:54:37.844292    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0171621d_8650_401e_84e2_b13bd9f57fa0.slice/crio-55241e1899ce77f22d1e9b90591e1cdf5cd9c884fa0b188a2a103a2a5e4a8cdd WatchSource:0}: Error finding container 55241e1899ce77f22d1e9b90591e1cdf5cd9c884fa0b188a2a103a2a5e4a8cdd: Status 404 returned error can't find the container with id 55241e1899ce77f22d1e9b90591e1cdf5cd9c884fa0b188a2a103a2a5e4a8cdd
Jul 20 19:54:37.883703 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:37.883667    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t" event={"ID":"0171621d-8650-401e-84e2-b13bd9f57fa0","Type":"ContainerStarted","Data":"55241e1899ce77f22d1e9b90591e1cdf5cd9c884fa0b188a2a103a2a5e4a8cdd"}
Jul 20 19:54:38.890982 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:38.890945    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t" event={"ID":"0171621d-8650-401e-84e2-b13bd9f57fa0","Type":"ContainerStarted","Data":"5924f9c65ed345b0a7b98137bcd23e80d77d757af3b815833db92658ac88da78"}
Jul 20 19:54:38.891431 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:38.891063    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:39.332110 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:39.332079    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:39.434564 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:39.434528    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:40.324114 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:40.324075    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:40.457678 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:40.457647    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:41.141007 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:41.140973    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:41.449960 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:41.449877    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:41.488666 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:41.488615    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t" podStartSLOduration=5.062812113 podStartE2EDuration="5.488597696s" totalImagesPullingTime="425.785583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:54:38.914123476 +0000 UTC m=+2365.137750657" watchObservedRunningTime="2026-07-20 19:54:41.488597696 +0000 UTC m=+2367.712224924"
Jul 20 19:54:41.489060 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:41.489046    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:54:41.819089 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:41.819007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:42.020730 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:42.020704    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:44.708470 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.708432    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:44.808685 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.808658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:44.849942 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.849912    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"]
Jul 20 19:54:44.853528 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.853512    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:54:44.855828 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.855797    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-01f2d8-serving-cert\""
Jul 20 19:54:44.869781 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.869748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967b45f9-7c85-4802-b996-b7051de0ac11-maas-api-tls\") pod \"maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2\" (UID: \"967b45f9-7c85-4802-b996-b7051de0ac11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:54:44.869930 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.869802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5dzz\" (UniqueName: \"kubernetes.io/projected/967b45f9-7c85-4802-b996-b7051de0ac11-kube-api-access-j5dzz\") pod \"maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2\" (UID: \"967b45f9-7c85-4802-b996-b7051de0ac11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:54:44.869930 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.869904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967b45f9-7c85-4802-b996-b7051de0ac11-openshift-service-ca\") pod \"maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2\" (UID: \"967b45f9-7c85-4802-b996-b7051de0ac11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:54:44.870262 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.870234    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"]
Jul 20 19:54:44.902155 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.902133    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 19:54:44.921292 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.921268    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:44.971027 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.970943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967b45f9-7c85-4802-b996-b7051de0ac11-openshift-service-ca\") pod \"maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2\" (UID: \"967b45f9-7c85-4802-b996-b7051de0ac11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:54:44.971210 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.971026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967b45f9-7c85-4802-b996-b7051de0ac11-maas-api-tls\") pod \"maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2\" (UID: \"967b45f9-7c85-4802-b996-b7051de0ac11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:54:44.971210 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.971057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5dzz\" (UniqueName: \"kubernetes.io/projected/967b45f9-7c85-4802-b996-b7051de0ac11-kube-api-access-j5dzz\") pod \"maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2\" (UID: \"967b45f9-7c85-4802-b996-b7051de0ac11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:54:44.971210 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:54:44.971170    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-serving-cert: secret "maas-api-e2e-shared-b-01f2d8-serving-cert" not found
Jul 20 19:54:44.971386 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:54:44.971270    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/967b45f9-7c85-4802-b996-b7051de0ac11-maas-api-tls podName:967b45f9-7c85-4802-b996-b7051de0ac11 nodeName:}" failed. No retries permitted until 2026-07-20 19:54:45.471248051 +0000 UTC m=+2371.694875227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/967b45f9-7c85-4802-b996-b7051de0ac11-maas-api-tls") pod "maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2" (UID: "967b45f9-7c85-4802-b996-b7051de0ac11") : secret "maas-api-e2e-shared-b-01f2d8-serving-cert" not found
Jul 20 19:54:44.971710 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.971690    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967b45f9-7c85-4802-b996-b7051de0ac11-openshift-service-ca\") pod \"maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2\" (UID: \"967b45f9-7c85-4802-b996-b7051de0ac11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:54:44.991373 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:44.991349    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5dzz\" (UniqueName: \"kubernetes.io/projected/967b45f9-7c85-4802-b996-b7051de0ac11-kube-api-access-j5dzz\") pod \"maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2\" (UID: \"967b45f9-7c85-4802-b996-b7051de0ac11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:54:45.293541 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:45.293437    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:45.476202 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:45.476155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967b45f9-7c85-4802-b996-b7051de0ac11-maas-api-tls\") pod \"maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2\" (UID: \"967b45f9-7c85-4802-b996-b7051de0ac11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:54:45.478732 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:45.478704    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967b45f9-7c85-4802-b996-b7051de0ac11-maas-api-tls\") pod \"maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2\" (UID: \"967b45f9-7c85-4802-b996-b7051de0ac11\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:54:45.763431 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:45.763397    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:54:45.833085 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:45.832889    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:45.914478 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:45.914455    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"]
Jul 20 19:54:45.915808 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:54:45.915781    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967b45f9_7c85_4802_b996_b7051de0ac11.slice/crio-c4ac417990f74041d95dc9b00c25e0a55b6f620272ab25b352dc60de238960e9 WatchSource:0}: Error finding container c4ac417990f74041d95dc9b00c25e0a55b6f620272ab25b352dc60de238960e9: Status 404 returned error can't find the container with id c4ac417990f74041d95dc9b00c25e0a55b6f620272ab25b352dc60de238960e9
Jul 20 19:54:45.927468 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:45.927443    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2" event={"ID":"967b45f9-7c85-4802-b996-b7051de0ac11","Type":"ContainerStarted","Data":"c4ac417990f74041d95dc9b00c25e0a55b6f620272ab25b352dc60de238960e9"}
Jul 20 19:54:45.971799 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:45.971773    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:46.934167 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:46.934128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2" event={"ID":"967b45f9-7c85-4802-b996-b7051de0ac11","Type":"ContainerStarted","Data":"b322fff1b848517eb525499ee2bcae33a7c7ec50b08149e5244151b4f37bf8c3"}
Jul 20 19:54:46.934583 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:46.934242    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:54:46.953167 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:46.953119    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2" podStartSLOduration=2.543832067 podStartE2EDuration="2.953103839s" totalImagesPullingTime="409.271772ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:54:46.952600587 +0000 UTC m=+2373.176227769" watchObservedRunningTime="2026-07-20 19:54:46.953103839 +0000 UTC m=+2373.176731011"
Jul 20 19:54:49.220553 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:49.220520    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:54:50.303943 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:50.303906    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:54:52.944463 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:54:52.944434    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 19:55:01.630392 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:01.630361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:55:01.753795 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:01.753765    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:55:07.069418 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:07.069383    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:55:07.168929 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:07.168895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:55:11.194914 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.194884    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"]
Jul 20 19:55:11.198419 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.198404    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.201948 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.201924    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-710890\"/\"auth-test-model-710890-kserve-self-signed-certs\""
Jul 20 19:55:11.201948 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.201942    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-710890\"/\"default-dockercfg-m7vr6\""
Jul 20 19:55:11.202127 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.201924    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-710890\"/\"openshift-service-ca.crt\""
Jul 20 19:55:11.202127 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.201987    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-710890\"/\"kube-root-ca.crt\""
Jul 20 19:55:11.218648 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.218625    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"]
Jul 20 19:55:11.296810 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.296782    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:55:11.318958 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.318918    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-dshm\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.319068 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.318968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2de63356-5227-4ae6-8705-3469a49213e2-tls-certs\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.319068 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.319038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-home\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.319068 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.319057    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-tmp-dir\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.319226 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.319135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx7xm\" (UniqueName: \"kubernetes.io/projected/2de63356-5227-4ae6-8705-3469a49213e2-kube-api-access-sx7xm\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.319226 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.319180    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-model-cache\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.419985 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.419955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-model-cache\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.420151 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.420003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-dshm\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.420151 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.420028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2de63356-5227-4ae6-8705-3469a49213e2-tls-certs\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.420151 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.420079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-home\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.420151 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.420104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-tmp-dir\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.420380 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.420153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx7xm\" (UniqueName: \"kubernetes.io/projected/2de63356-5227-4ae6-8705-3469a49213e2-kube-api-access-sx7xm\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.421022 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.420998    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-model-cache\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.428622 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.421010    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-tmp-dir\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.428622 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.421250    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-home\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.428871 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.428459    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-dshm\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.430687 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.430661    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2de63356-5227-4ae6-8705-3469a49213e2-tls-certs\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.432060 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.432032    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx7xm\" (UniqueName: \"kubernetes.io/projected/2de63356-5227-4ae6-8705-3469a49213e2-kube-api-access-sx7xm\") pod \"auth-test-model-710890-kserve-64b9ccccf-s2tx5\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") " pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.507659 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.507570    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:11.673962 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:11.673932    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"]
Jul 20 19:55:11.675537 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:55:11.675513    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2de63356_5227_4ae6_8705_3469a49213e2.slice/crio-8f5170318392e5158df0d011dc831e9acb8bd733c6c43f33af8b15125fb126cf WatchSource:0}: Error finding container 8f5170318392e5158df0d011dc831e9acb8bd733c6c43f33af8b15125fb126cf: Status 404 returned error can't find the container with id 8f5170318392e5158df0d011dc831e9acb8bd733c6c43f33af8b15125fb126cf
Jul 20 19:55:12.062035 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:12.062002    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5" event={"ID":"2de63356-5227-4ae6-8705-3469a49213e2","Type":"ContainerStarted","Data":"609fe82565f4563a3b56892ed2d83c86bb500e6e77babc76405d8b2b638d38cb"}
Jul 20 19:55:12.062035 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:12.062042    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5" event={"ID":"2de63356-5227-4ae6-8705-3469a49213e2","Type":"ContainerStarted","Data":"8f5170318392e5158df0d011dc831e9acb8bd733c6c43f33af8b15125fb126cf"}
Jul 20 19:55:12.084383 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:12.084328    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5" podStartSLOduration=1.084312239 podStartE2EDuration="1.084312239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:55:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:55:12.081821428 +0000 UTC m=+2398.305448633" watchObservedRunningTime="2026-07-20 19:55:12.084312239 +0000 UTC m=+2398.307939420"
Jul 20 19:55:14.366019 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:14.365992    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:55:14.373977 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:14.373953    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 19:55:15.381049 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:15.381005    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:55:21.508320 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:21.508278    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:21.508320 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:21.508341    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:21.520880 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:21.520851    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:22.122446 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:22.122413    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:55:24.666247 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:24.666211    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:55:47.496925 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.496838    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"]
Jul 20 19:55:47.500467 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.500445    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.503145 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.503126    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01f2d8\"/\"kube-root-ca.crt\""
Jul 20 19:55:47.503280 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.503216    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01f2d8\"/\"openshift-service-ca.crt\""
Jul 20 19:55:47.504140 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.504127    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01f2d8\"/\"default-dockercfg-9gg8r\""
Jul 20 19:55:47.504202 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.504164    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01f2d8\"/\"auth-test-model-01f2d8-kserve-self-signed-certs\""
Jul 20 19:55:47.516015 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.515986    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"]
Jul 20 19:55:47.614764 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.614735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:55:47.635914 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.635876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m6f2\" (UniqueName: \"kubernetes.io/projected/1e123884-8ce1-4fbc-a212-a5ecef0254f1-kube-api-access-8m6f2\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.635914 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.635919    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-tmp-dir\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.636127 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.635947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-home\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.636127 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.636021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-model-cache\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.636127 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.636064    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e123884-8ce1-4fbc-a212-a5ecef0254f1-tls-certs\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.636127 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.636092    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-dshm\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.736741 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.736707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m6f2\" (UniqueName: \"kubernetes.io/projected/1e123884-8ce1-4fbc-a212-a5ecef0254f1-kube-api-access-8m6f2\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.736741 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.736745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-tmp-dir\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.737017 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.736773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-home\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.737017 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.736797    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-model-cache\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.737017 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.736838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e123884-8ce1-4fbc-a212-a5ecef0254f1-tls-certs\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.737017 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.736862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-dshm\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.737263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.737209    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-tmp-dir\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.737263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.737234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-home\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.737332 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.737317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-model-cache\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.739294 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.739278    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-dshm\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.739428 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.739411    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e123884-8ce1-4fbc-a212-a5ecef0254f1-tls-certs\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.747206 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.747128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m6f2\" (UniqueName: \"kubernetes.io/projected/1e123884-8ce1-4fbc-a212-a5ecef0254f1-kube-api-access-8m6f2\") pod \"auth-test-model-01f2d8-kserve-764b5d965f-fnmzw\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") " pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.809744 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.809714    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:47.955922 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:47.955894    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"]
Jul 20 19:55:47.956814 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:55:47.956785    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e123884_8ce1_4fbc_a212_a5ecef0254f1.slice/crio-5d1ce3d482f5621437182cabdbf523aa6f7bfbb9d9ed2c809574581b6a1a38af WatchSource:0}: Error finding container 5d1ce3d482f5621437182cabdbf523aa6f7bfbb9d9ed2c809574581b6a1a38af: Status 404 returned error can't find the container with id 5d1ce3d482f5621437182cabdbf523aa6f7bfbb9d9ed2c809574581b6a1a38af
Jul 20 19:55:48.246479 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:48.246445    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw" event={"ID":"1e123884-8ce1-4fbc-a212-a5ecef0254f1","Type":"ContainerStarted","Data":"0f24e100712caa8f9192bac4e4d16aa0863c533fdb2ca564c426de05fb452413"}
Jul 20 19:55:48.246479 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:48.246486    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw" event={"ID":"1e123884-8ce1-4fbc-a212-a5ecef0254f1","Type":"ContainerStarted","Data":"5d1ce3d482f5621437182cabdbf523aa6f7bfbb9d9ed2c809574581b6a1a38af"}
Jul 20 19:55:48.276506 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:48.276411    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw" podStartSLOduration=1.276397676 podStartE2EDuration="1.276397676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:55:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:55:48.275229468 +0000 UTC m=+2434.498856649" watchObservedRunningTime="2026-07-20 19:55:48.276397676 +0000 UTC m=+2434.500024857"
Jul 20 19:55:51.289950 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:51.289914    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:55:57.810536 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:57.810488    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:57.810936 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:57.810785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:57.822914 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:57.822895    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:55:58.312591 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:55:58.312564    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:56:06.699181 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:56:06.699141    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:56:21.318398 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:56:21.318357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:56:25.585811 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:56:25.585768    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:56:45.374684 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:56:45.374646    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:57:02.680103 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:57:02.680066    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:57:19.886249 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:57:19.886139    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:57:37.477523 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:57:37.477487    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:57:48.496002 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:57:48.495966    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"]
Jul 20 19:57:48.515623 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:57:48.515591    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:57:49.464794 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:57:49.464758    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"]
Jul 20 19:57:51.091695 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:57:51.091663    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:57:53.478537 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:57:53.478507    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:57:56.071819 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:57:56.071785    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:03.516296 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.516181    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5" podUID="2de63356-5227-4ae6-8705-3469a49213e2" containerName="main" containerID="cri-o://609fe82565f4563a3b56892ed2d83c86bb500e6e77babc76405d8b2b638d38cb" gracePeriod=45
Jul 20 19:58:03.766572 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.766502    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:58:03.909160 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.909127    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2de63356-5227-4ae6-8705-3469a49213e2-tls-certs\") pod \"2de63356-5227-4ae6-8705-3469a49213e2\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") "
Jul 20 19:58:03.909160 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.909165    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-tmp-dir\") pod \"2de63356-5227-4ae6-8705-3469a49213e2\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") "
Jul 20 19:58:03.909462 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.909215    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-model-cache\") pod \"2de63356-5227-4ae6-8705-3469a49213e2\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") "
Jul 20 19:58:03.909462 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.909255    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-home\") pod \"2de63356-5227-4ae6-8705-3469a49213e2\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") "
Jul 20 19:58:03.909462 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.909296    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sx7xm\" (UniqueName: \"kubernetes.io/projected/2de63356-5227-4ae6-8705-3469a49213e2-kube-api-access-sx7xm\") pod \"2de63356-5227-4ae6-8705-3469a49213e2\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") "
Jul 20 19:58:03.909462 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.909376    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-dshm\") pod \"2de63356-5227-4ae6-8705-3469a49213e2\" (UID: \"2de63356-5227-4ae6-8705-3469a49213e2\") "
Jul 20 19:58:03.909667 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.909520    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2de63356-5227-4ae6-8705-3469a49213e2" (UID: "2de63356-5227-4ae6-8705-3469a49213e2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:58:03.909667 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.909529    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-model-cache" (OuterVolumeSpecName: "model-cache") pod "2de63356-5227-4ae6-8705-3469a49213e2" (UID: "2de63356-5227-4ae6-8705-3469a49213e2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:58:03.909667 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.909549    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-home" (OuterVolumeSpecName: "home") pod "2de63356-5227-4ae6-8705-3469a49213e2" (UID: "2de63356-5227-4ae6-8705-3469a49213e2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:58:03.909786 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.909667    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-tmp-dir\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:58:03.909786 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.909685    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-model-cache\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:58:03.909786 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.909699    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-home\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:58:03.911646 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.911623    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-dshm" (OuterVolumeSpecName: "dshm") pod "2de63356-5227-4ae6-8705-3469a49213e2" (UID: "2de63356-5227-4ae6-8705-3469a49213e2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:58:03.911646 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.911624    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2de63356-5227-4ae6-8705-3469a49213e2-kube-api-access-sx7xm" (OuterVolumeSpecName: "kube-api-access-sx7xm") pod "2de63356-5227-4ae6-8705-3469a49213e2" (UID: "2de63356-5227-4ae6-8705-3469a49213e2"). InnerVolumeSpecName "kube-api-access-sx7xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:58:03.911771 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.911655    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de63356-5227-4ae6-8705-3469a49213e2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2de63356-5227-4ae6-8705-3469a49213e2" (UID: "2de63356-5227-4ae6-8705-3469a49213e2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:58:03.955425 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.955384    2581 generic.go:356] "Generic (PLEG): container finished" podID="2de63356-5227-4ae6-8705-3469a49213e2" containerID="609fe82565f4563a3b56892ed2d83c86bb500e6e77babc76405d8b2b638d38cb" exitCode=0
Jul 20 19:58:03.955595 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.955433    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"
Jul 20 19:58:03.955595 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.955468    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5" event={"ID":"2de63356-5227-4ae6-8705-3469a49213e2","Type":"ContainerDied","Data":"609fe82565f4563a3b56892ed2d83c86bb500e6e77babc76405d8b2b638d38cb"}
Jul 20 19:58:03.955595 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.955511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5" event={"ID":"2de63356-5227-4ae6-8705-3469a49213e2","Type":"ContainerDied","Data":"8f5170318392e5158df0d011dc831e9acb8bd733c6c43f33af8b15125fb126cf"}
Jul 20 19:58:03.955595 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.955528    2581 scope.go:117] "RemoveContainer" containerID="609fe82565f4563a3b56892ed2d83c86bb500e6e77babc76405d8b2b638d38cb"
Jul 20 19:58:03.965129 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.965110    2581 scope.go:117] "RemoveContainer" containerID="609fe82565f4563a3b56892ed2d83c86bb500e6e77babc76405d8b2b638d38cb"
Jul 20 19:58:03.965421 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:58:03.965399    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"609fe82565f4563a3b56892ed2d83c86bb500e6e77babc76405d8b2b638d38cb\": container with ID starting with 609fe82565f4563a3b56892ed2d83c86bb500e6e77babc76405d8b2b638d38cb not found: ID does not exist" containerID="609fe82565f4563a3b56892ed2d83c86bb500e6e77babc76405d8b2b638d38cb"
Jul 20 19:58:03.965472 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.965433    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"609fe82565f4563a3b56892ed2d83c86bb500e6e77babc76405d8b2b638d38cb"} err="failed to get container status \"609fe82565f4563a3b56892ed2d83c86bb500e6e77babc76405d8b2b638d38cb\": rpc error: code = NotFound desc = could not find container \"609fe82565f4563a3b56892ed2d83c86bb500e6e77babc76405d8b2b638d38cb\": container with ID starting with 609fe82565f4563a3b56892ed2d83c86bb500e6e77babc76405d8b2b638d38cb not found: ID does not exist"
Jul 20 19:58:03.977154 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.977126    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"]
Jul 20 19:58:03.979114 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:03.979093    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-710890/auth-test-model-710890-kserve-64b9ccccf-s2tx5"]
Jul 20 19:58:04.010680 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.010643    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2de63356-5227-4ae6-8705-3469a49213e2-dshm\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:58:04.010680 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.010676    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2de63356-5227-4ae6-8705-3469a49213e2-tls-certs\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:58:04.010680 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.010687    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx7xm\" (UniqueName: \"kubernetes.io/projected/2de63356-5227-4ae6-8705-3469a49213e2-kube-api-access-sx7xm\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:58:04.266599 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.266556    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2de63356-5227-4ae6-8705-3469a49213e2" path="/var/lib/kubelet/pods/2de63356-5227-4ae6-8705-3469a49213e2/volumes"
Jul 20 19:58:04.485902 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.485829    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw" podUID="1e123884-8ce1-4fbc-a212-a5ecef0254f1" containerName="main" containerID="cri-o://0f24e100712caa8f9192bac4e4d16aa0863c533fdb2ca564c426de05fb452413" gracePeriod=45
Jul 20 19:58:04.740693 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.740664    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:58:04.819743 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.819638    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e123884-8ce1-4fbc-a212-a5ecef0254f1-tls-certs\") pod \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") "
Jul 20 19:58:04.819743 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.819689    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-model-cache\") pod \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") "
Jul 20 19:58:04.819743 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.819737    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-home\") pod \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") "
Jul 20 19:58:04.820044 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.819757    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-tmp-dir\") pod \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") "
Jul 20 19:58:04.820044 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.819816    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m6f2\" (UniqueName: \"kubernetes.io/projected/1e123884-8ce1-4fbc-a212-a5ecef0254f1-kube-api-access-8m6f2\") pod \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") "
Jul 20 19:58:04.820044 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.819840    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-dshm\") pod \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\" (UID: \"1e123884-8ce1-4fbc-a212-a5ecef0254f1\") "
Jul 20 19:58:04.820167 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.820044    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-model-cache" (OuterVolumeSpecName: "model-cache") pod "1e123884-8ce1-4fbc-a212-a5ecef0254f1" (UID: "1e123884-8ce1-4fbc-a212-a5ecef0254f1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:58:04.820167 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.820054    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-home" (OuterVolumeSpecName: "home") pod "1e123884-8ce1-4fbc-a212-a5ecef0254f1" (UID: "1e123884-8ce1-4fbc-a212-a5ecef0254f1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:58:04.820167 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.820068    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1e123884-8ce1-4fbc-a212-a5ecef0254f1" (UID: "1e123884-8ce1-4fbc-a212-a5ecef0254f1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:58:04.822133 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.822107    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e123884-8ce1-4fbc-a212-a5ecef0254f1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1e123884-8ce1-4fbc-a212-a5ecef0254f1" (UID: "1e123884-8ce1-4fbc-a212-a5ecef0254f1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:58:04.822282 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.822155    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-dshm" (OuterVolumeSpecName: "dshm") pod "1e123884-8ce1-4fbc-a212-a5ecef0254f1" (UID: "1e123884-8ce1-4fbc-a212-a5ecef0254f1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:58:04.822282 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.822181    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e123884-8ce1-4fbc-a212-a5ecef0254f1-kube-api-access-8m6f2" (OuterVolumeSpecName: "kube-api-access-8m6f2") pod "1e123884-8ce1-4fbc-a212-a5ecef0254f1" (UID: "1e123884-8ce1-4fbc-a212-a5ecef0254f1"). InnerVolumeSpecName "kube-api-access-8m6f2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:58:04.921182 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.921150    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-home\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:58:04.921367 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.921226    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-tmp-dir\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:58:04.921367 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.921238    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m6f2\" (UniqueName: \"kubernetes.io/projected/1e123884-8ce1-4fbc-a212-a5ecef0254f1-kube-api-access-8m6f2\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:58:04.921367 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.921248    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-dshm\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:58:04.921367 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.921256    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e123884-8ce1-4fbc-a212-a5ecef0254f1-tls-certs\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:58:04.921367 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.921263    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e123884-8ce1-4fbc-a212-a5ecef0254f1-model-cache\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:58:04.961989 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.961955    2581 generic.go:356] "Generic (PLEG): container finished" podID="1e123884-8ce1-4fbc-a212-a5ecef0254f1" containerID="0f24e100712caa8f9192bac4e4d16aa0863c533fdb2ca564c426de05fb452413" exitCode=0
Jul 20 19:58:04.962165 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.962020    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"
Jul 20 19:58:04.962165 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.962043    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw" event={"ID":"1e123884-8ce1-4fbc-a212-a5ecef0254f1","Type":"ContainerDied","Data":"0f24e100712caa8f9192bac4e4d16aa0863c533fdb2ca564c426de05fb452413"}
Jul 20 19:58:04.962165 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.962100    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw" event={"ID":"1e123884-8ce1-4fbc-a212-a5ecef0254f1","Type":"ContainerDied","Data":"5d1ce3d482f5621437182cabdbf523aa6f7bfbb9d9ed2c809574581b6a1a38af"}
Jul 20 19:58:04.962165 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.962125    2581 scope.go:117] "RemoveContainer" containerID="0f24e100712caa8f9192bac4e4d16aa0863c533fdb2ca564c426de05fb452413"
Jul 20 19:58:04.971655 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.971635    2581 scope.go:117] "RemoveContainer" containerID="0f24e100712caa8f9192bac4e4d16aa0863c533fdb2ca564c426de05fb452413"
Jul 20 19:58:04.971908 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:58:04.971892    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f24e100712caa8f9192bac4e4d16aa0863c533fdb2ca564c426de05fb452413\": container with ID starting with 0f24e100712caa8f9192bac4e4d16aa0863c533fdb2ca564c426de05fb452413 not found: ID does not exist" containerID="0f24e100712caa8f9192bac4e4d16aa0863c533fdb2ca564c426de05fb452413"
Jul 20 19:58:04.971954 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.971917    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f24e100712caa8f9192bac4e4d16aa0863c533fdb2ca564c426de05fb452413"} err="failed to get container status \"0f24e100712caa8f9192bac4e4d16aa0863c533fdb2ca564c426de05fb452413\": rpc error: code = NotFound desc = could not find container \"0f24e100712caa8f9192bac4e4d16aa0863c533fdb2ca564c426de05fb452413\": container with ID starting with 0f24e100712caa8f9192bac4e4d16aa0863c533fdb2ca564c426de05fb452413 not found: ID does not exist"
Jul 20 19:58:04.984745 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.984713    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"]
Jul 20 19:58:04.993076 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:04.993051    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/auth-test-model-01f2d8-kserve-764b5d965f-fnmzw"]
Jul 20 19:58:06.266099 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:06.266062    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e123884-8ce1-4fbc-a212-a5ecef0254f1" path="/var/lib/kubelet/pods/1e123884-8ce1-4fbc-a212-a5ecef0254f1/volumes"
Jul 20 19:58:06.976877 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:06.976847    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:58:21.588437 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.588402    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"]
Jul 20 19:58:21.588898 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.588879    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e123884-8ce1-4fbc-a212-a5ecef0254f1" containerName="main"
Jul 20 19:58:21.588943 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.588903    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e123884-8ce1-4fbc-a212-a5ecef0254f1" containerName="main"
Jul 20 19:58:21.588978 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.588951    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de63356-5227-4ae6-8705-3469a49213e2" containerName="main"
Jul 20 19:58:21.588978 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.588960    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de63356-5227-4ae6-8705-3469a49213e2" containerName="main"
Jul 20 19:58:21.589058 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.589046    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de63356-5227-4ae6-8705-3469a49213e2" containerName="main"
Jul 20 19:58:21.589098 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.589066    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e123884-8ce1-4fbc-a212-a5ecef0254f1" containerName="main"
Jul 20 19:58:21.592072 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.592052    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.595334 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.595311    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01f2d8\"/\"default-dockercfg-9gg8r\""
Jul 20 19:58:21.595665 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.595316    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-01f2d8\"/\"sub-test-model-01f2d8-kserve-self-signed-certs\""
Jul 20 19:58:21.595783 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.595331    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01f2d8\"/\"kube-root-ca.crt\""
Jul 20 19:58:21.595844 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.595338    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-01f2d8\"/\"openshift-service-ca.crt\""
Jul 20 19:58:21.598575 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.598544    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"]
Jul 20 19:58:21.616566 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.616543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:58:21.666799 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.666766    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-model-cache\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.666799 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.666798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-tmp-dir\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.666983 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.666827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wwss\" (UniqueName: \"kubernetes.io/projected/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-kube-api-access-5wwss\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.666983 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.666914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-tls-certs\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.666983 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.666953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-home\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.667086 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.667004    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-dshm\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.768339 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.768298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wwss\" (UniqueName: \"kubernetes.io/projected/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-kube-api-access-5wwss\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.768339 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.768346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-tls-certs\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.768593 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.768383    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-home\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.768593 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.768430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-dshm\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.768593 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.768471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-model-cache\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.768593 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.768487    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-tmp-dir\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.768853 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.768827    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-home\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.768906 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.768849    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-model-cache\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.768906 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.768895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-tmp-dir\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.770831 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.770813    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-dshm\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.771217 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.771179    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-tls-certs\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.777854 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.777814    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wwss\" (UniqueName: \"kubernetes.io/projected/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-kube-api-access-5wwss\") pod \"sub-test-model-01f2d8-kserve-f8646bc85-4cssl\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") " pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:21.902589 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:21.902495    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:22.040484 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:22.040452    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"]
Jul 20 19:58:22.042077 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:58:22.042051    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e25bebe_fa95_4404_8583_f31b0d9b6c0b.slice/crio-3942d4d6e66702e7a760f7be8c41acb3fa2adc01a7c4c658315fc2f39682911f WatchSource:0}: Error finding container 3942d4d6e66702e7a760f7be8c41acb3fa2adc01a7c4c658315fc2f39682911f: Status 404 returned error can't find the container with id 3942d4d6e66702e7a760f7be8c41acb3fa2adc01a7c4c658315fc2f39682911f
Jul 20 19:58:22.052037 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:22.052013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl" event={"ID":"7e25bebe-fa95-4404-8583-f31b0d9b6c0b","Type":"ContainerStarted","Data":"3942d4d6e66702e7a760f7be8c41acb3fa2adc01a7c4c658315fc2f39682911f"}
Jul 20 19:58:23.065111 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:23.065064    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl" event={"ID":"7e25bebe-fa95-4404-8583-f31b0d9b6c0b","Type":"ContainerStarted","Data":"a8c8c1f7d9bffd43763d30b9fef333b67f4b6818fa7d362dc07179949e5355d0"}
Jul 20 19:58:23.084238 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:23.084176    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl" podStartSLOduration=2.084162648 podStartE2EDuration="2.084162648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:58:23.081674351 +0000 UTC m=+2589.305301545" watchObservedRunningTime="2026-07-20 19:58:23.084162648 +0000 UTC m=+2589.307789859"
Jul 20 19:58:25.483111 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:25.483065    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:58:31.902959 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:31.902918    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:31.903457 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:31.902975    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:31.916067 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:31.916042    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:32.126086 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:32.126055    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:58:40.575924 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:40.575839    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:58:59.808948 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:58:59.808914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:00.859658 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:00.859627    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"]
Jul 20 19:59:00.882223 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:00.882163    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:05.078572 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:05.078541    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:59:14.553997 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.553954    2581 scope.go:117] "RemoveContainer" containerID="0b0799e01f4c813462f4d7420e8ad32f40f61030e3424cb68c7a92188f57096c"
Jul 20 19:59:14.562161 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.562141    2581 scope.go:117] "RemoveContainer" containerID="072eff1db460f743dcfc339aa7b561a60523e0289a2689efaf8520753f636031"
Jul 20 19:59:14.901128 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.901092    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"]
Jul 20 19:59:14.906263 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.906242    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:14.910012 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.909991    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-710890\"/\"rate-test-model-710890-kserve-self-signed-certs\""
Jul 20 19:59:14.910012 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.909999    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-710890\"/\"kube-root-ca.crt\""
Jul 20 19:59:14.910168 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.910047    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-710890\"/\"default-dockercfg-m7vr6\""
Jul 20 19:59:14.910168 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.910001    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-710890\"/\"openshift-service-ca.crt\""
Jul 20 19:59:14.915963 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.915943    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"]
Jul 20 19:59:14.934057 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.934032    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-model-cache\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:14.934232 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.934067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22q2k\" (UniqueName: \"kubernetes.io/projected/b0ee99ae-bdcf-45e8-8250-2beedca580ae-kube-api-access-22q2k\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:14.934232 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.934100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-home\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:14.934232 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.934155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-tmp-dir\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:14.934405 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.934238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-dshm\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:14.934405 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.934266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0ee99ae-bdcf-45e8-8250-2beedca580ae-tls-certs\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:14.982939 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:14.982912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:15.035168 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.035132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-home\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:15.035168 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.035168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-tmp-dir\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:15.035401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.035319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-dshm\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:15.035401 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.035360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0ee99ae-bdcf-45e8-8250-2beedca580ae-tls-certs\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:15.035493 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.035405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-model-cache\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:15.035493 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.035440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22q2k\" (UniqueName: \"kubernetes.io/projected/b0ee99ae-bdcf-45e8-8250-2beedca580ae-kube-api-access-22q2k\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:15.035598 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.035550    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-tmp-dir\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:15.035598 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.035589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-home\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:15.035706 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.035690    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-model-cache\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:15.037642 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.037623    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-dshm\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:15.037983 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.037964    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0ee99ae-bdcf-45e8-8250-2beedca580ae-tls-certs\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:15.044990 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.044971    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22q2k\" (UniqueName: \"kubernetes.io/projected/b0ee99ae-bdcf-45e8-8250-2beedca580ae-kube-api-access-22q2k\") pod \"rate-test-model-710890-kserve-575fb678ff-tj9l7\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") " pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:15.217558 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.217464    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:15.355640 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.355611    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"]
Jul 20 19:59:15.358336 ip-10-0-141-43 kubenswrapper[2581]: W0720 19:59:15.358294    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0ee99ae_bdcf_45e8_8250_2beedca580ae.slice/crio-200dfcf8105e1becd5590b4aac90660f4ab9a89ed63e09157ddfbdd914b94729 WatchSource:0}: Error finding container 200dfcf8105e1becd5590b4aac90660f4ab9a89ed63e09157ddfbdd914b94729: Status 404 returned error can't find the container with id 200dfcf8105e1becd5590b4aac90660f4ab9a89ed63e09157ddfbdd914b94729
Jul 20 19:59:15.881342 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:15.881282    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl" podUID="7e25bebe-fa95-4404-8583-f31b0d9b6c0b" containerName="main" containerID="cri-o://a8c8c1f7d9bffd43763d30b9fef333b67f4b6818fa7d362dc07179949e5355d0" gracePeriod=45
Jul 20 19:59:16.135604 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.135547    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:59:16.145165 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.145142    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-home\") pod \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") "
Jul 20 19:59:16.145308 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.145256    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-tls-certs\") pod \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") "
Jul 20 19:59:16.145358 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.145315    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-dshm\") pod \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") "
Jul 20 19:59:16.145358 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.145346    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-tmp-dir\") pod \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") "
Jul 20 19:59:16.145434 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.145393    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-model-cache\") pod \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") "
Jul 20 19:59:16.145434 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.145408    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-home" (OuterVolumeSpecName: "home") pod "7e25bebe-fa95-4404-8583-f31b0d9b6c0b" (UID: "7e25bebe-fa95-4404-8583-f31b0d9b6c0b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:59:16.145514 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.145444    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wwss\" (UniqueName: \"kubernetes.io/projected/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-kube-api-access-5wwss\") pod \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\" (UID: \"7e25bebe-fa95-4404-8583-f31b0d9b6c0b\") "
Jul 20 19:59:16.145620 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.145594    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7e25bebe-fa95-4404-8583-f31b0d9b6c0b" (UID: "7e25bebe-fa95-4404-8583-f31b0d9b6c0b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:59:16.145737 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.145676    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-model-cache" (OuterVolumeSpecName: "model-cache") pod "7e25bebe-fa95-4404-8583-f31b0d9b6c0b" (UID: "7e25bebe-fa95-4404-8583-f31b0d9b6c0b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:59:16.145737 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.145711    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-tmp-dir\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:59:16.145737 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.145729    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-home\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:59:16.147414 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.147394    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7e25bebe-fa95-4404-8583-f31b0d9b6c0b" (UID: "7e25bebe-fa95-4404-8583-f31b0d9b6c0b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:59:16.147488 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.147474    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-dshm" (OuterVolumeSpecName: "dshm") pod "7e25bebe-fa95-4404-8583-f31b0d9b6c0b" (UID: "7e25bebe-fa95-4404-8583-f31b0d9b6c0b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:59:16.147613 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.147596    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-kube-api-access-5wwss" (OuterVolumeSpecName: "kube-api-access-5wwss") pod "7e25bebe-fa95-4404-8583-f31b0d9b6c0b" (UID: "7e25bebe-fa95-4404-8583-f31b0d9b6c0b"). InnerVolumeSpecName "kube-api-access-5wwss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:59:16.246909 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.246875    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-dshm\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:59:16.246909 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.246905    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-model-cache\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:59:16.247122 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.246918    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wwss\" (UniqueName: \"kubernetes.io/projected/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-kube-api-access-5wwss\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:59:16.247122 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.246927    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e25bebe-fa95-4404-8583-f31b0d9b6c0b-tls-certs\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 19:59:16.351143 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.351109    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7" event={"ID":"b0ee99ae-bdcf-45e8-8250-2beedca580ae","Type":"ContainerStarted","Data":"55369285c83edeeaf13ae079281050cf03b4b4f7ce755f2390a2aecd1f20b2a2"}
Jul 20 19:59:16.351346 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.351153    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7" event={"ID":"b0ee99ae-bdcf-45e8-8250-2beedca580ae","Type":"ContainerStarted","Data":"200dfcf8105e1becd5590b4aac90660f4ab9a89ed63e09157ddfbdd914b94729"}
Jul 20 19:59:16.352352 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.352330    2581 generic.go:356] "Generic (PLEG): container finished" podID="7e25bebe-fa95-4404-8583-f31b0d9b6c0b" containerID="a8c8c1f7d9bffd43763d30b9fef333b67f4b6818fa7d362dc07179949e5355d0" exitCode=0
Jul 20 19:59:16.352453 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.352361    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"
Jul 20 19:59:16.352453 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.352385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl" event={"ID":"7e25bebe-fa95-4404-8583-f31b0d9b6c0b","Type":"ContainerDied","Data":"a8c8c1f7d9bffd43763d30b9fef333b67f4b6818fa7d362dc07179949e5355d0"}
Jul 20 19:59:16.352453 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.352413    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl" event={"ID":"7e25bebe-fa95-4404-8583-f31b0d9b6c0b","Type":"ContainerDied","Data":"3942d4d6e66702e7a760f7be8c41acb3fa2adc01a7c4c658315fc2f39682911f"}
Jul 20 19:59:16.352453 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.352428    2581 scope.go:117] "RemoveContainer" containerID="a8c8c1f7d9bffd43763d30b9fef333b67f4b6818fa7d362dc07179949e5355d0"
Jul 20 19:59:16.361180 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.361153    2581 scope.go:117] "RemoveContainer" containerID="a8c8c1f7d9bffd43763d30b9fef333b67f4b6818fa7d362dc07179949e5355d0"
Jul 20 19:59:16.361434 ip-10-0-141-43 kubenswrapper[2581]: E0720 19:59:16.361414    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8c8c1f7d9bffd43763d30b9fef333b67f4b6818fa7d362dc07179949e5355d0\": container with ID starting with a8c8c1f7d9bffd43763d30b9fef333b67f4b6818fa7d362dc07179949e5355d0 not found: ID does not exist" containerID="a8c8c1f7d9bffd43763d30b9fef333b67f4b6818fa7d362dc07179949e5355d0"
Jul 20 19:59:16.361476 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.361443    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8c8c1f7d9bffd43763d30b9fef333b67f4b6818fa7d362dc07179949e5355d0"} err="failed to get container status \"a8c8c1f7d9bffd43763d30b9fef333b67f4b6818fa7d362dc07179949e5355d0\": rpc error: code = NotFound desc = could not find container \"a8c8c1f7d9bffd43763d30b9fef333b67f4b6818fa7d362dc07179949e5355d0\": container with ID starting with a8c8c1f7d9bffd43763d30b9fef333b67f4b6818fa7d362dc07179949e5355d0 not found: ID does not exist"
Jul 20 19:59:16.375910 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.375855    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7" podStartSLOduration=2.375838163 podStartE2EDuration="2.375838163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:59:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:59:16.374474538 +0000 UTC m=+2642.598101731" watchObservedRunningTime="2026-07-20 19:59:16.375838163 +0000 UTC m=+2642.599465347"
Jul 20 19:59:16.395360 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.395300    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"]
Jul 20 19:59:16.401016 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:16.400991    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-01f2d8/sub-test-model-01f2d8-kserve-f8646bc85-4cssl"]
Jul 20 19:59:17.876409 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:17.876371    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:59:18.266338 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:18.266256    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e25bebe-fa95-4404-8583-f31b0d9b6c0b" path="/var/lib/kubelet/pods/7e25bebe-fa95-4404-8583-f31b0d9b6c0b/volumes"
Jul 20 19:59:24.037715 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:24.037684    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:24.139061 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:24.139027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:25.218210 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:25.218137    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:25.218210 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:25.218219    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:25.230382 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:25.230361    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:25.411504 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:25.411476    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 19:59:31.436676 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:31.436645    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:35.695156 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:35.695121    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 19:59:40.169178 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:40.169140    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 19:59:40.275507 ip-10-0-141-43 kubenswrapper[2581]: I0720 19:59:40.275474    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:00.138487 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:00.138446    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz"]
Jul 20 20:00:00.139268 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:00.139245    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e25bebe-fa95-4404-8583-f31b0d9b6c0b" containerName="main"
Jul 20 20:00:00.139268 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:00.139269    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e25bebe-fa95-4404-8583-f31b0d9b6c0b" containerName="main"
Jul 20 20:00:00.139477 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:00.139460    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e25bebe-fa95-4404-8583-f31b0d9b6c0b" containerName="main"
Jul 20 20:00:00.143032 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:00.143006    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz"
Jul 20 20:00:00.145703 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:00.145674    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\""
Jul 20 20:00:00.151216 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:00.151161    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz"]
Jul 20 20:00:00.157304 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:00.157274    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz"
Jul 20 20:00:00.301607 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:00.301579    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz"]
Jul 20 20:00:00.303950 ip-10-0-141-43 kubenswrapper[2581]: W0720 20:00:00.303904    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d5c6bd_2f25_493d_9051_f961e15b3e7b.slice/crio-ebb10deae239f06d6d2bcf02e501dd194a49c6e812f042f61ae7c9108110e700 WatchSource:0}: Error finding container ebb10deae239f06d6d2bcf02e501dd194a49c6e812f042f61ae7c9108110e700: Status 404 returned error can't find the container with id ebb10deae239f06d6d2bcf02e501dd194a49c6e812f042f61ae7c9108110e700
Jul 20 20:00:00.593204 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:00.593153    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz" event={"ID":"85d5c6bd-2f25-493d-9051-f961e15b3e7b","Type":"ContainerStarted","Data":"96cd3ecb674d04e5250f62fe63d94a992198cf638b79dbdd026f38d0a3d4dc14"}
Jul 20 20:00:00.593383 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:00.593229    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz" event={"ID":"85d5c6bd-2f25-493d-9051-f961e15b3e7b","Type":"ContainerStarted","Data":"ebb10deae239f06d6d2bcf02e501dd194a49c6e812f042f61ae7c9108110e700"}
Jul 20 20:00:00.609594 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:00.609541    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz" podStartSLOduration=0.609525999 podStartE2EDuration="609.525999ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:00:00.607266234 +0000 UTC m=+2686.830893414" watchObservedRunningTime="2026-07-20 20:00:00.609525999 +0000 UTC m=+2686.833153226"
Jul 20 20:00:01.600328 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:01.600287    2581 generic.go:356] "Generic (PLEG): container finished" podID="85d5c6bd-2f25-493d-9051-f961e15b3e7b" containerID="96cd3ecb674d04e5250f62fe63d94a992198cf638b79dbdd026f38d0a3d4dc14" exitCode=0
Jul 20 20:00:01.600754 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:01.600371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz" event={"ID":"85d5c6bd-2f25-493d-9051-f961e15b3e7b","Type":"ContainerDied","Data":"96cd3ecb674d04e5250f62fe63d94a992198cf638b79dbdd026f38d0a3d4dc14"}
Jul 20 20:00:02.525744 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:02.525706    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:02.593362 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:02.593327    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 20:00:02.608512 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:02.608484    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:02.746302 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:02.746271    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz"
Jul 20 20:00:03.614663 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:03.614637    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz"
Jul 20 20:00:03.615088 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:03.614636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz" event={"ID":"85d5c6bd-2f25-493d-9051-f961e15b3e7b","Type":"ContainerDied","Data":"ebb10deae239f06d6d2bcf02e501dd194a49c6e812f042f61ae7c9108110e700"}
Jul 20 20:00:03.615088 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:03.614766    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebb10deae239f06d6d2bcf02e501dd194a49c6e812f042f61ae7c9108110e700"
Jul 20 20:00:07.976640 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:07.976604    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:08.078178 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:08.078144    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:14.399423 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:14.399393    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 20:00:14.407134 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:14.407115    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-njbnv_b4430254-3957-4d90-a9be-9b4760c44565/ovn-acl-logging/0.log"
Jul 20 20:00:14.586392 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:14.586360    2581 scope.go:117] "RemoveContainer" containerID="b7bf39c735285067b478a63753ff75001ba808ec703df96f2f22492ae02548ea"
Jul 20 20:00:14.595004 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:14.594985    2581 scope.go:117] "RemoveContainer" containerID="867ccffc3c3131f715dfee542fce073f652de0daeb735f83e33521250eeb2fa8"
Jul 20 20:00:18.882283 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:18.882249    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 20:00:25.177972 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:25.177934    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"]
Jul 20 20:00:25.194824 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:25.194797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:26.142207 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:26.142161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:27.053157 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.053125    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7415-139772282186544"]
Jul 20 20:00:27.053554 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.053452    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d5c6bd-2f25-493d-9051-f961e15b3e7b" containerName="cleanup"
Jul 20 20:00:27.053554 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.053462    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d5c6bd-2f25-493d-9051-f961e15b3e7b" containerName="cleanup"
Jul 20 20:00:27.053554 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.053530    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="85d5c6bd-2f25-493d-9051-f961e15b3e7b" containerName="cleanup"
Jul 20 20:00:27.056460 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.056438    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282186544"
Jul 20 20:00:27.059156 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.059136    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rmpxm\""
Jul 20 20:00:27.063057 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.063017    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7415-139772282186544"]
Jul 20 20:00:27.173729 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.173701    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b494j\" (UniqueName: \"kubernetes.io/projected/f5e78d43-362a-48c7-a59f-afc5086f6e80-kube-api-access-b494j\") pod \"test-curl-7415-139772282186544\" (UID: \"f5e78d43-362a-48c7-a59f-afc5086f6e80\") " pod="opendatahub/test-curl-7415-139772282186544"
Jul 20 20:00:27.275154 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.275115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b494j\" (UniqueName: \"kubernetes.io/projected/f5e78d43-362a-48c7-a59f-afc5086f6e80-kube-api-access-b494j\") pod \"test-curl-7415-139772282186544\" (UID: \"f5e78d43-362a-48c7-a59f-afc5086f6e80\") " pod="opendatahub/test-curl-7415-139772282186544"
Jul 20 20:00:27.284882 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.284851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b494j\" (UniqueName: \"kubernetes.io/projected/f5e78d43-362a-48c7-a59f-afc5086f6e80-kube-api-access-b494j\") pod \"test-curl-7415-139772282186544\" (UID: \"f5e78d43-362a-48c7-a59f-afc5086f6e80\") " pod="opendatahub/test-curl-7415-139772282186544"
Jul 20 20:00:27.366862 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.366816    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282186544"
Jul 20 20:00:27.503753 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.503728    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7415-139772282186544"]
Jul 20 20:00:27.506040 ip-10-0-141-43 kubenswrapper[2581]: W0720 20:00:27.506015    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5e78d43_362a_48c7_a59f_afc5086f6e80.slice/crio-80ce6b7db034fce9db25842c97112701bcdc312319c9f32a9d9ae3f55f6e0412 WatchSource:0}: Error finding container 80ce6b7db034fce9db25842c97112701bcdc312319c9f32a9d9ae3f55f6e0412: Status 404 returned error can't find the container with id 80ce6b7db034fce9db25842c97112701bcdc312319c9f32a9d9ae3f55f6e0412
Jul 20 20:00:27.507385 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.507367    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 20:00:27.737984 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:27.737894    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7415-139772282186544" event={"ID":"f5e78d43-362a-48c7-a59f-afc5086f6e80","Type":"ContainerStarted","Data":"80ce6b7db034fce9db25842c97112701bcdc312319c9f32a9d9ae3f55f6e0412"}
Jul 20 20:00:28.745334 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:28.745232    2581 generic.go:356] "Generic (PLEG): container finished" podID="f5e78d43-362a-48c7-a59f-afc5086f6e80" containerID="bc0042fd40d1a8b103e8cd6c28b611f92f6d685b6a1e85a204d027f325b2c6ac" exitCode=0
Jul 20 20:00:28.745334 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:28.745319    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7415-139772282186544" event={"ID":"f5e78d43-362a-48c7-a59f-afc5086f6e80","Type":"ContainerDied","Data":"bc0042fd40d1a8b103e8cd6c28b611f92f6d685b6a1e85a204d027f325b2c6ac"}
Jul 20 20:00:29.890538 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:29.890515    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282186544"
Jul 20 20:00:29.911494 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:29.911471    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7415-139772282186544_f5e78d43-362a-48c7-a59f-afc5086f6e80/test-curl-7415-139772282186544/0.log"
Jul 20 20:00:29.935975 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:29.935943    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7415-139772282186544"]
Jul 20 20:00:29.940356 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:29.940335    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7415-139772282186544"]
Jul 20 20:00:30.003864 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:30.003777    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b494j\" (UniqueName: \"kubernetes.io/projected/f5e78d43-362a-48c7-a59f-afc5086f6e80-kube-api-access-b494j\") pod \"f5e78d43-362a-48c7-a59f-afc5086f6e80\" (UID: \"f5e78d43-362a-48c7-a59f-afc5086f6e80\") "
Jul 20 20:00:30.006053 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:30.006026    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5e78d43-362a-48c7-a59f-afc5086f6e80-kube-api-access-b494j" (OuterVolumeSpecName: "kube-api-access-b494j") pod "f5e78d43-362a-48c7-a59f-afc5086f6e80" (UID: "f5e78d43-362a-48c7-a59f-afc5086f6e80"). InnerVolumeSpecName "kube-api-access-b494j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:00:30.104436 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:30.104399    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b494j\" (UniqueName: \"kubernetes.io/projected/f5e78d43-362a-48c7-a59f-afc5086f6e80-kube-api-access-b494j\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:00:30.266339 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:30.266239    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5e78d43-362a-48c7-a59f-afc5086f6e80" path="/var/lib/kubelet/pods/f5e78d43-362a-48c7-a59f-afc5086f6e80/volumes"
Jul 20 20:00:30.756555 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:30.756526    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282186544"
Jul 20 20:00:30.756740 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:30.756567    2581 scope.go:117] "RemoveContainer" containerID="bc0042fd40d1a8b103e8cd6c28b611f92f6d685b6a1e85a204d027f325b2c6ac"
Jul 20 20:00:35.907001 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:35.906969    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7415-139772282290368"]
Jul 20 20:00:35.907502 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:35.907329    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5e78d43-362a-48c7-a59f-afc5086f6e80" containerName="test-curl-7415-139772282186544"
Jul 20 20:00:35.907502 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:35.907341    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5e78d43-362a-48c7-a59f-afc5086f6e80" containerName="test-curl-7415-139772282186544"
Jul 20 20:00:35.907502 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:35.907402    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5e78d43-362a-48c7-a59f-afc5086f6e80" containerName="test-curl-7415-139772282186544"
Jul 20 20:00:35.911753 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:35.911735    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282290368"
Jul 20 20:00:35.914983 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:35.914961    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rmpxm\""
Jul 20 20:00:35.919137 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:35.918967    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7415-139772282290368"]
Jul 20 20:00:36.057425 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:36.057391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdsnx\" (UniqueName: \"kubernetes.io/projected/b7522a17-b4ee-48c1-bf52-7070b8ebdfe1-kube-api-access-wdsnx\") pod \"test-curl-7415-139772282290368\" (UID: \"b7522a17-b4ee-48c1-bf52-7070b8ebdfe1\") " pod="opendatahub/test-curl-7415-139772282290368"
Jul 20 20:00:36.083836 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:36.083800    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 20:00:36.158081 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:36.157990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdsnx\" (UniqueName: \"kubernetes.io/projected/b7522a17-b4ee-48c1-bf52-7070b8ebdfe1-kube-api-access-wdsnx\") pod \"test-curl-7415-139772282290368\" (UID: \"b7522a17-b4ee-48c1-bf52-7070b8ebdfe1\") " pod="opendatahub/test-curl-7415-139772282290368"
Jul 20 20:00:36.166829 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:36.166801    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdsnx\" (UniqueName: \"kubernetes.io/projected/b7522a17-b4ee-48c1-bf52-7070b8ebdfe1-kube-api-access-wdsnx\") pod \"test-curl-7415-139772282290368\" (UID: \"b7522a17-b4ee-48c1-bf52-7070b8ebdfe1\") " pod="opendatahub/test-curl-7415-139772282290368"
Jul 20 20:00:36.221840 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:36.221806    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282290368"
Jul 20 20:00:36.357387 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:36.357363    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7415-139772282290368"]
Jul 20 20:00:36.359034 ip-10-0-141-43 kubenswrapper[2581]: W0720 20:00:36.359007    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7522a17_b4ee_48c1_bf52_7070b8ebdfe1.slice/crio-00feb23e9fa297a7651981943a012961b4b3874690401df87e5c219d4791cb7e WatchSource:0}: Error finding container 00feb23e9fa297a7651981943a012961b4b3874690401df87e5c219d4791cb7e: Status 404 returned error can't find the container with id 00feb23e9fa297a7651981943a012961b4b3874690401df87e5c219d4791cb7e
Jul 20 20:00:36.790217 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:36.790164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7415-139772282290368" event={"ID":"b7522a17-b4ee-48c1-bf52-7070b8ebdfe1","Type":"ContainerStarted","Data":"11baea9ccdf5616347645102e9b110ab7b98905b4a4a9b73bbfa449c3a4d13d6"}
Jul 20 20:00:36.790349 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:36.790228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7415-139772282290368" event={"ID":"b7522a17-b4ee-48c1-bf52-7070b8ebdfe1","Type":"ContainerStarted","Data":"00feb23e9fa297a7651981943a012961b4b3874690401df87e5c219d4791cb7e"}
Jul 20 20:00:36.805229 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:36.805166    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7415-139772282290368" podStartSLOduration=1.467239455 podStartE2EDuration="1.805149761s" totalImagesPullingTime="337.910306ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:00:36.803363529 +0000 UTC m=+2723.026990711" watchObservedRunningTime="2026-07-20 20:00:36.805149761 +0000 UTC m=+2723.028776942"
Jul 20 20:00:36.900042 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:36.900015    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7415-139772282290368_b7522a17-b4ee-48c1-bf52-7070b8ebdfe1/test-curl-7415-139772282290368/0.log"
Jul 20 20:00:37.797280 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:37.797244    2581 generic.go:356] "Generic (PLEG): container finished" podID="b7522a17-b4ee-48c1-bf52-7070b8ebdfe1" containerID="11baea9ccdf5616347645102e9b110ab7b98905b4a4a9b73bbfa449c3a4d13d6" exitCode=0
Jul 20 20:00:37.797693 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:37.797336    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7415-139772282290368" event={"ID":"b7522a17-b4ee-48c1-bf52-7070b8ebdfe1","Type":"ContainerDied","Data":"11baea9ccdf5616347645102e9b110ab7b98905b4a4a9b73bbfa449c3a4d13d6"}
Jul 20 20:00:38.934385 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:38.934356    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282290368"
Jul 20 20:00:38.966627 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:38.966597    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7415-139772282290368"]
Jul 20 20:00:38.970854 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:38.970826    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7415-139772282290368"]
Jul 20 20:00:39.083918 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:39.083888    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdsnx\" (UniqueName: \"kubernetes.io/projected/b7522a17-b4ee-48c1-bf52-7070b8ebdfe1-kube-api-access-wdsnx\") pod \"b7522a17-b4ee-48c1-bf52-7070b8ebdfe1\" (UID: \"b7522a17-b4ee-48c1-bf52-7070b8ebdfe1\") "
Jul 20 20:00:39.086293 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:39.086268    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7522a17-b4ee-48c1-bf52-7070b8ebdfe1-kube-api-access-wdsnx" (OuterVolumeSpecName: "kube-api-access-wdsnx") pod "b7522a17-b4ee-48c1-bf52-7070b8ebdfe1" (UID: "b7522a17-b4ee-48c1-bf52-7070b8ebdfe1"). InnerVolumeSpecName "kube-api-access-wdsnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:00:39.185119 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:39.185087    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdsnx\" (UniqueName: \"kubernetes.io/projected/b7522a17-b4ee-48c1-bf52-7070b8ebdfe1-kube-api-access-wdsnx\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:00:39.808049 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:39.808017    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00feb23e9fa297a7651981943a012961b4b3874690401df87e5c219d4791cb7e"
Jul 20 20:00:39.808229 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:39.808059    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282290368"
Jul 20 20:00:39.817775 ip-10-0-141-43 kubenswrapper[2581]: E0720 20:00:39.817747    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7415-139772282290368\" is forbidden: User \"system:node:ip-10-0-141-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-43.ec2.internal' and this object" podUID="b7522a17-b4ee-48c1-bf52-7070b8ebdfe1" pod="opendatahub/test-curl-7415-139772282290368"
Jul 20 20:00:40.198445 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.198403    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7" podUID="b0ee99ae-bdcf-45e8-8250-2beedca580ae" containerName="main" containerID="cri-o://55369285c83edeeaf13ae079281050cf03b4b4f7ce755f2390a2aecd1f20b2a2" gracePeriod=45
Jul 20 20:00:40.266513 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.266477    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7522a17-b4ee-48c1-bf52-7070b8ebdfe1" path="/var/lib/kubelet/pods/b7522a17-b4ee-48c1-bf52-7070b8ebdfe1/volumes"
Jul 20 20:00:40.457050 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.456976    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 20:00:40.596975 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.596938    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-tmp-dir\") pod \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") "
Jul 20 20:00:40.597147 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.596996    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-model-cache\") pod \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") "
Jul 20 20:00:40.597147 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.597106    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0ee99ae-bdcf-45e8-8250-2beedca580ae-tls-certs\") pod \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") "
Jul 20 20:00:40.597147 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.597134    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-dshm\") pod \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") "
Jul 20 20:00:40.597340 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.597169    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-home\") pod \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") "
Jul 20 20:00:40.597340 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.597221    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22q2k\" (UniqueName: \"kubernetes.io/projected/b0ee99ae-bdcf-45e8-8250-2beedca580ae-kube-api-access-22q2k\") pod \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\" (UID: \"b0ee99ae-bdcf-45e8-8250-2beedca580ae\") "
Jul 20 20:00:40.597340 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.597300    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b0ee99ae-bdcf-45e8-8250-2beedca580ae" (UID: "b0ee99ae-bdcf-45e8-8250-2beedca580ae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:00:40.597340 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.597313    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-model-cache" (OuterVolumeSpecName: "model-cache") pod "b0ee99ae-bdcf-45e8-8250-2beedca580ae" (UID: "b0ee99ae-bdcf-45e8-8250-2beedca580ae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:00:40.597552 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.597473    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-home" (OuterVolumeSpecName: "home") pod "b0ee99ae-bdcf-45e8-8250-2beedca580ae" (UID: "b0ee99ae-bdcf-45e8-8250-2beedca580ae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:00:40.597552 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.597500    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-tmp-dir\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:00:40.597552 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.597517    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-model-cache\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:00:40.599337 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.599317    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ee99ae-bdcf-45e8-8250-2beedca580ae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b0ee99ae-bdcf-45e8-8250-2beedca580ae" (UID: "b0ee99ae-bdcf-45e8-8250-2beedca580ae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:00:40.599421 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.599387    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ee99ae-bdcf-45e8-8250-2beedca580ae-kube-api-access-22q2k" (OuterVolumeSpecName: "kube-api-access-22q2k") pod "b0ee99ae-bdcf-45e8-8250-2beedca580ae" (UID: "b0ee99ae-bdcf-45e8-8250-2beedca580ae"). InnerVolumeSpecName "kube-api-access-22q2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:00:40.599474 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.599413    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-dshm" (OuterVolumeSpecName: "dshm") pod "b0ee99ae-bdcf-45e8-8250-2beedca580ae" (UID: "b0ee99ae-bdcf-45e8-8250-2beedca580ae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 20:00:40.698706 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.698667    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0ee99ae-bdcf-45e8-8250-2beedca580ae-tls-certs\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:00:40.698706 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.698698    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-dshm\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:00:40.698706 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.698709    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0ee99ae-bdcf-45e8-8250-2beedca580ae-home\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:00:40.698954 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.698720    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22q2k\" (UniqueName: \"kubernetes.io/projected/b0ee99ae-bdcf-45e8-8250-2beedca580ae-kube-api-access-22q2k\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:00:40.814320 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.814232    2581 generic.go:356] "Generic (PLEG): container finished" podID="b0ee99ae-bdcf-45e8-8250-2beedca580ae" containerID="55369285c83edeeaf13ae079281050cf03b4b4f7ce755f2390a2aecd1f20b2a2" exitCode=0
Jul 20 20:00:40.814320 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.814275    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"
Jul 20 20:00:40.814320 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.814309    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7" event={"ID":"b0ee99ae-bdcf-45e8-8250-2beedca580ae","Type":"ContainerDied","Data":"55369285c83edeeaf13ae079281050cf03b4b4f7ce755f2390a2aecd1f20b2a2"}
Jul 20 20:00:40.814576 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.814338    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7" event={"ID":"b0ee99ae-bdcf-45e8-8250-2beedca580ae","Type":"ContainerDied","Data":"200dfcf8105e1becd5590b4aac90660f4ab9a89ed63e09157ddfbdd914b94729"}
Jul 20 20:00:40.814576 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.814357    2581 scope.go:117] "RemoveContainer" containerID="55369285c83edeeaf13ae079281050cf03b4b4f7ce755f2390a2aecd1f20b2a2"
Jul 20 20:00:40.833422 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.833403    2581 scope.go:117] "RemoveContainer" containerID="55369285c83edeeaf13ae079281050cf03b4b4f7ce755f2390a2aecd1f20b2a2"
Jul 20 20:00:40.833822 ip-10-0-141-43 kubenswrapper[2581]: E0720 20:00:40.833802    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55369285c83edeeaf13ae079281050cf03b4b4f7ce755f2390a2aecd1f20b2a2\": container with ID starting with 55369285c83edeeaf13ae079281050cf03b4b4f7ce755f2390a2aecd1f20b2a2 not found: ID does not exist" containerID="55369285c83edeeaf13ae079281050cf03b4b4f7ce755f2390a2aecd1f20b2a2"
Jul 20 20:00:40.833876 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.833833    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55369285c83edeeaf13ae079281050cf03b4b4f7ce755f2390a2aecd1f20b2a2"} err="failed to get container status \"55369285c83edeeaf13ae079281050cf03b4b4f7ce755f2390a2aecd1f20b2a2\": rpc error: code = NotFound desc = could not find container \"55369285c83edeeaf13ae079281050cf03b4b4f7ce755f2390a2aecd1f20b2a2\": container with ID starting with 55369285c83edeeaf13ae079281050cf03b4b4f7ce755f2390a2aecd1f20b2a2 not found: ID does not exist"
Jul 20 20:00:40.841506 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.841480    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"]
Jul 20 20:00:40.845369 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:40.845344    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-710890/rate-test-model-710890-kserve-575fb678ff-tj9l7"]
Jul 20 20:00:41.979548 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:41.979515    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7415-139772282508320"]
Jul 20 20:00:41.980051 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:41.980032    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ee99ae-bdcf-45e8-8250-2beedca580ae" containerName="main"
Jul 20 20:00:41.980126 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:41.980055    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ee99ae-bdcf-45e8-8250-2beedca580ae" containerName="main"
Jul 20 20:00:41.980126 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:41.980088    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7522a17-b4ee-48c1-bf52-7070b8ebdfe1" containerName="test-curl-7415-139772282290368"
Jul 20 20:00:41.980126 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:41.980098    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7522a17-b4ee-48c1-bf52-7070b8ebdfe1" containerName="test-curl-7415-139772282290368"
Jul 20 20:00:41.980335 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:41.980201    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ee99ae-bdcf-45e8-8250-2beedca580ae" containerName="main"
Jul 20 20:00:41.980335 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:41.980217    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7522a17-b4ee-48c1-bf52-7070b8ebdfe1" containerName="test-curl-7415-139772282290368"
Jul 20 20:00:41.984456 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:41.984436    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282508320"
Jul 20 20:00:41.986799 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:41.986776    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rmpxm\""
Jul 20 20:00:41.989813 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:41.989783    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7415-139772282508320"]
Jul 20 20:00:42.110204 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:42.110149    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98bnm\" (UniqueName: \"kubernetes.io/projected/2814326b-02ad-4c32-8a45-60c055fc5866-kube-api-access-98bnm\") pod \"test-curl-7415-139772282508320\" (UID: \"2814326b-02ad-4c32-8a45-60c055fc5866\") " pod="opendatahub/test-curl-7415-139772282508320"
Jul 20 20:00:42.210804 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:42.210761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98bnm\" (UniqueName: \"kubernetes.io/projected/2814326b-02ad-4c32-8a45-60c055fc5866-kube-api-access-98bnm\") pod \"test-curl-7415-139772282508320\" (UID: \"2814326b-02ad-4c32-8a45-60c055fc5866\") " pod="opendatahub/test-curl-7415-139772282508320"
Jul 20 20:00:42.219513 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:42.219477    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98bnm\" (UniqueName: \"kubernetes.io/projected/2814326b-02ad-4c32-8a45-60c055fc5866-kube-api-access-98bnm\") pod \"test-curl-7415-139772282508320\" (UID: \"2814326b-02ad-4c32-8a45-60c055fc5866\") " pod="opendatahub/test-curl-7415-139772282508320"
Jul 20 20:00:42.266442 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:42.266366    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ee99ae-bdcf-45e8-8250-2beedca580ae" path="/var/lib/kubelet/pods/b0ee99ae-bdcf-45e8-8250-2beedca580ae/volumes"
Jul 20 20:00:42.294112 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:42.294083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282508320"
Jul 20 20:00:42.426813 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:42.426786    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7415-139772282508320"]
Jul 20 20:00:42.428598 ip-10-0-141-43 kubenswrapper[2581]: W0720 20:00:42.428569    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2814326b_02ad_4c32_8a45_60c055fc5866.slice/crio-ff20cb1cf9d6ff824c174d418f844e64ec7b1fe84248acdc842293456cb966d8 WatchSource:0}: Error finding container ff20cb1cf9d6ff824c174d418f844e64ec7b1fe84248acdc842293456cb966d8: Status 404 returned error can't find the container with id ff20cb1cf9d6ff824c174d418f844e64ec7b1fe84248acdc842293456cb966d8
Jul 20 20:00:42.828089 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:42.828052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7415-139772282508320" event={"ID":"2814326b-02ad-4c32-8a45-60c055fc5866","Type":"ContainerStarted","Data":"ff20cb1cf9d6ff824c174d418f844e64ec7b1fe84248acdc842293456cb966d8"}
Jul 20 20:00:43.834421 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:43.834389    2581 generic.go:356] "Generic (PLEG): container finished" podID="2814326b-02ad-4c32-8a45-60c055fc5866" containerID="6757e1477177504d0de36a5137c58a8495e556d1d640aa91f0d9326eb2506319" exitCode=0
Jul 20 20:00:43.834820 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:43.834430    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7415-139772282508320" event={"ID":"2814326b-02ad-4c32-8a45-60c055fc5866","Type":"ContainerDied","Data":"6757e1477177504d0de36a5137c58a8495e556d1d640aa91f0d9326eb2506319"}
Jul 20 20:00:44.980402 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:44.980379    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282508320"
Jul 20 20:00:45.000929 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.000900    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7415-139772282508320_2814326b-02ad-4c32-8a45-60c055fc5866/test-curl-7415-139772282508320/0.log"
Jul 20 20:00:45.026757 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.026727    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7415-139772282508320"]
Jul 20 20:00:45.028784 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.028764    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7415-139772282508320"]
Jul 20 20:00:45.136822 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.136739    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98bnm\" (UniqueName: \"kubernetes.io/projected/2814326b-02ad-4c32-8a45-60c055fc5866-kube-api-access-98bnm\") pod \"2814326b-02ad-4c32-8a45-60c055fc5866\" (UID: \"2814326b-02ad-4c32-8a45-60c055fc5866\") "
Jul 20 20:00:45.138910 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.138887    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2814326b-02ad-4c32-8a45-60c055fc5866-kube-api-access-98bnm" (OuterVolumeSpecName: "kube-api-access-98bnm") pod "2814326b-02ad-4c32-8a45-60c055fc5866" (UID: "2814326b-02ad-4c32-8a45-60c055fc5866"). InnerVolumeSpecName "kube-api-access-98bnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:00:45.212831 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.212792    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z"]
Jul 20 20:00:45.213151 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.213138    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2814326b-02ad-4c32-8a45-60c055fc5866" containerName="test-curl-7415-139772282508320"
Jul 20 20:00:45.213226 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.213152    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2814326b-02ad-4c32-8a45-60c055fc5866" containerName="test-curl-7415-139772282508320"
Jul 20 20:00:45.213266 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.213235    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2814326b-02ad-4c32-8a45-60c055fc5866" containerName="test-curl-7415-139772282508320"
Jul 20 20:00:45.216034 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.216019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z"
Jul 20 20:00:45.218497 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.218477    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\""
Jul 20 20:00:45.225805 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.225778    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z"]
Jul 20 20:00:45.238237 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.238213    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98bnm\" (UniqueName: \"kubernetes.io/projected/2814326b-02ad-4c32-8a45-60c055fc5866-kube-api-access-98bnm\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:00:45.339446 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.339404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee187854-3472-4f8e-b004-5ba941198c15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-710890-nsn2z\" (UID: \"ee187854-3472-4f8e-b004-5ba941198c15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z"
Jul 20 20:00:45.440959 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.440860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee187854-3472-4f8e-b004-5ba941198c15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-710890-nsn2z\" (UID: \"ee187854-3472-4f8e-b004-5ba941198c15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z"
Jul 20 20:00:45.441599 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.441572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee187854-3472-4f8e-b004-5ba941198c15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-710890-nsn2z\" (UID: \"ee187854-3472-4f8e-b004-5ba941198c15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z"
Jul 20 20:00:45.527408 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.527373    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z"
Jul 20 20:00:45.686107 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.686079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z"]
Jul 20 20:00:45.688176 ip-10-0-141-43 kubenswrapper[2581]: W0720 20:00:45.688140    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee187854_3472_4f8e_b004_5ba941198c15.slice/crio-056d4b6eb6ce742863d776609ed4690d980aeb96c8111bcb4314b5a26917018f WatchSource:0}: Error finding container 056d4b6eb6ce742863d776609ed4690d980aeb96c8111bcb4314b5a26917018f: Status 404 returned error can't find the container with id 056d4b6eb6ce742863d776609ed4690d980aeb96c8111bcb4314b5a26917018f
Jul 20 20:00:45.846055 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.846022    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7415-139772282508320"
Jul 20 20:00:45.846264 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.846061    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff20cb1cf9d6ff824c174d418f844e64ec7b1fe84248acdc842293456cb966d8"
Jul 20 20:00:45.847541 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.847503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z" event={"ID":"ee187854-3472-4f8e-b004-5ba941198c15","Type":"ContainerStarted","Data":"056d4b6eb6ce742863d776609ed4690d980aeb96c8111bcb4314b5a26917018f"}
Jul 20 20:00:45.871913 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.871889    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:45.874182 ip-10-0-141-43 kubenswrapper[2581]: E0720 20:00:45.874155    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7415-139772282508320\" is forbidden: User \"system:node:ip-10-0-141-43.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-43.ec2.internal' and this object" podUID="2814326b-02ad-4c32-8a45-60c055fc5866" pod="opendatahub/test-curl-7415-139772282508320"
Jul 20 20:00:45.970926 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:45.970895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:46.266140 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:46.266065    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2814326b-02ad-4c32-8a45-60c055fc5866" path="/var/lib/kubelet/pods/2814326b-02ad-4c32-8a45-60c055fc5866/volumes"
Jul 20 20:00:46.854005 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:46.853970    2581 generic.go:356] "Generic (PLEG): container finished" podID="ee187854-3472-4f8e-b004-5ba941198c15" containerID="db809435f2be8371b35fa85df9ed66bb5fd271d001674e3de0411a9ce1a8045d" exitCode=0
Jul 20 20:00:46.854157 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:46.854049    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z" event={"ID":"ee187854-3472-4f8e-b004-5ba941198c15","Type":"ContainerDied","Data":"db809435f2be8371b35fa85df9ed66bb5fd271d001674e3de0411a9ce1a8045d"}
Jul 20 20:00:47.989165 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:47.989144    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z"
Jul 20 20:00:48.164837 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:48.164745    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee187854-3472-4f8e-b004-5ba941198c15-maas-api-service-ca\") pod \"ee187854-3472-4f8e-b004-5ba941198c15\" (UID: \"ee187854-3472-4f8e-b004-5ba941198c15\") "
Jul 20 20:00:48.165081 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:48.165059    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee187854-3472-4f8e-b004-5ba941198c15-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ee187854-3472-4f8e-b004-5ba941198c15" (UID: "ee187854-3472-4f8e-b004-5ba941198c15"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:00:48.265949 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:48.265913    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee187854-3472-4f8e-b004-5ba941198c15-maas-api-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:00:48.865855 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:48.865827    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z"
Jul 20 20:00:48.865855 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:48.865836    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z" event={"ID":"ee187854-3472-4f8e-b004-5ba941198c15","Type":"ContainerDied","Data":"056d4b6eb6ce742863d776609ed4690d980aeb96c8111bcb4314b5a26917018f"}
Jul 20 20:00:48.866125 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:48.865882    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="056d4b6eb6ce742863d776609ed4690d980aeb96c8111bcb4314b5a26917018f"
Jul 20 20:00:55.875395 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:55.875361    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"]
Jul 20 20:00:55.875846 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:55.875574    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t" podUID="0171621d-8650-401e-84e2-b13bd9f57fa0" containerName="maas-api" containerID="cri-o://5924f9c65ed345b0a7b98137bcd23e80d77d757af3b815833db92658ac88da78" gracePeriod=30
Jul 20 20:00:56.122298 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.122271    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 20:00:56.145262 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.145125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:00:56.236947 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.236913    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0171621d-8650-401e-84e2-b13bd9f57fa0-openshift-service-ca\") pod \"0171621d-8650-401e-84e2-b13bd9f57fa0\" (UID: \"0171621d-8650-401e-84e2-b13bd9f57fa0\") "
Jul 20 20:00:56.237152 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.236987    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t42vs\" (UniqueName: \"kubernetes.io/projected/0171621d-8650-401e-84e2-b13bd9f57fa0-kube-api-access-t42vs\") pod \"0171621d-8650-401e-84e2-b13bd9f57fa0\" (UID: \"0171621d-8650-401e-84e2-b13bd9f57fa0\") "
Jul 20 20:00:56.237152 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.237091    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0171621d-8650-401e-84e2-b13bd9f57fa0-maas-api-tls\") pod \"0171621d-8650-401e-84e2-b13bd9f57fa0\" (UID: \"0171621d-8650-401e-84e2-b13bd9f57fa0\") "
Jul 20 20:00:56.237366 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.237330    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0171621d-8650-401e-84e2-b13bd9f57fa0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0171621d-8650-401e-84e2-b13bd9f57fa0" (UID: "0171621d-8650-401e-84e2-b13bd9f57fa0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:00:56.239242 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.239220    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0171621d-8650-401e-84e2-b13bd9f57fa0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0171621d-8650-401e-84e2-b13bd9f57fa0" (UID: "0171621d-8650-401e-84e2-b13bd9f57fa0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:00:56.239385 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.239363    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0171621d-8650-401e-84e2-b13bd9f57fa0-kube-api-access-t42vs" (OuterVolumeSpecName: "kube-api-access-t42vs") pod "0171621d-8650-401e-84e2-b13bd9f57fa0" (UID: "0171621d-8650-401e-84e2-b13bd9f57fa0"). InnerVolumeSpecName "kube-api-access-t42vs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:00:56.338589 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.338550    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0171621d-8650-401e-84e2-b13bd9f57fa0-maas-api-tls\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:00:56.338589 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.338580    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0171621d-8650-401e-84e2-b13bd9f57fa0-openshift-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:00:56.338589 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.338591    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t42vs\" (UniqueName: \"kubernetes.io/projected/0171621d-8650-401e-84e2-b13bd9f57fa0-kube-api-access-t42vs\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:00:56.906370 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.906333    2581 generic.go:356] "Generic (PLEG): container finished" podID="0171621d-8650-401e-84e2-b13bd9f57fa0" containerID="5924f9c65ed345b0a7b98137bcd23e80d77d757af3b815833db92658ac88da78" exitCode=0
Jul 20 20:00:56.906755 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.906387    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t" event={"ID":"0171621d-8650-401e-84e2-b13bd9f57fa0","Type":"ContainerDied","Data":"5924f9c65ed345b0a7b98137bcd23e80d77d757af3b815833db92658ac88da78"}
Jul 20 20:00:56.906755 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.906398    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"
Jul 20 20:00:56.906755 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.906451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t" event={"ID":"0171621d-8650-401e-84e2-b13bd9f57fa0","Type":"ContainerDied","Data":"55241e1899ce77f22d1e9b90591e1cdf5cd9c884fa0b188a2a103a2a5e4a8cdd"}
Jul 20 20:00:56.906755 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.906472    2581 scope.go:117] "RemoveContainer" containerID="5924f9c65ed345b0a7b98137bcd23e80d77d757af3b815833db92658ac88da78"
Jul 20 20:00:56.915353 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.915331    2581 scope.go:117] "RemoveContainer" containerID="5924f9c65ed345b0a7b98137bcd23e80d77d757af3b815833db92658ac88da78"
Jul 20 20:00:56.915619 ip-10-0-141-43 kubenswrapper[2581]: E0720 20:00:56.915601    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5924f9c65ed345b0a7b98137bcd23e80d77d757af3b815833db92658ac88da78\": container with ID starting with 5924f9c65ed345b0a7b98137bcd23e80d77d757af3b815833db92658ac88da78 not found: ID does not exist" containerID="5924f9c65ed345b0a7b98137bcd23e80d77d757af3b815833db92658ac88da78"
Jul 20 20:00:56.915680 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.915631    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5924f9c65ed345b0a7b98137bcd23e80d77d757af3b815833db92658ac88da78"} err="failed to get container status \"5924f9c65ed345b0a7b98137bcd23e80d77d757af3b815833db92658ac88da78\": rpc error: code = NotFound desc = could not find container \"5924f9c65ed345b0a7b98137bcd23e80d77d757af3b815833db92658ac88da78\": container with ID starting with 5924f9c65ed345b0a7b98137bcd23e80d77d757af3b815833db92658ac88da78 not found: ID does not exist"
Jul 20 20:00:56.922710 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.922685    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"]
Jul 20 20:00:56.924978 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:56.924954    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-710890-779f74c447-hwr9t"]
Jul 20 20:00:58.266064 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:58.266027    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0171621d-8650-401e-84e2-b13bd9f57fa0" path="/var/lib/kubelet/pods/0171621d-8650-401e-84e2-b13bd9f57fa0/volumes"
Jul 20 20:00:59.185180 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:00:59.185144    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 20:01:00.321509 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:00.321476    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:00.329786 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:00.329748    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z"]
Jul 20 20:01:00.333881 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:00.333853    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-710890-nsn2z"]
Jul 20 20:01:00.737114 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:00.737080    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:02.266386 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:02.266352    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee187854-3472-4f8e-b004-5ba941198c15" path="/var/lib/kubelet/pods/ee187854-3472-4f8e-b004-5ba941198c15/volumes"
Jul 20 20:01:06.977341 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:06.977306    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:07.109923 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.109888    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:07.350693 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.350659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:07.560334 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.560300    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:07.659719 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.659639    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9"]
Jul 20 20:01:07.659953 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.659942    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0171621d-8650-401e-84e2-b13bd9f57fa0" containerName="maas-api"
Jul 20 20:01:07.659995 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.659955    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0171621d-8650-401e-84e2-b13bd9f57fa0" containerName="maas-api"
Jul 20 20:01:07.659995 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.659969    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee187854-3472-4f8e-b004-5ba941198c15" containerName="revoke-keys"
Jul 20 20:01:07.659995 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.659975    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee187854-3472-4f8e-b004-5ba941198c15" containerName="revoke-keys"
Jul 20 20:01:07.660092 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.660030    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee187854-3472-4f8e-b004-5ba941198c15" containerName="revoke-keys"
Jul 20 20:01:07.660092 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.660043    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0171621d-8650-401e-84e2-b13bd9f57fa0" containerName="maas-api"
Jul 20 20:01:07.663008 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.662993    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9"
Jul 20 20:01:07.665476 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.665460    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xf9r\""
Jul 20 20:01:07.685171 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.685147    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9"]
Jul 20 20:01:07.725653 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.725619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5819a36-e881-411f-997c-976f95b41a4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9\" (UID: \"b5819a36-e881-411f-997c-976f95b41a4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9"
Jul 20 20:01:07.826765 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.826724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5819a36-e881-411f-997c-976f95b41a4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9\" (UID: \"b5819a36-e881-411f-997c-976f95b41a4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9"
Jul 20 20:01:07.827393 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.827374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5819a36-e881-411f-997c-976f95b41a4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9\" (UID: \"b5819a36-e881-411f-997c-976f95b41a4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9"
Jul 20 20:01:07.972875 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:07.972796    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9"
Jul 20 20:01:08.110394 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:08.110366    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9"]
Jul 20 20:01:08.112262 ip-10-0-141-43 kubenswrapper[2581]: W0720 20:01:08.112236    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5819a36_e881_411f_997c_976f95b41a4c.slice/crio-2989da4d13f35703dbb47cc55e8f5860d26056325511c575e3257d8cd0190fc1 WatchSource:0}: Error finding container 2989da4d13f35703dbb47cc55e8f5860d26056325511c575e3257d8cd0190fc1: Status 404 returned error can't find the container with id 2989da4d13f35703dbb47cc55e8f5860d26056325511c575e3257d8cd0190fc1
Jul 20 20:01:08.219237 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:08.219178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:08.319422 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:08.319337    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:08.972619 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:08.972581    2581 generic.go:356] "Generic (PLEG): container finished" podID="b5819a36-e881-411f-997c-976f95b41a4c" containerID="ab265eab4e4340bc594b09f1f457a5c544f96367fe7a0a06e4193800ed9bf9b7" exitCode=0
Jul 20 20:01:08.972810 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:08.972671    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9" event={"ID":"b5819a36-e881-411f-997c-976f95b41a4c","Type":"ContainerDied","Data":"ab265eab4e4340bc594b09f1f457a5c544f96367fe7a0a06e4193800ed9bf9b7"}
Jul 20 20:01:08.972810 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:08.972724    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9" event={"ID":"b5819a36-e881-411f-997c-976f95b41a4c","Type":"ContainerStarted","Data":"2989da4d13f35703dbb47cc55e8f5860d26056325511c575e3257d8cd0190fc1"}
Jul 20 20:01:10.105819 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:10.105796    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9"
Jul 20 20:01:10.145931 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:10.145880    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5819a36-e881-411f-997c-976f95b41a4c-maas-api-service-ca\") pod \"b5819a36-e881-411f-997c-976f95b41a4c\" (UID: \"b5819a36-e881-411f-997c-976f95b41a4c\") "
Jul 20 20:01:10.146254 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:10.146233    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5819a36-e881-411f-997c-976f95b41a4c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b5819a36-e881-411f-997c-976f95b41a4c" (UID: "b5819a36-e881-411f-997c-976f95b41a4c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:01:10.247550 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:10.247450    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5819a36-e881-411f-997c-976f95b41a4c-maas-api-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:01:10.983674 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:10.983643    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9"
Jul 20 20:01:10.983878 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:10.983675    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9" event={"ID":"b5819a36-e881-411f-997c-976f95b41a4c","Type":"ContainerDied","Data":"2989da4d13f35703dbb47cc55e8f5860d26056325511c575e3257d8cd0190fc1"}
Jul 20 20:01:10.983878 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:10.983715    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2989da4d13f35703dbb47cc55e8f5860d26056325511c575e3257d8cd0190fc1"
Jul 20 20:01:18.126204 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.126152    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"]
Jul 20 20:01:18.126614 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.126408    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2" podUID="967b45f9-7c85-4802-b996-b7051de0ac11" containerName="maas-api" containerID="cri-o://b322fff1b848517eb525499ee2bcae33a7c7ec50b08149e5244151b4f37bf8c3" gracePeriod=30
Jul 20 20:01:18.152603 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.152577    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz"]
Jul 20 20:01:18.156839 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.156817    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-01f2d8-29742960-8twnz"]
Jul 20 20:01:18.158877 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.158857    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:18.266796 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.266668    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85d5c6bd-2f25-493d-9051-f961e15b3e7b" path="/var/lib/kubelet/pods/85d5c6bd-2f25-493d-9051-f961e15b3e7b/volumes"
Jul 20 20:01:18.377717 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.377659    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 20:01:18.414611 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.414584    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967b45f9-7c85-4802-b996-b7051de0ac11-maas-api-tls\") pod \"967b45f9-7c85-4802-b996-b7051de0ac11\" (UID: \"967b45f9-7c85-4802-b996-b7051de0ac11\") "
Jul 20 20:01:18.414778 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.414683    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967b45f9-7c85-4802-b996-b7051de0ac11-openshift-service-ca\") pod \"967b45f9-7c85-4802-b996-b7051de0ac11\" (UID: \"967b45f9-7c85-4802-b996-b7051de0ac11\") "
Jul 20 20:01:18.414778 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.414721    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5dzz\" (UniqueName: \"kubernetes.io/projected/967b45f9-7c85-4802-b996-b7051de0ac11-kube-api-access-j5dzz\") pod \"967b45f9-7c85-4802-b996-b7051de0ac11\" (UID: \"967b45f9-7c85-4802-b996-b7051de0ac11\") "
Jul 20 20:01:18.415063 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.415041    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/967b45f9-7c85-4802-b996-b7051de0ac11-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "967b45f9-7c85-4802-b996-b7051de0ac11" (UID: "967b45f9-7c85-4802-b996-b7051de0ac11"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 20:01:18.416780 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.416757    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/967b45f9-7c85-4802-b996-b7051de0ac11-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "967b45f9-7c85-4802-b996-b7051de0ac11" (UID: "967b45f9-7c85-4802-b996-b7051de0ac11"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 20:01:18.416926 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.416901    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/967b45f9-7c85-4802-b996-b7051de0ac11-kube-api-access-j5dzz" (OuterVolumeSpecName: "kube-api-access-j5dzz") pod "967b45f9-7c85-4802-b996-b7051de0ac11" (UID: "967b45f9-7c85-4802-b996-b7051de0ac11"). InnerVolumeSpecName "kube-api-access-j5dzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 20:01:18.515760 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.515721    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967b45f9-7c85-4802-b996-b7051de0ac11-maas-api-tls\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:01:18.515760 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.515751    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967b45f9-7c85-4802-b996-b7051de0ac11-openshift-service-ca\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:01:18.515760 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:18.515762    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5dzz\" (UniqueName: \"kubernetes.io/projected/967b45f9-7c85-4802-b996-b7051de0ac11-kube-api-access-j5dzz\") on node \"ip-10-0-141-43.ec2.internal\" DevicePath \"\""
Jul 20 20:01:19.023247 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:19.023182    2581 generic.go:356] "Generic (PLEG): container finished" podID="967b45f9-7c85-4802-b996-b7051de0ac11" containerID="b322fff1b848517eb525499ee2bcae33a7c7ec50b08149e5244151b4f37bf8c3" exitCode=0
Jul 20 20:01:19.023400 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:19.023260    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"
Jul 20 20:01:19.023400 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:19.023288    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2" event={"ID":"967b45f9-7c85-4802-b996-b7051de0ac11","Type":"ContainerDied","Data":"b322fff1b848517eb525499ee2bcae33a7c7ec50b08149e5244151b4f37bf8c3"}
Jul 20 20:01:19.023400 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:19.023377    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2" event={"ID":"967b45f9-7c85-4802-b996-b7051de0ac11","Type":"ContainerDied","Data":"c4ac417990f74041d95dc9b00c25e0a55b6f620272ab25b352dc60de238960e9"}
Jul 20 20:01:19.023525 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:19.023404    2581 scope.go:117] "RemoveContainer" containerID="b322fff1b848517eb525499ee2bcae33a7c7ec50b08149e5244151b4f37bf8c3"
Jul 20 20:01:19.032849 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:19.032828    2581 scope.go:117] "RemoveContainer" containerID="b322fff1b848517eb525499ee2bcae33a7c7ec50b08149e5244151b4f37bf8c3"
Jul 20 20:01:19.033098 ip-10-0-141-43 kubenswrapper[2581]: E0720 20:01:19.033076    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b322fff1b848517eb525499ee2bcae33a7c7ec50b08149e5244151b4f37bf8c3\": container with ID starting with b322fff1b848517eb525499ee2bcae33a7c7ec50b08149e5244151b4f37bf8c3 not found: ID does not exist" containerID="b322fff1b848517eb525499ee2bcae33a7c7ec50b08149e5244151b4f37bf8c3"
Jul 20 20:01:19.033171 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:19.033105    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b322fff1b848517eb525499ee2bcae33a7c7ec50b08149e5244151b4f37bf8c3"} err="failed to get container status \"b322fff1b848517eb525499ee2bcae33a7c7ec50b08149e5244151b4f37bf8c3\": rpc error: code = NotFound desc = could not find container \"b322fff1b848517eb525499ee2bcae33a7c7ec50b08149e5244151b4f37bf8c3\": container with ID starting with b322fff1b848517eb525499ee2bcae33a7c7ec50b08149e5244151b4f37bf8c3 not found: ID does not exist"
Jul 20 20:01:19.044310 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:19.044287    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"]
Jul 20 20:01:19.048338 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:19.048302    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-01f2d8-578fbb7794-ccfq2"]
Jul 20 20:01:20.266485 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:20.266446    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="967b45f9-7c85-4802-b996-b7051de0ac11" path="/var/lib/kubelet/pods/967b45f9-7c85-4802-b996-b7051de0ac11/volumes"
Jul 20 20:01:21.185285 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:21.185253    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vg88v"]
Jul 20 20:01:22.738424 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:22.738358    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9"]
Jul 20 20:01:22.740707 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:22.740676    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-01f2d8-r5kw9"]
Jul 20 20:01:23.162393 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:23.162359    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:23.645537 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:23.645503    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:24.265178 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:24.265146    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5819a36-e881-411f-997c-976f95b41a4c" path="/var/lib/kubelet/pods/b5819a36-e881-411f-997c-976f95b41a4c/volumes"
Jul 20 20:01:27.056443 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:27.056408    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:29.189121 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:29.189088    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:29.334657 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:29.334621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:29.467702 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:29.467628    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:29.677524 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:29.677495    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:33.557165 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:33.557126    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:33.632837 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:33.632793    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:35.517858 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:35.517780    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gn9q9_fb9caa89-cbe8-4189-84c1-1ae0ec7597f5/manager/0.log"
Jul 20 20:01:36.224031 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:36.224005    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8569dc75f9-kjghb_9f14b95b-decb-4950-9126-ea19535eec93/copy-manifests/0.log"
Jul 20 20:01:36.230026 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:36.230002    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8569dc75f9-kjghb_9f14b95b-decb-4950-9126-ea19535eec93/manager/0.log"
Jul 20 20:01:36.910650 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:36.910620    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742945-8z2zg_b8c7cf9b-30d5-4187-87dc-c608e0d2a601/cleanup/0.log"
Jul 20 20:01:37.875918 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:37.875885    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747_547beb18-0f38-46d6-a994-a5570edce61a/util/0.log"
Jul 20 20:01:37.882252 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:37.882229    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747_547beb18-0f38-46d6-a994-a5570edce61a/pull/0.log"
Jul 20 20:01:37.888314 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:37.888295    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747_547beb18-0f38-46d6-a994-a5570edce61a/extract/0.log"
Jul 20 20:01:37.995125 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:37.995096    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967_d5c90583-595f-4e5d-85c2-01549d3765cd/util/0.log"
Jul 20 20:01:38.001042 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:38.001020    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967_d5c90583-595f-4e5d-85c2-01549d3765cd/pull/0.log"
Jul 20 20:01:38.006566 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:38.006548    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967_d5c90583-595f-4e5d-85c2-01549d3765cd/extract/0.log"
Jul 20 20:01:38.121905 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:38.121873    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss_bb544841-fb4d-4608-9957-839b920023d1/util/0.log"
Jul 20 20:01:38.127853 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:38.127788    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss_bb544841-fb4d-4608-9957-839b920023d1/pull/0.log"
Jul 20 20:01:38.135247 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:38.135225    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss_bb544841-fb4d-4608-9957-839b920023d1/extract/0.log"
Jul 20 20:01:38.242527 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:38.242494    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd_21337ad5-34c7-4212-851c-a6d141caee6e/util/0.log"
Jul 20 20:01:38.248828 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:38.248806    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd_21337ad5-34c7-4212-851c-a6d141caee6e/pull/0.log"
Jul 20 20:01:38.254966 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:38.254950    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd_21337ad5-34c7-4212-851c-a6d141caee6e/extract/0.log"
Jul 20 20:01:39.058490 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:39.058461    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vg88v_172b7df5-5721-4576-bf97-8433d22e0e2f/limitador/0.log"
Jul 20 20:01:39.630806 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:39.630777    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kmp7m_2e47ff2e-e614-4721-9811-a33b8057690d/discovery/0.log"
Jul 20 20:01:41.087583 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:41.087552    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-x8l8x_61f59870-ec1c-4dfd-b9fe-8519e119cb1e/main/0.log"
Jul 20 20:01:47.060686 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.060648    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hzf79/must-gather-tf4p9"]
Jul 20 20:01:47.061058 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.060978    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="967b45f9-7c85-4802-b996-b7051de0ac11" containerName="maas-api"
Jul 20 20:01:47.061058 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.060989    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="967b45f9-7c85-4802-b996-b7051de0ac11" containerName="maas-api"
Jul 20 20:01:47.061058 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.060999    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5819a36-e881-411f-997c-976f95b41a4c" containerName="revoke-keys"
Jul 20 20:01:47.061058 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.061005    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5819a36-e881-411f-997c-976f95b41a4c" containerName="revoke-keys"
Jul 20 20:01:47.061218 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.061061    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5819a36-e881-411f-997c-976f95b41a4c" containerName="revoke-keys"
Jul 20 20:01:47.061218 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.061069    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="967b45f9-7c85-4802-b996-b7051de0ac11" containerName="maas-api"
Jul 20 20:01:47.065276 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.065256    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hzf79/must-gather-tf4p9"
Jul 20 20:01:47.067870 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.067850    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hzf79\"/\"default-dockercfg-ghgxr\""
Jul 20 20:01:47.068092 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.068074    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hzf79\"/\"kube-root-ca.crt\""
Jul 20 20:01:47.068448 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.068434    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hzf79\"/\"openshift-service-ca.crt\""
Jul 20 20:01:47.081343 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.081321    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hzf79/must-gather-tf4p9"]
Jul 20 20:01:47.083732 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.083707    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:47.159218 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.159160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r88ws\" (UniqueName: \"kubernetes.io/projected/4a82164c-53c5-4ec3-9c2a-2e711d2e19b0-kube-api-access-r88ws\") pod \"must-gather-tf4p9\" (UID: \"4a82164c-53c5-4ec3-9c2a-2e711d2e19b0\") " pod="openshift-must-gather-hzf79/must-gather-tf4p9"
Jul 20 20:01:47.159400 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.159281    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a82164c-53c5-4ec3-9c2a-2e711d2e19b0-must-gather-output\") pod \"must-gather-tf4p9\" (UID: \"4a82164c-53c5-4ec3-9c2a-2e711d2e19b0\") " pod="openshift-must-gather-hzf79/must-gather-tf4p9"
Jul 20 20:01:47.249504 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.249466    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log" limit=1024
Jul 20 20:01:47.260612 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.260587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r88ws\" (UniqueName: \"kubernetes.io/projected/4a82164c-53c5-4ec3-9c2a-2e711d2e19b0-kube-api-access-r88ws\") pod \"must-gather-tf4p9\" (UID: \"4a82164c-53c5-4ec3-9c2a-2e711d2e19b0\") " pod="openshift-must-gather-hzf79/must-gather-tf4p9"
Jul 20 20:01:47.260721 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.260657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a82164c-53c5-4ec3-9c2a-2e711d2e19b0-must-gather-output\") pod \"must-gather-tf4p9\" (UID: \"4a82164c-53c5-4ec3-9c2a-2e711d2e19b0\") " pod="openshift-must-gather-hzf79/must-gather-tf4p9"
Jul 20 20:01:47.260999 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.260979    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a82164c-53c5-4ec3-9c2a-2e711d2e19b0-must-gather-output\") pod \"must-gather-tf4p9\" (UID: \"4a82164c-53c5-4ec3-9c2a-2e711d2e19b0\") " pod="openshift-must-gather-hzf79/must-gather-tf4p9"
Jul 20 20:01:47.277499 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.277469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r88ws\" (UniqueName: \"kubernetes.io/projected/4a82164c-53c5-4ec3-9c2a-2e711d2e19b0-kube-api-access-r88ws\") pod \"must-gather-tf4p9\" (UID: \"4a82164c-53c5-4ec3-9c2a-2e711d2e19b0\") " pod="openshift-must-gather-hzf79/must-gather-tf4p9"
Jul 20 20:01:47.374088 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.374047    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hzf79/must-gather-tf4p9"
Jul 20 20:01:47.525163 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:47.525138    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hzf79/must-gather-tf4p9"]
Jul 20 20:01:47.527144 ip-10-0-141-43 kubenswrapper[2581]: W0720 20:01:47.527112    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a82164c_53c5_4ec3_9c2a_2e711d2e19b0.slice/crio-432e922142d5a6bed9134f56f0b8881c544045ff25072a0ffcff2feaf20ebbc0 WatchSource:0}: Error finding container 432e922142d5a6bed9134f56f0b8881c544045ff25072a0ffcff2feaf20ebbc0: Status 404 returned error can't find the container with id 432e922142d5a6bed9134f56f0b8881c544045ff25072a0ffcff2feaf20ebbc0
Jul 20 20:01:48.170523 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:48.170481    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hzf79/must-gather-tf4p9" event={"ID":"4a82164c-53c5-4ec3-9c2a-2e711d2e19b0","Type":"ContainerStarted","Data":"432e922142d5a6bed9134f56f0b8881c544045ff25072a0ffcff2feaf20ebbc0"}
Jul 20 20:01:49.180534 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:49.180491    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hzf79/must-gather-tf4p9" event={"ID":"4a82164c-53c5-4ec3-9c2a-2e711d2e19b0","Type":"ContainerStarted","Data":"85ab7c76dfa81bccf41eecab5afca291e0a64ce861272f1c17fd3365ab78c166"}
Jul 20 20:01:50.190123 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:50.190087    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hzf79/must-gather-tf4p9" event={"ID":"4a82164c-53c5-4ec3-9c2a-2e711d2e19b0","Type":"ContainerStarted","Data":"b78a18695877c8bd77c9093402b8a424bd0709a5ed21064650fa00f691c40ffd"}
Jul 20 20:01:50.207434 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:50.207382    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hzf79/must-gather-tf4p9" podStartSLOduration=1.731901771 podStartE2EDuration="3.207362953s" totalImagesPullingTime="1.475461182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 20:01:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:01:50.206761902 +0000 UTC m=+2796.430389084" watchObservedRunningTime="2026-07-20 20:01:50.207362953 +0000 UTC m=+2796.430990133"
Jul 20 20:01:50.841746 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:50.841716    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l67tj_b1d98b95-11d0-422d-bccf-6284f813cd9b/global-pull-secret-syncer/0.log"
Jul 20 20:01:51.104447 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:51.104371    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gwcjd_1781dbad-3d0b-49da-bac6-368ad5e817f9/konnectivity-agent/0.log"
Jul 20 20:01:51.317374 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:51.317345    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-43.ec2.internal_de8985a0299f61e88b78af4c7e64a175/haproxy/0.log"
Jul 20 20:01:55.691178 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:55.691143    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747_547beb18-0f38-46d6-a994-a5570edce61a/extract/0.log"
Jul 20 20:01:55.750327 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:55.750208    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747_547beb18-0f38-46d6-a994-a5570edce61a/util/0.log"
Jul 20 20:01:55.801520 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:55.801491    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tn747_547beb18-0f38-46d6-a994-a5570edce61a/pull/0.log"
Jul 20 20:01:55.859321 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:55.859289    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967_d5c90583-595f-4e5d-85c2-01549d3765cd/extract/0.log"
Jul 20 20:01:55.907010 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:55.906981    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967_d5c90583-595f-4e5d-85c2-01549d3765cd/util/0.log"
Jul 20 20:01:55.973937 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:55.973848    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p9967_d5c90583-595f-4e5d-85c2-01549d3765cd/pull/0.log"
Jul 20 20:01:56.048606 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:56.048567    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss_bb544841-fb4d-4608-9957-839b920023d1/extract/0.log"
Jul 20 20:01:56.091562 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:56.091520    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss_bb544841-fb4d-4608-9957-839b920023d1/util/0.log"
Jul 20 20:01:56.159893 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:56.159860    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q7wss_bb544841-fb4d-4608-9957-839b920023d1/pull/0.log"
Jul 20 20:01:56.238130 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:56.238049    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd_21337ad5-34c7-4212-851c-a6d141caee6e/extract/0.log"
Jul 20 20:01:56.316968 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:56.316934    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd_21337ad5-34c7-4212-851c-a6d141caee6e/util/0.log"
Jul 20 20:01:56.403852 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:56.403822    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ff5gd_21337ad5-34c7-4212-851c-a6d141caee6e/pull/0.log"
Jul 20 20:01:57.530772 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:57.530731    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vg88v_172b7df5-5721-4576-bf97-8433d22e0e2f/limitador/0.log"
Jul 20 20:01:59.651050 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:59.651021    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6cd546b44f-jh9gp_1606d028-d95c-4a28-a562-26e4072af18f/metrics-server/0.log"
Jul 20 20:01:59.707033 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:59.706992    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-528xt_986328c7-1a7b-467c-923d-6095f1f57a65/monitoring-plugin/0.log"
Jul 20 20:01:59.953408 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:59.953319    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xb9s8_4502df8c-6ebb-42e2-b2b8-4547b268c103/node-exporter/0.log"
Jul 20 20:01:59.987149 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:01:59.987125    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xb9s8_4502df8c-6ebb-42e2-b2b8-4547b268c103/kube-rbac-proxy/0.log"
Jul 20 20:02:00.019456 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.019425    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xb9s8_4502df8c-6ebb-42e2-b2b8-4547b268c103/init-textfile/0.log"
Jul 20 20:02:00.066908 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.066880    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-mmjjn_6875ac4a-cad6-4a63-828f-e13e42521ece/kube-rbac-proxy-main/0.log"
Jul 20 20:02:00.132066 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.132037    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-mmjjn_6875ac4a-cad6-4a63-828f-e13e42521ece/kube-rbac-proxy-self/0.log"
Jul 20 20:02:00.192711 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.192675    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-mmjjn_6875ac4a-cad6-4a63-828f-e13e42521ece/openshift-state-metrics/0.log"
Jul 20 20:02:00.737779 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.737745    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c66784696-jfbzn_fb59c2b9-0af7-4146-b058-89f47891c478/telemeter-client/0.log"
Jul 20 20:02:00.793269 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.793236    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"]
Jul 20 20:02:00.797537 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.797506    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:00.826150 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.826127    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c66784696-jfbzn_fb59c2b9-0af7-4146-b058-89f47891c478/reload/0.log"
Jul 20 20:02:00.826397 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.826376    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"]
Jul 20 20:02:00.897337 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.897300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9979\" (UniqueName: \"kubernetes.io/projected/95b1c25f-d542-46bc-9285-c48537d75045-kube-api-access-d9979\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:00.898493 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.898465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95b1c25f-d542-46bc-9285-c48537d75045-proc\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:00.898821 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.898789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b1c25f-d542-46bc-9285-c48537d75045-sys\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:00.898967 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.898847    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95b1c25f-d542-46bc-9285-c48537d75045-podres\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:00.898967 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.898885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95b1c25f-d542-46bc-9285-c48537d75045-lib-modules\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:00.898967 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.898939    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c66784696-jfbzn_fb59c2b9-0af7-4146-b058-89f47891c478/kube-rbac-proxy/0.log"
Jul 20 20:02:00.999994 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.999897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b1c25f-d542-46bc-9285-c48537d75045-sys\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:00.999994 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.999940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95b1c25f-d542-46bc-9285-c48537d75045-podres\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:00.999994 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:00.999960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95b1c25f-d542-46bc-9285-c48537d75045-lib-modules\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:01.000285 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:01.000000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9979\" (UniqueName: \"kubernetes.io/projected/95b1c25f-d542-46bc-9285-c48537d75045-kube-api-access-d9979\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:01.000285 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:01.000038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95b1c25f-d542-46bc-9285-c48537d75045-proc\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:01.000285 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:01.000039    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b1c25f-d542-46bc-9285-c48537d75045-sys\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:01.000285 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:01.000081    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95b1c25f-d542-46bc-9285-c48537d75045-podres\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:01.000285 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:01.000112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95b1c25f-d542-46bc-9285-c48537d75045-proc\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:01.000285 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:01.000117    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95b1c25f-d542-46bc-9285-c48537d75045-lib-modules\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:01.014847 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:01.014808    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9979\" (UniqueName: \"kubernetes.io/projected/95b1c25f-d542-46bc-9285-c48537d75045-kube-api-access-d9979\") pod \"perf-node-gather-daemonset-27gwn\" (UID: \"95b1c25f-d542-46bc-9285-c48537d75045\") " pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:01.107955 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:01.107920    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:01.297177 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:01.297143    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"]
Jul 20 20:02:01.300865 ip-10-0-141-43 kubenswrapper[2581]: W0720 20:02:01.300833    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod95b1c25f_d542_46bc_9285_c48537d75045.slice/crio-b500f2dd7df8ea832f076e2aa54bf8d618bd15c62736ca2940cef9c419a29c08 WatchSource:0}: Error finding container b500f2dd7df8ea832f076e2aa54bf8d618bd15c62736ca2940cef9c419a29c08: Status 404 returned error can't find the container with id b500f2dd7df8ea832f076e2aa54bf8d618bd15c62736ca2940cef9c419a29c08
Jul 20 20:02:02.287284 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:02.287238    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn" event={"ID":"95b1c25f-d542-46bc-9285-c48537d75045","Type":"ContainerStarted","Data":"3d0831b5358c3daecf76b214d3a5af89a80ac448030dedc13e1f6401ef82ac59"}
Jul 20 20:02:02.287735 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:02.287310    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn" event={"ID":"95b1c25f-d542-46bc-9285-c48537d75045","Type":"ContainerStarted","Data":"b500f2dd7df8ea832f076e2aa54bf8d618bd15c62736ca2940cef9c419a29c08"}
Jul 20 20:02:02.288113 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:02.288090    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:02.318622 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:02.318552    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn" podStartSLOduration=2.318526724 podStartE2EDuration="2.318526724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 20:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 20:02:02.316587568 +0000 UTC m=+2808.540214750" watchObservedRunningTime="2026-07-20 20:02:02.318526724 +0000 UTC m=+2808.542153886"
Jul 20 20:02:03.728243 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:03.728215    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b5d977b76-pgtc6_3d6729cf-493a-4084-a884-319efb717deb/console/0.log"
Jul 20 20:02:03.773171 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:03.773138    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-2pp2d_ede9f43b-32a6-4be2-8ce8-33dc87dc1760/download-server/0.log"
Jul 20 20:02:05.892945 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:05.892906    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gdb6x_89836d7f-263d-4464-b3dd-adb73febcdb1/dns/0.log"
Jul 20 20:02:05.968035 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:05.968011    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gdb6x_89836d7f-263d-4464-b3dd-adb73febcdb1/kube-rbac-proxy/0.log"
Jul 20 20:02:06.098479 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:06.098455    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tl872_7b874fd5-c689-4333-8dec-c1501ff9086d/dns-node-resolver/0.log"
Jul 20 20:02:06.945088 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:06.945058    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-d6c89bd89-nb7qk_19ba474b-7ca5-4f03-a6a6-b763a9921078/registry/0.log"
Jul 20 20:02:07.113439 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:07.113409    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mb7g9_b4b0b496-eaaa-4d90-8aac-a3c5fa796ac8/node-ca/0.log"
Jul 20 20:02:08.599368 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:08.599310    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kmp7m_2e47ff2e-e614-4721-9811-a33b8057690d/discovery/0.log"
Jul 20 20:02:09.314983 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:09.314959    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hzf79/perf-node-gather-daemonset-27gwn"
Jul 20 20:02:09.684697 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:09.684664    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8zss7_84194694-3e25-4fb9-97f4-39954b7b4467/serve-healthcheck-canary/0.log"
Jul 20 20:02:10.483250 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:10.483222    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4kbnh_a334e128-8982-4c51-890c-007e171f8c6e/kube-rbac-proxy/0.log"
Jul 20 20:02:10.532904 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:10.532879    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4kbnh_a334e128-8982-4c51-890c-007e171f8c6e/exporter/0.log"
Jul 20 20:02:10.599733 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:10.599702    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4kbnh_a334e128-8982-4c51-890c-007e171f8c6e/extractor/0.log"
Jul 20 20:02:11.642788 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:11.642743    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kmp7m_2e47ff2e-e614-4721-9811-a33b8057690d/discovery/0.log"
Jul 20 20:02:13.180564 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:13.180525    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kmp7m_2e47ff2e-e614-4721-9811-a33b8057690d/discovery/0.log"
Jul 20 20:02:13.609134 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:13.609105    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gn9q9_fb9caa89-cbe8-4189-84c1-1ae0ec7597f5/manager/0.log"
Jul 20 20:02:14.319867 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:14.319828    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8569dc75f9-kjghb_9f14b95b-decb-4950-9126-ea19535eec93/manager/0.log"
Jul 20 20:02:14.353624 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:14.353598    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8569dc75f9-kjghb_9f14b95b-decb-4950-9126-ea19535eec93/copy-manifests/0.log"
Jul 20 20:02:15.633551 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:15.633523    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-554c775d9-sq7wm_a636f934-b07d-4290-acbb-f7bba984224f/manager/0.log"
Jul 20 20:02:15.739381 ip-10-0-141-43 kubenswrapper[2581]: I0720 20:02:15.739353    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dhxbp_480db2ea-0271-49ff-9c19-4fc50f9e8e38/openshift-lws-operator/0.log"