Jul 02 19:49:07.996687 ip-10-0-130-14 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 02 19:49:07.996702 ip-10-0-130-14 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 02 19:49:07.996713 ip-10-0-130-14 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 02 19:49:07.997129 ip-10-0-130-14 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 02 19:49:18.189057 ip-10-0-130-14 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 02 19:49:18.189080 ip-10-0-130-14 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 98aa61ea5dc145828ab670eb012f3d5b --
Jul 02 19:50:55.513667 ip-10-0-130-14 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.954829    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960585    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960601    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960604    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960609    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960612    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960614    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960617    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:50:56.038878 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960620    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:50:56.025220 ip-10-0-130-14 systemd[1]: Started Kubernetes Kubelet.
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960624    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960627    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960638    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960641    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960644    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960646    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960650    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960652    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960655    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960657    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960660    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960663    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960666    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960669    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960672    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960675    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960678    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960681    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960683    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:50:56.054531 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960686    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960689    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960691    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960694    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960696    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960700    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960703    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960706    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960708    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960711    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960714    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960716    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960719    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960721    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960724    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960727    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960735    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960738    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960740    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960743    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:50:56.057223 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960745    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960748    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960750    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960753    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960755    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960758    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960761    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960764    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960767    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960770    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960773    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960777    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960781    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960785    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960787    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960790    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960793    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960796    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960800    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:50:56.059617 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960804    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960807    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960810    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960813    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960816    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960819    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960821    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960825    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960828    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960830    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960840    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960843    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960845    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960848    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960851    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960854    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960856    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960859    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960862    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960865    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:50:56.074964 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960868    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960871    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960873    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960876    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960879    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960887    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960890    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960893    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960895    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960898    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960902    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960906    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.960909    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961680    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961688    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961691    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961694    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961697    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961700    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961703    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:50:56.077355 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961706    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961709    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961712    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961717    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961722    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961725    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961728    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961731    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961734    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961737    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961741    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961745    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961748    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961751    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961754    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961757    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961762    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961765    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961769    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:50:56.092693 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961771    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961774    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961777    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961779    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961782    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961785    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961787    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961790    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961792    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961795    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961798    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961800    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961803    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961806    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961809    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961811    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961814    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961817    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961819    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961822    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:50:56.094054 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961826    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961829    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961832    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961834    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961837    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961839    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961842    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961845    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961847    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961853    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961856    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961859    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961862    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961865    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961868    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961870    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961873    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961876    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961878    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961881    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:50:56.257710 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961886    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961889    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961892    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961895    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961897    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961901    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961905    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961908    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961911    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961914    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961917    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961920    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961923    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961926    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961929    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961932    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961934    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961937    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961940    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:50:56.258911 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961943    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961945    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961949    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961953    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961955    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961958    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961960    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961963    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961966    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961969    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961971    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961974    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961977    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.961980    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962387    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962393    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962396    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962399    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962402    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962404    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:50:56.259974 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962407    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962410    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962413    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962419    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962424    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962427    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962429    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962432    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962435    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962438    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962442    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962446    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962449    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962452    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962458    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962460    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962463    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962466    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962469    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:50:56.260788 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962472    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962475    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962478    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962480    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962483    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962487    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962489    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962492    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962495    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962498    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962500    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962503    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962506    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962508    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962511    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962514    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962516    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962521    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962524    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962527    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:50:56.261594 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962529    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962532    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962534    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962537    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962539    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962542    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962544    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962550    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962553    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962556    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962560    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962563    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962565    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962568    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962571    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962573    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962576    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962579    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962581    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:50:56.262192 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962584    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962586    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962589    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962591    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962594    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962597    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962600    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962604    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962608    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962611    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962614    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962618    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962620    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962623    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962625    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962628    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962630    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962633    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962636    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:50:56.262823 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962638    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962643    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962646    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962648    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962651    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962654    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962657    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962659    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962662    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962665    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962667    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962670    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962673    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962675    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962678    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.962680    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962755    2556 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962766    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962773    2556 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962778    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962782    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 19:50:56.263505 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962786    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962790    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962796    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962799    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962803    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962807    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962810    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962814    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962817    2556 flags.go:64] FLAG: --cgroup-root=""
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962819    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962822    2556 flags.go:64] FLAG: --client-ca-file=""
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962825    2556 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962830    2556 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962835    2556 flags.go:64] FLAG: --cluster-domain=""
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962838    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962841    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962844    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962848    2556 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962852    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962855    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962858    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962861    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962865    2556 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962868    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 19:50:56.264116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962871    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962874    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962877    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962881    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962884    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962887    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962890    2556 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962893    2556 flags.go:64] FLAG: --enable-server="true"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962896    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962901    2556 flags.go:64] FLAG: --event-burst="100"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962906    2556 flags.go:64] FLAG: --event-qps="50"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962909    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962913    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962916    2556 flags.go:64] FLAG: --eviction-hard=""
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962920    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962923    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962926    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962930    2556 flags.go:64] FLAG: --eviction-soft=""
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962932    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962935    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962940    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962943    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962946    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962949    2556 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962952    2556 flags.go:64] FLAG: --feature-gates=""
Jul 02 19:50:56.264787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962956    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962959    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962962    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962965    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962969    2556 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962972    2556 flags.go:64] FLAG: --help="false"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962975    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962978    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962982    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962984    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962988    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962991    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962994    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.962997    2556 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963000    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963003    2556 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963006    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963010    2556 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963013    2556 flags.go:64] FLAG: --kube-reserved=""
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963016    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963019    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963023    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963026    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963029    2556 flags.go:64] FLAG: --lock-file=""
Jul 02 19:50:56.265529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963031    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963034    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963038    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963045    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963048    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963051    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963054    2556 flags.go:64] FLAG: --logging-format="text"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963057    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963060    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963063    2556 flags.go:64] FLAG: --manifest-url=""
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963066    2556 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963073    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963076    2556 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963080    2556 flags.go:64] FLAG: --max-pods="110"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963083    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963087    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963089    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963092    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963096    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963099    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963102    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963110    2556 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963113    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963116    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 19:50:56.266559 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963119    2556 flags.go:64] FLAG: --pod-cidr=""
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963123    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963129    2556 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963132    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963136    2556 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963138    2556 flags.go:64] FLAG: --port="10250"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963142    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963145    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a639da46084151c9"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963148    2556 flags.go:64] FLAG: --qos-reserved=""
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963152    2556 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963154    2556 flags.go:64] FLAG: --register-node="true"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963157    2556 flags.go:64] FLAG: --register-with-taints=""
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963163    2556 flags.go:64] FLAG: --registry-burst="10"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963166    2556 flags.go:64] FLAG: --registry-qps="5"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963169    2556 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963172    2556 flags.go:64] FLAG: --reserved-memory=""
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963176    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963179    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963182    2556 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963185    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963187    2556 flags.go:64] FLAG: --runonce="false"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963190    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963193    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963197    2556 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963200    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 19:50:56.267314 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963203    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963206    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963209    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963212    2556 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963215    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963218    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963221    2556 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963223    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963228    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963231    2556 flags.go:64] FLAG: --system-cgroups=""
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963234    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963240    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963243    2556 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963246    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963251    2556 flags.go:64] FLAG: --tls-min-version=""
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963254    2556 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963257    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963260    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963263    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963267    2556 flags.go:64] FLAG: --v="2"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963287    2556 flags.go:64] FLAG: --version="false"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963292    2556 flags.go:64] FLAG: --vmodule=""
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963296    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.963299    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963413    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:50:56.426267 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963417    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963420    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963423    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963426    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963430    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963433    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963436    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963439    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963442    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963444    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963447    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963450    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963452    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963455    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963458    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963462    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963465    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963467    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963470    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963472    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:50:56.427119 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963475    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963478    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963481    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963483    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963486    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963489    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963493    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963495    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963498    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963501    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963503    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963506    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963509    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963512    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963514    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963517    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963520    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963522    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963525    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:50:56.427722 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963528    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963531    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963533    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963536    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963538    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963541    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963544    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963548    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963552    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963556    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963559    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963562    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963565    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963567    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963570    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963573    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963576    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963578    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963581    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:50:56.428292 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963585    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963588    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963592    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963595    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963598    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963601    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963604    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963606    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963609    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963612    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963615    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963617    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963620    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963622    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963625    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963628    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963630    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963633    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963636    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:50:56.428845 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963638    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963641    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963644    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963647    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963650    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963653    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963656    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963658    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963661    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963664    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963666    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963671    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963674    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963677    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963680    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963683    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963686    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963689    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963691    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963694    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:50:56.429427 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.963698    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.964488    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.972827    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.972857    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.973761    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.973769    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973848    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973854    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973858    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973861    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973866    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973869    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973872    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973875    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:50:56.429968 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973878    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973883    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973888    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973891    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973895    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973900    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973905    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973908    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973912    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973916    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973919    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973923    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973926    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973930    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973934    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973938    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973946    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973950    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973953    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973956    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:50:56.430442 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973960    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973963    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973966    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973970    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973973    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973977    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973980    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973984    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973987    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973990    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973994    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.973997    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974000    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974005    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974010    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974014    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974018    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974021    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974027    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:50:56.430972 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974031    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974034    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974037    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974041    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974044    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974047    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974050    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974053    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974057    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974060    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974064    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974067    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974070    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974075    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974079    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974083    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974086    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974090    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974093    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974097    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:50:56.431526 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974100    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974103    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974108    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974112    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974114    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974117    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974120    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974124    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974128    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974130    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974133    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974137    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974141    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974144    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974146    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974149    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974152    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974154    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974157    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:50:56.432068 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974159    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974162    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974165    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974167    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974170    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974173    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974175    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974178    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974181    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974184    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974187    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974189    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974192    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.974197    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974341    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:50:56.432673 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974348    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974352    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974356    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974359    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974363    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974366    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974373    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974377    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974381    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974386    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974390    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974395    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974399    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974403    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974407    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974411    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974414    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974417    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974420    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:50:56.433099 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974424    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974427    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974431    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974434    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974437    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974440    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974445    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974449    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974453    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974456    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974460    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974463    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974467    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974470    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974473    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974476    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974480    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974483    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974486    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:50:56.433676 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974491    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974494    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974498    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974503    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974506    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974510    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974513    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974517    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974521    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974524    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974528    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974532    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974535    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974538    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974540    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974543    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974546    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974549    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974552    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974554    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:50:56.434180 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974557    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974560    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974563    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974565    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974568    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974571    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974574    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974576    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974579    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974581    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974584    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974587    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974591    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974594    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974596    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974601    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974604    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974607    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974609    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974613    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:50:56.434820 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974616    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974619    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974622    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974625    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974628    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974631    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974633    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974636    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974640    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974643    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974646    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974648    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974651    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974657    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974662    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974666    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974671    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974675    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974679    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:50:56.435426 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:55.974683    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:50:56.436008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.974690    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:50:56.436008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.974895    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 19:50:56.436008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.979659    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 19:50:56.436008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.981011    2556 server.go:1019] "Starting client certificate rotation"
Jul 02 19:50:56.436008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.981140    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:50:56.436008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.981186    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:50:56.436008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.983656    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:50:56.436008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.985134    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:50:56.436008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.992847    2556 log.go:25] "Validated CRI v1 runtime API"
Jul 02 19:50:56.436008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.995127    2556 log.go:25] "Validated CRI v1 image API"
Jul 02 19:50:56.436008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.995884    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 19:50:56.436008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.999454    2556 fs.go:135] Filesystem UUIDs: map[2c45447f-8cdc-4624-a927-9da822ef977d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8fa293a3-b716-4b4f-94d6-92d2680a54f5:/dev/nvme0n1p4]
Jul 02 19:50:56.436376 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:55.999471    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 19:50:56.436488 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.004522    2556 manager.go:216] Machine: {Timestamp:2026-07-02 19:50:56.003133737 +0000 UTC m=+0.365280793 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091648 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28050dd0a394ce821b404191f153e4 SystemUUID:ec28050d-d0a3-94ce-821b-404191f153e4 BootID:98aa61ea-5dc1-4582-8ab6-70eb012f3d5b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:83:ed:15:9e:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:83:ed:15:9e:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:d4:7a:62:a2:1a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 19:50:56.436488 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.004628    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 19:50:56.436488 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.004714    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 19:50:56.436488 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.007668    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 19:50:56.436488 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.007710    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-14.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 19:50:56.436488 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.008437    2556 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 19:50:56.436488 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.008447    2556 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 19:50:56.436488 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.008455    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.008967    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.009463    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.010252    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.013684    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.013813    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.013855    2556 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.013865    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.013877    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.013886    2556 kubelet.go:398] "Adding apiserver pod source"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.013895    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.014249    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.014264    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.016635    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.018986    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.019014    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.019943    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.019960    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.019967    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.019973    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.019982    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.019988    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.019996    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.020001    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.020012    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.020019    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.020028    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.020033    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.020875    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.020883    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.023858    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-14.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.024052    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.024105    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.024298    2556 server.go:1268] "Started kubelet"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.024390    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.024397    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.024470    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.025589    2556 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.028070    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 19:50:56.437111 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.030687    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.034193    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.034234    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.034326    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-14.ec2.internal\" not found"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.034857    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.034857    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.034888    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.035080    2556 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.035092    2556 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.034155    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-14.ec2.internal.18be90ee63156973  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-14.ec2.internal,UID:ip-10-0-130-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-14.ec2.internal,},FirstTimestamp:2026-07-02 19:50:56.024258931 +0000 UTC m=+0.386405983,LastTimestamp:2026-07-02 19:50:56.024258931 +0000 UTC m=+0.386405983,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-14.ec2.internal,}"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.036791    2556 factory.go:55] Registering systemd factory
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.036840    2556 factory.go:223] Registration of the systemd container factory successfully
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.037104    2556 factory.go:153] Registering CRI-O factory
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.037120    2556 factory.go:223] Registration of the crio container factory successfully
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.037176    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.037204    2556 factory.go:103] Registering Raw factory
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.037219    2556 manager.go:1196] Started watching for new ooms in manager
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.037659    2556 manager.go:349] Starting recovery of all containers
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.039840    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.039927    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.049471    2556 manager.go:354] Recovery completed
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.054758    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.056466    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.056491    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.056501    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.057072    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.057080    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.057095    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.057222    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.058048    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.058079    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.438594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.058102    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.605905 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.058570    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-14.ec2.internal.18be90ee65011399  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-14.ec2.internal,UID:ip-10-0-130-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-14.ec2.internal,},FirstTimestamp:2026-07-02 19:50:56.056480665 +0000 UTC m=+0.418627718,LastTimestamp:2026-07-02 19:50:56.056480665 +0000 UTC m=+0.418627718,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-14.ec2.internal,}"
Jul 02 19:50:56.605905 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.059103    2556 policy_none.go:49] "None policy: Start"
Jul 02 19:50:56.605905 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.059126    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 19:50:56.605905 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.059137    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 19:50:56.605905 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.060230    2556 policy_none.go:47] "Start"
Jul 02 19:50:56.605905 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.067298    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-14.ec2.internal.18be90ee65014cc3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-14.ec2.internal,UID:ip-10-0-130-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-14.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-14.ec2.internal,},FirstTimestamp:2026-07-02 19:50:56.056495299 +0000 UTC m=+0.418642353,LastTimestamp:2026-07-02 19:50:56.056495299 +0000 UTC m=+0.418642353,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-14.ec2.internal,}"
Jul 02 19:50:56.605905 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.070567    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-14.ec2.internal.18be90ee650171de  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-14.ec2.internal,UID:ip-10-0-130-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-14.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-14.ec2.internal,},FirstTimestamp:2026-07-02 19:50:56.056504798 +0000 UTC m=+0.418651851,LastTimestamp:2026-07-02 19:50:56.056504798 +0000 UTC m=+0.418651851,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-14.ec2.internal,}"
Jul 02 19:50:56.605905 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.076038    2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-14.ec2.internal.18be90ee65011399\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-14.ec2.internal.18be90ee65011399  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-14.ec2.internal,UID:ip-10-0-130-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-14.ec2.internal,},FirstTimestamp:2026-07-02 19:50:56.056480665 +0000 UTC m=+0.418627718,LastTimestamp:2026-07-02 19:50:56.058063424 +0000 UTC m=+0.420210479,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-14.ec2.internal,}"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.083722    2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-14.ec2.internal.18be90ee65014cc3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-14.ec2.internal.18be90ee65014cc3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-14.ec2.internal,UID:ip-10-0-130-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-14.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-14.ec2.internal,},FirstTimestamp:2026-07-02 19:50:56.056495299 +0000 UTC m=+0.418642353,LastTimestamp:2026-07-02 19:50:56.058084982 +0000 UTC m=+0.420232037,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-14.ec2.internal,}"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.091530    2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-14.ec2.internal.18be90ee650171de\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-14.ec2.internal.18be90ee650171de  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-14.ec2.internal,UID:ip-10-0-130-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-14.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-14.ec2.internal,},FirstTimestamp:2026-07-02 19:50:56.056504798 +0000 UTC m=+0.418651851,LastTimestamp:2026-07-02 19:50:56.058108026 +0000 UTC m=+0.420255081,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-14.ec2.internal,}"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.101936    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f7sxl"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.111163    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f7sxl"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.129941    2556 manager.go:337] "Starting Device Plugin manager"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.129979    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.129989    2556 server.go:87] "Starting device plugin registration server"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.130317    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.130329    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.130430    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.130540    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.130547    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.131097    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.131146    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-14.ec2.internal\" not found"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.188474    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.189882    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.189919    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.189942    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.189980    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.192512    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.230627    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.231695    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.231733    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.231748    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.606267 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.231785    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.242998    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.243023    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-14.ec2.internal\": node \"ip-10-0-130-14.ec2.internal\" not found"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.284300    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-14.ec2.internal\" not found"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.290502    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-14.ec2.internal"]
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.290569    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.291529    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.291554    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.291564    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.293048    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.293183    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.293224    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.297455    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.297460    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.297479    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.297482    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.297489    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.297494    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.298691    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.298715    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.299507    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.299531    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.299549    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.330531    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-14.ec2.internal\" not found" node="ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.335025    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-14.ec2.internal\" not found" node="ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.336596    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/89047581411ffd8e8378adff77958cbf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal\" (UID: \"89047581411ffd8e8378adff77958cbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.336619    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89047581411ffd8e8378adff77958cbf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal\" (UID: \"89047581411ffd8e8378adff77958cbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.606965 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.336640    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d76ef9ff7b6cadafe54bfd3a40fd4b7d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-14.ec2.internal\" (UID: \"d76ef9ff7b6cadafe54bfd3a40fd4b7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.607740 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.384944    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-14.ec2.internal\" not found"
Jul 02 19:50:56.607740 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.437758    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/89047581411ffd8e8378adff77958cbf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal\" (UID: \"89047581411ffd8e8378adff77958cbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.607740 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.437787    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89047581411ffd8e8378adff77958cbf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal\" (UID: \"89047581411ffd8e8378adff77958cbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.607740 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.437805    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d76ef9ff7b6cadafe54bfd3a40fd4b7d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-14.ec2.internal\" (UID: \"d76ef9ff7b6cadafe54bfd3a40fd4b7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.607740 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.437848    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d76ef9ff7b6cadafe54bfd3a40fd4b7d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-14.ec2.internal\" (UID: \"d76ef9ff7b6cadafe54bfd3a40fd4b7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.607740 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.437889    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/89047581411ffd8e8378adff77958cbf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal\" (UID: \"89047581411ffd8e8378adff77958cbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.607740 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.437912    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89047581411ffd8e8378adff77958cbf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal\" (UID: \"89047581411ffd8e8378adff77958cbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.607740 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.485048    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-14.ec2.internal\" not found"
Jul 02 19:50:56.607740 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.585240    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-14.ec2.internal\" not found"
Jul 02 19:50:56.784103 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.637387    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.784103 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.638472    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:56.784103 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.686325    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-14.ec2.internal\" not found"
Jul 02 19:50:56.975025 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.788614    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-14.ec2.internal\" not found"
Jul 02 19:50:56.975025 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.888789    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-14.ec2.internal\" not found"
Jul 02 19:50:57.115673 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.980910    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 19:50:57.115673 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:56.981086    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 19:50:57.115673 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:56.989859    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-14.ec2.internal\" not found"
Jul 02 19:50:57.115673 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:57.084012    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:50:57.115673 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:57.087595    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:50:57.115673 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:57.112979    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 19:45:56 +0000 UTC" deadline="2028-02-24 23:20:48.505011189 +0000 UTC"
Jul 02 19:50:57.115673 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:57.113026    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14451h29m51.391989797s"
Jul 02 19:50:57.279051 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:57.135427    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:57.279051 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:57.147531    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:50:57.279051 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:57.149485    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal"
Jul 02 19:50:57.279051 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:57.160525    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:50:57.279051 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:57.255726    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd76ef9ff7b6cadafe54bfd3a40fd4b7d.slice/crio-033ba09011f04944825c616db6a682ad23775997e61cedbd11e1ac10b84943c9 WatchSource:0}: Error finding container 033ba09011f04944825c616db6a682ad23775997e61cedbd11e1ac10b84943c9: Status 404 returned error can't find the container with id 033ba09011f04944825c616db6a682ad23775997e61cedbd11e1ac10b84943c9
Jul 02 19:50:57.279051 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:57.255971    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89047581411ffd8e8378adff77958cbf.slice/crio-2797819fbf361140bc876178c3b28037060989aee57b6b4268b88da78aba3c09 WatchSource:0}: Error finding container 2797819fbf361140bc876178c3b28037060989aee57b6b4268b88da78aba3c09: Status 404 returned error can't find the container with id 2797819fbf361140bc876178c3b28037060989aee57b6b4268b88da78aba3c09
Jul 02 19:50:57.279051 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:57.263248    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:50:57.685643 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:57.502064    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.014527    2556 apiserver.go:52] "Watching apiserver"
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.023148    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.023558    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-bvtcx","openshift-network-diagnostics/network-check-target-lskk6","openshift-ovn-kubernetes/ovnkube-node-j9dh9","kube-system/global-pull-secret-syncer-ktd42","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq","openshift-cluster-node-tuning-operator/tuned-cjdfp","openshift-image-registry/node-ca-cdzpb","openshift-multus/multus-additional-cni-plugins-xnpsf","openshift-multus/network-metrics-daemon-cpx79","openshift-network-operator/iptables-alerter-484fq","kube-system/konnectivity-agent-7gkfk","kube-system/kube-apiserver-proxy-ip-10-0-130-14.ec2.internal","openshift-dns/node-resolver-rcpst","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal"]
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.025457    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cdzpb"
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.026616    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rcpst"
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.028199    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.028210    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.028240    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gspwc\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.028522    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.028526    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.029412    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.029501    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sk9ql\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.029640    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.029779    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.029830    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.030942    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.031255    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.031455    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.032074    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.032273    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.032286    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.032286    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.032963    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.033531    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rqrf7\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.033732    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.034013    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 19:50:58.105653 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.034098    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qsq7c\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.034338    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.034983    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.035048    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.035459    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.035537    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.036046    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.036371    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5l9v8\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.036971    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.039898    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.040173    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.040361    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.040446    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2k4tn\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.040856    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.041244    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.041320    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.042897    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-484fq"
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.045625    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7gkfk"
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.046235    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.046527    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.046953    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-np9vf\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.046952    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.047793    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.048068    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.048672    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vhlnz\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.049935    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.050617    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.051490    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mxl6d\""
Jul 02 19:50:58.107196 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.052816    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054097    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-sysconfig\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054130    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-kubernetes\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054155    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-var-lib-cni-bin\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054182    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c74366c9-55c2-489e-87f5-039729691572-cni-binary-copy\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054249    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6c722c47-d54a-4fa2-98f5-07009751d2e3-serviceca\") pod \"node-ca-cdzpb\" (UID: \"6c722c47-d54a-4fa2-98f5-07009751d2e3\") " pod="openshift-image-registry/node-ca-cdzpb"
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054305    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-sys-fs\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054334    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-multus-socket-dir-parent\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054358    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-run-netns\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054383    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/829fd4e9-6a1f-4b4d-8cd3-42b944b487b2-tmp-dir\") pod \"node-resolver-rcpst\" (UID: \"829fd4e9-6a1f-4b4d-8cd3-42b944b487b2\") " pod="openshift-dns/node-resolver-rcpst"
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054407    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-node-log\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054431    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-registration-dir\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054455    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-cnibin\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054484    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-run-k8s-cni-cncf-io\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.109049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054508    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-etc-openvswitch\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.112859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054533    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7dp7\" (UniqueName: \"kubernetes.io/projected/829fd4e9-6a1f-4b4d-8cd3-42b944b487b2-kube-api-access-w7dp7\") pod \"node-resolver-rcpst\" (UID: \"829fd4e9-6a1f-4b4d-8cd3-42b944b487b2\") " pod="openshift-dns/node-resolver-rcpst"
Jul 02 19:50:58.112859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054571    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-var-lib-openvswitch\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.112859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054602    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-run-openvswitch\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.112859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054624    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-cni-netd\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.112859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054650    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.112859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054676    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.112859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054714    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c74366c9-55c2-489e-87f5-039729691572-multus-daemon-config\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.112859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054740    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-etc-kubernetes\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.112859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054765    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:50:58.112859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054789    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-run-ovn\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.112859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054810    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-var-lib-kubelet\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.112859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054851    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcp9z\" (UniqueName: \"kubernetes.io/projected/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-kube-api-access-bcp9z\") pod \"network-metrics-daemon-cpx79\" (UID: \"77025d92-7c39-45a3-a54c-4ff7a1ec2d39\") " pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:50:58.112859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054964    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-kubelet\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.054998    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-device-dir\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055029    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-sysctl-conf\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055054    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-tmp\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055080    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhwhk\" (UniqueName: \"kubernetes.io/projected/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-kube-api-access-mhwhk\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055120    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-os-release\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055141    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c722c47-d54a-4fa2-98f5-07009751d2e3-host\") pod \"node-ca-cdzpb\" (UID: \"6c722c47-d54a-4fa2-98f5-07009751d2e3\") " pod="openshift-image-registry/node-ca-cdzpb"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055158    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-run-netns\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055173    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-run-systemd\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055188    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-multus-cni-dir\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055203    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-env-overrides\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055220    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-etc-selinux\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055247    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnpr8\" (UniqueName: \"kubernetes.io/projected/837aef9a-cbf2-40e7-9e36-cd22cdf20419-kube-api-access-nnpr8\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055265    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-sys\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.115255 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055281    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs\") pod \"network-metrics-daemon-cpx79\" (UID: \"77025d92-7c39-45a3-a54c-4ff7a1ec2d39\") " pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055313    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f320b8c-773b-46d2-b6ae-4057cf92f04b-kubelet-config\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055346    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-run-ovn-kubernetes\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055383    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-ovn-node-metrics-cert\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055418    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-ovnkube-script-lib\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055443    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-sysctl-d\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055466    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-tuned\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055520    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-run-multus-certs\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055563    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f320b8c-773b-46d2-b6ae-4057cf92f04b-dbus\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055592    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4j22\" (UniqueName: \"kubernetes.io/projected/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-kube-api-access-j4j22\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055617    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-ovnkube-config\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055641    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-modprobe-d\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055664    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-run\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055688    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-host\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.116614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055713    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-system-cni-dir\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055739    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kfz8\" (UniqueName: \"kubernetes.io/projected/c74366c9-55c2-489e-87f5-039729691572-kube-api-access-2kfz8\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055764    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-socket-dir\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055788    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-systemd\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055813    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wxjp\" (UniqueName: \"kubernetes.io/projected/6c722c47-d54a-4fa2-98f5-07009751d2e3-kube-api-access-9wxjp\") pod \"node-ca-cdzpb\" (UID: \"6c722c47-d54a-4fa2-98f5-07009751d2e3\") " pod="openshift-image-registry/node-ca-cdzpb"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-var-lib-cni-multus\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055875    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-var-lib-kubelet\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055912    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-hostroot\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055941    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-slash\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055965    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-lib-modules\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.055999    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-multus-conf-dir\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.056045    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/829fd4e9-6a1f-4b4d-8cd3-42b944b487b2-hosts-file\") pod \"node-resolver-rcpst\" (UID: \"829fd4e9-6a1f-4b4d-8cd3-42b944b487b2\") " pod="openshift-dns/node-resolver-rcpst"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.056069    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-systemd-units\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.056090    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-log-socket\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.117988 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.056128    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-cni-bin\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.118695 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.059366    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:50:58.118695 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.090191    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-txl9b"
Jul 02 19:50:58.118695 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.100251    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-txl9b"
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.136983    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157351    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs\") pod \"network-metrics-daemon-cpx79\" (UID: \"77025d92-7c39-45a3-a54c-4ff7a1ec2d39\") " pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157393    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f320b8c-773b-46d2-b6ae-4057cf92f04b-kubelet-config\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157421    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-run-ovn-kubernetes\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157447    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-ovn-node-metrics-cert\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157470    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-ovnkube-script-lib\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157512    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-sysctl-d\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157533    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-tuned\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.157534    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157555    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzmgw\" (UniqueName: \"kubernetes.io/projected/cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6-kube-api-access-fzmgw\") pod \"iptables-alerter-484fq\" (UID: \"cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6\") " pod="openshift-network-operator/iptables-alerter-484fq"
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157573    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-run-multus-certs\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157609    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f320b8c-773b-46d2-b6ae-4057cf92f04b-dbus\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.157644    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs podName:77025d92-7c39-45a3-a54c-4ff7a1ec2d39 nodeName:}" failed. No retries permitted until 2026-07-02 19:50:58.657606397 +0000 UTC m=+3.019753458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs") pod "network-metrics-daemon-cpx79" (UID: "77025d92-7c39-45a3-a54c-4ff7a1ec2d39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157684    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4j22\" (UniqueName: \"kubernetes.io/projected/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-kube-api-access-j4j22\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.195000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157712    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-ovnkube-config\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157740    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-modprobe-d\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157763    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-run\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157784    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-host\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157812    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157821    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f320b8c-773b-46d2-b6ae-4057cf92f04b-dbus\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157839    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-system-cni-dir\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157869    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kfz8\" (UniqueName: \"kubernetes.io/projected/c74366c9-55c2-489e-87f5-039729691572-kube-api-access-2kfz8\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157895    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-socket-dir\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157907    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-sysctl-d\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157919    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-systemd\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157946    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wxjp\" (UniqueName: \"kubernetes.io/projected/6c722c47-d54a-4fa2-98f5-07009751d2e3-kube-api-access-9wxjp\") pod \"node-ca-cdzpb\" (UID: \"6c722c47-d54a-4fa2-98f5-07009751d2e3\") " pod="openshift-image-registry/node-ca-cdzpb"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157965    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-run\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157973    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-var-lib-cni-multus\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.157999    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-var-lib-kubelet\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.196135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158021    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-hostroot\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158043    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-slash\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158072    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-system-cni-dir\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158098    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-lib-modules\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158125    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158154    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs79w\" (UniqueName: \"kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w\") pod \"network-check-target-lskk6\" (UID: \"8e059bc7-1ecb-40a6-8123-36df05326642\") " pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158181    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-multus-conf-dir\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158182    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158212    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/829fd4e9-6a1f-4b4d-8cd3-42b944b487b2-hosts-file\") pod \"node-resolver-rcpst\" (UID: \"829fd4e9-6a1f-4b4d-8cd3-42b944b487b2\") " pod="openshift-dns/node-resolver-rcpst"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158237    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-systemd-units\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158262    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-log-socket\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158290    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-cni-bin\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158315    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-sysconfig\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158340    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-kubernetes\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.199754 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158381    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8773705-33e6-4a9b-bbaf-49a63596e417-agent-certs\") pod \"konnectivity-agent-7gkfk\" (UID: \"e8773705-33e6-4a9b-bbaf-49a63596e417\") " pod="kube-system/konnectivity-agent-7gkfk"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158416    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-var-lib-cni-bin\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158442    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c74366c9-55c2-489e-87f5-039729691572-cni-binary-copy\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158492    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-modprobe-d\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158509    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6c722c47-d54a-4fa2-98f5-07009751d2e3-serviceca\") pod \"node-ca-cdzpb\" (UID: \"6c722c47-d54a-4fa2-98f5-07009751d2e3\") " pod="openshift-image-registry/node-ca-cdzpb"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158527    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-host\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158538    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-sys-fs\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158577    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-os-release\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158596    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-sys-fs\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158608    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8773705-33e6-4a9b-bbaf-49a63596e417-konnectivity-ca\") pod \"konnectivity-agent-7gkfk\" (UID: \"e8773705-33e6-4a9b-bbaf-49a63596e417\") " pod="kube-system/konnectivity-agent-7gkfk"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158657    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-multus-socket-dir-parent\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158687    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-run-netns\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158720    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/829fd4e9-6a1f-4b4d-8cd3-42b944b487b2-tmp-dir\") pod \"node-resolver-rcpst\" (UID: \"829fd4e9-6a1f-4b4d-8cd3-42b944b487b2\") " pod="openshift-dns/node-resolver-rcpst"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158731    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/829fd4e9-6a1f-4b4d-8cd3-42b944b487b2-hosts-file\") pod \"node-resolver-rcpst\" (UID: \"829fd4e9-6a1f-4b4d-8cd3-42b944b487b2\") " pod="openshift-dns/node-resolver-rcpst"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158748    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-node-log\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.202151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158780    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-systemd-units\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158790    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-registration-dir\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158823    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158826    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-log-socket\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158864    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-cnibin\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158872    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-cni-bin\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158891    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-run-k8s-cni-cncf-io\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158919    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-etc-openvswitch\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158927    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-sysconfig\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158938    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-ovnkube-script-lib\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158967    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-etc-openvswitch\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.158999    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-system-cni-dir\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159020    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-kubernetes\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159044    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f320b8c-773b-46d2-b6ae-4057cf92f04b-kubelet-config\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159048    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-ovnkube-config\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.203078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159069    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-var-lib-cni-bin\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159099    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-run-ovn-kubernetes\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159207    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-lib-modules\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159304    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-socket-dir\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159307    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-multus-socket-dir-parent\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159340    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-multus-conf-dir\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159391    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-systemd\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159411    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-run-netns\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159646    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-var-lib-cni-multus\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159669    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c74366c9-55c2-489e-87f5-039729691572-cni-binary-copy\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159697    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-var-lib-kubelet\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159704    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/829fd4e9-6a1f-4b4d-8cd3-42b944b487b2-tmp-dir\") pod \"node-resolver-rcpst\" (UID: \"829fd4e9-6a1f-4b4d-8cd3-42b944b487b2\") " pod="openshift-dns/node-resolver-rcpst"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159725    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj5zc\" (UniqueName: \"kubernetes.io/projected/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-kube-api-access-xj5zc\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159786    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-cnibin\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159788    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-registration-dir\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.205847 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159821    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-node-log\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159833    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-run-k8s-cni-cncf-io\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159869    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7dp7\" (UniqueName: \"kubernetes.io/projected/829fd4e9-6a1f-4b4d-8cd3-42b944b487b2-kube-api-access-w7dp7\") pod \"node-resolver-rcpst\" (UID: \"829fd4e9-6a1f-4b4d-8cd3-42b944b487b2\") " pod="openshift-dns/node-resolver-rcpst"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159880    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-slash\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159899    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-var-lib-openvswitch\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159924    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-hostroot\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159925    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-run-openvswitch\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159966    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-cni-netd\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159977    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-run-openvswitch\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.159995    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160015    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-var-lib-openvswitch\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160024    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160052    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-cnibin\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160086    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c74366c9-55c2-489e-87f5-039729691572-multus-daemon-config\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.207013 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160086    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-cni-netd\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160092    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6c722c47-d54a-4fa2-98f5-07009751d2e3-serviceca\") pod \"node-ca-cdzpb\" (UID: \"6c722c47-d54a-4fa2-98f5-07009751d2e3\") " pod="openshift-image-registry/node-ca-cdzpb"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160140    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-etc-kubernetes\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160173    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160201    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-run-ovn\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160244    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-var-lib-kubelet\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160273    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcp9z\" (UniqueName: \"kubernetes.io/projected/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-kube-api-access-bcp9z\") pod \"network-metrics-daemon-cpx79\" (UID: \"77025d92-7c39-45a3-a54c-4ff7a1ec2d39\") " pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160301    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-kubelet\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160328    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-device-dir\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160330    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-run-ovn\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160392    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-sysctl-conf\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160421    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-tmp\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160450    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhwhk\" (UniqueName: \"kubernetes.io/projected/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-kube-api-access-mhwhk\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160483    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.210034 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160511    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6-iptables-alerter-script\") pod \"iptables-alerter-484fq\" (UID: \"cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6\") " pod="openshift-network-operator/iptables-alerter-484fq"
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160539    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-os-release\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160579    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c722c47-d54a-4fa2-98f5-07009751d2e3-host\") pod \"node-ca-cdzpb\" (UID: \"6c722c47-d54a-4fa2-98f5-07009751d2e3\") " pod="openshift-image-registry/node-ca-cdzpb"
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160585    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c74366c9-55c2-489e-87f5-039729691572-multus-daemon-config\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160594    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-kubelet\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160606    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-run-netns\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160641    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-run-systemd\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160644    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160647    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-host-run-multus-certs\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160669    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-multus-cni-dir\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160692    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160697    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-env-overrides\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160732    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-etc-selinux\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.160743    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:50:58.211185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160762    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnpr8\" (UniqueName: \"kubernetes.io/projected/837aef9a-cbf2-40e7-9e36-cd22cdf20419-kube-api-access-nnpr8\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.160795    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret podName:5f320b8c-773b-46d2-b6ae-4057cf92f04b nodeName:}" failed. No retries permitted until 2026-07-02 19:50:58.660778547 +0000 UTC m=+3.022925604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret") pod "global-pull-secret-syncer-ktd42" (UID: "5f320b8c-773b-46d2-b6ae-4057cf92f04b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160815    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-sys\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160862    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6-host-slash\") pod \"iptables-alerter-484fq\" (UID: \"cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6\") " pod="openshift-network-operator/iptables-alerter-484fq"
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.160961    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-device-dir\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.161011    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-var-lib-kubelet\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.161034    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/837aef9a-cbf2-40e7-9e36-cd22cdf20419-etc-selinux\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.161066    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-host-run-netns\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.161067    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-env-overrides\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.161123    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c722c47-d54a-4fa2-98f5-07009751d2e3-host\") pod \"node-ca-cdzpb\" (UID: \"6c722c47-d54a-4fa2-98f5-07009751d2e3\") " pod="openshift-image-registry/node-ca-cdzpb"
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.161144    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-multus-cni-dir\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.161159    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-sysctl-conf\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.161160    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-run-systemd\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.161209    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-etc-kubernetes\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.214647 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.161223    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-sys\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.215828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.161265    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c74366c9-55c2-489e-87f5-039729691572-os-release\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.215828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.162666    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-ovn-node-metrics-cert\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.215828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.163825    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-tmp\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.215828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.164161    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-etc-tuned\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.215828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.174021    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhwhk\" (UniqueName: \"kubernetes.io/projected/83131cdb-e91d-4f69-b23d-4a8455c6c0ca-kube-api-access-mhwhk\") pod \"tuned-cjdfp\" (UID: \"83131cdb-e91d-4f69-b23d-4a8455c6c0ca\") " pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.215828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.174753    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7dp7\" (UniqueName: \"kubernetes.io/projected/829fd4e9-6a1f-4b4d-8cd3-42b944b487b2-kube-api-access-w7dp7\") pod \"node-resolver-rcpst\" (UID: \"829fd4e9-6a1f-4b4d-8cd3-42b944b487b2\") " pod="openshift-dns/node-resolver-rcpst"
Jul 02 19:50:58.215828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.175562    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcp9z\" (UniqueName: \"kubernetes.io/projected/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-kube-api-access-bcp9z\") pod \"network-metrics-daemon-cpx79\" (UID: \"77025d92-7c39-45a3-a54c-4ff7a1ec2d39\") " pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:50:58.215828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.176060    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4j22\" (UniqueName: \"kubernetes.io/projected/541e48fc-bb7c-49ec-a7c8-b72ba27ed643-kube-api-access-j4j22\") pod \"ovnkube-node-j9dh9\" (UID: \"541e48fc-bb7c-49ec-a7c8-b72ba27ed643\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.215828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.176619    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnpr8\" (UniqueName: \"kubernetes.io/projected/837aef9a-cbf2-40e7-9e36-cd22cdf20419-kube-api-access-nnpr8\") pod \"aws-ebs-csi-driver-node-fr2lq\" (UID: \"837aef9a-cbf2-40e7-9e36-cd22cdf20419\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.215828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.177154    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kfz8\" (UniqueName: \"kubernetes.io/projected/c74366c9-55c2-489e-87f5-039729691572-kube-api-access-2kfz8\") pod \"multus-bvtcx\" (UID: \"c74366c9-55c2-489e-87f5-039729691572\") " pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.215828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.177368    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wxjp\" (UniqueName: \"kubernetes.io/projected/6c722c47-d54a-4fa2-98f5-07009751d2e3-kube-api-access-9wxjp\") pod \"node-ca-cdzpb\" (UID: \"6c722c47-d54a-4fa2-98f5-07009751d2e3\") " pod="openshift-image-registry/node-ca-cdzpb"
Jul 02 19:50:58.215828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.197697    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal" event={"ID":"89047581411ffd8e8378adff77958cbf","Type":"ContainerStarted","Data":"2797819fbf361140bc876178c3b28037060989aee57b6b4268b88da78aba3c09"}
Jul 02 19:50:58.215828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.199629    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-14.ec2.internal" event={"ID":"d76ef9ff7b6cadafe54bfd3a40fd4b7d","Type":"ContainerStarted","Data":"033ba09011f04944825c616db6a682ad23775997e61cedbd11e1ac10b84943c9"}
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.261466    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6-iptables-alerter-script\") pod \"iptables-alerter-484fq\" (UID: \"cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6\") " pod="openshift-network-operator/iptables-alerter-484fq"
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.261519    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6-host-slash\") pod \"iptables-alerter-484fq\" (UID: \"cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6\") " pod="openshift-network-operator/iptables-alerter-484fq"
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.261566    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzmgw\" (UniqueName: \"kubernetes.io/projected/cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6-kube-api-access-fzmgw\") pod \"iptables-alerter-484fq\" (UID: \"cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6\") " pod="openshift-network-operator/iptables-alerter-484fq"
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.261598    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.261661    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6-host-slash\") pod \"iptables-alerter-484fq\" (UID: \"cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6\") " pod="openshift-network-operator/iptables-alerter-484fq"
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.261813    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262040    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-system-cni-dir\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262076    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262108    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs79w\" (UniqueName: \"kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w\") pod \"network-check-target-lskk6\" (UID: \"8e059bc7-1ecb-40a6-8123-36df05326642\") " pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262141    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8773705-33e6-4a9b-bbaf-49a63596e417-agent-certs\") pod \"konnectivity-agent-7gkfk\" (UID: \"e8773705-33e6-4a9b-bbaf-49a63596e417\") " pod="kube-system/konnectivity-agent-7gkfk"
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262166    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-os-release\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262189    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8773705-33e6-4a9b-bbaf-49a63596e417-konnectivity-ca\") pod \"konnectivity-agent-7gkfk\" (UID: \"e8773705-33e6-4a9b-bbaf-49a63596e417\") " pod="kube-system/konnectivity-agent-7gkfk"
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262202    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6-iptables-alerter-script\") pod \"iptables-alerter-484fq\" (UID: \"cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6\") " pod="openshift-network-operator/iptables-alerter-484fq"
Jul 02 19:50:58.283360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262218    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262260    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5zc\" (UniqueName: \"kubernetes.io/projected/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-kube-api-access-xj5zc\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262288    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-cnibin\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262351    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262692    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262838    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262108    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-system-cni-dir\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.262972    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-cnibin\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.263065    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-os-release\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.263069    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.263505    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8773705-33e6-4a9b-bbaf-49a63596e417-konnectivity-ca\") pod \"konnectivity-agent-7gkfk\" (UID: \"e8773705-33e6-4a9b-bbaf-49a63596e417\") " pod="kube-system/konnectivity-agent-7gkfk"
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.265112    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8773705-33e6-4a9b-bbaf-49a63596e417-agent-certs\") pod \"konnectivity-agent-7gkfk\" (UID: \"e8773705-33e6-4a9b-bbaf-49a63596e417\") " pod="kube-system/konnectivity-agent-7gkfk"
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.269133    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.269159    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:50:58.285951 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.269174    2556 projected.go:196] Error preparing data for projected volume kube-api-access-fs79w for pod openshift-network-diagnostics/network-check-target-lskk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:50:58.287147 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.269241    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w podName:8e059bc7-1ecb-40a6-8123-36df05326642 nodeName:}" failed. No retries permitted until 2026-07-02 19:50:58.769222345 +0000 UTC m=+3.131369391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fs79w" (UniqueName: "kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w") pod "network-check-target-lskk6" (UID: "8e059bc7-1ecb-40a6-8123-36df05326642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:50:58.287147 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.272288    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj5zc\" (UniqueName: \"kubernetes.io/projected/40bf2d56-28e2-45ff-b807-2c3517a4e7d6-kube-api-access-xj5zc\") pod \"multus-additional-cni-plugins-xnpsf\" (UID: \"40bf2d56-28e2-45ff-b807-2c3517a4e7d6\") " pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.287147 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.272531    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzmgw\" (UniqueName: \"kubernetes.io/projected/cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6-kube-api-access-fzmgw\") pod \"iptables-alerter-484fq\" (UID: \"cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6\") " pod="openshift-network-operator/iptables-alerter-484fq"
Jul 02 19:50:58.396522 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.340384    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cdzpb"
Jul 02 19:50:58.396522 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.350833    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rcpst"
Jul 02 19:50:58.396522 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.359277    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:50:58.396522 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.370904    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq"
Jul 02 19:50:58.396522 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.380346    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cjdfp"
Jul 02 19:50:58.396522 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.389321    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bvtcx"
Jul 02 19:50:58.463912 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.447960    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:50:58.496719 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.496686    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-484fq"
Jul 02 19:50:58.540221 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.540158    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7gkfk"
Jul 02 19:50:58.547574 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.547542    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xnpsf"
Jul 02 19:50:58.665583 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.665491    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:50:58.665583 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.665564    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs\") pod \"network-metrics-daemon-cpx79\" (UID: \"77025d92-7c39-45a3-a54c-4ff7a1ec2d39\") " pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:50:58.665805 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.665722    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:50:58.665805 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.665736    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:50:58.665805 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.665796    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs podName:77025d92-7c39-45a3-a54c-4ff7a1ec2d39 nodeName:}" failed. No retries permitted until 2026-07-02 19:50:59.665781623 +0000 UTC m=+4.027928666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs") pod "network-metrics-daemon-cpx79" (UID: "77025d92-7c39-45a3-a54c-4ff7a1ec2d39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:50:58.665978 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.665816    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret podName:5f320b8c-773b-46d2-b6ae-4057cf92f04b nodeName:}" failed. No retries permitted until 2026-07-02 19:50:59.665804899 +0000 UTC m=+4.027951944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret") pod "global-pull-secret-syncer-ktd42" (UID: "5f320b8c-773b-46d2-b6ae-4057cf92f04b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:50:58.867421 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:58.867383    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs79w\" (UniqueName: \"kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w\") pod \"network-check-target-lskk6\" (UID: \"8e059bc7-1ecb-40a6-8123-36df05326642\") " pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:50:58.867627 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.867597    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:50:58.867751 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.867642    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:50:58.867751 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.867655    2556 projected.go:196] Error preparing data for projected volume kube-api-access-fs79w for pod openshift-network-diagnostics/network-check-target-lskk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:50:58.867751 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:58.867718    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w podName:8e059bc7-1ecb-40a6-8123-36df05326642 nodeName:}" failed. No retries permitted until 2026-07-02 19:50:59.86769751 +0000 UTC m=+4.229844555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fs79w" (UniqueName: "kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w") pod "network-check-target-lskk6" (UID: "8e059bc7-1ecb-40a6-8123-36df05326642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:50:59.102951 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:59.102858    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:45:58 +0000 UTC" deadline="2028-01-14 12:59:19.28827538 +0000 UTC"
Jul 02 19:50:59.102951 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:59.102897    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13457h8m20.185383314s"
Jul 02 19:50:59.190370 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:59.190332    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:50:59.190822 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:59.190480    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:50:59.464487 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:59.464453    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd75a0d0_4b5e_4f2d_8e57_1682e503a7f6.slice/crio-6e81711cfd0b18aac4435968ce4f61814aa74a94887637740e0c3dd1671b96d1 WatchSource:0}: Error finding container 6e81711cfd0b18aac4435968ce4f61814aa74a94887637740e0c3dd1671b96d1: Status 404 returned error can't find the container with id 6e81711cfd0b18aac4435968ce4f61814aa74a94887637740e0c3dd1671b96d1
Jul 02 19:50:59.465879 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:59.465819    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod829fd4e9_6a1f_4b4d_8cd3_42b944b487b2.slice/crio-a73bdf49350c8b508a786df97adc97faf0979a228388a85706b8c43a0cda49ea WatchSource:0}: Error finding container a73bdf49350c8b508a786df97adc97faf0979a228388a85706b8c43a0cda49ea: Status 404 returned error can't find the container with id a73bdf49350c8b508a786df97adc97faf0979a228388a85706b8c43a0cda49ea
Jul 02 19:50:59.467152 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:59.467128    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83131cdb_e91d_4f69_b23d_4a8455c6c0ca.slice/crio-595e0b073b893d2737f34a0b6293a5ffaa4fbaf87093f814618b60da96931502 WatchSource:0}: Error finding container 595e0b073b893d2737f34a0b6293a5ffaa4fbaf87093f814618b60da96931502: Status 404 returned error can't find the container with id 595e0b073b893d2737f34a0b6293a5ffaa4fbaf87093f814618b60da96931502
Jul 02 19:50:59.467901 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:59.467877    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40bf2d56_28e2_45ff_b807_2c3517a4e7d6.slice/crio-a9eecf08c1c2c21c9d83ad0279acb4ea96546fae4c15c6455ab9ee804d057809 WatchSource:0}: Error finding container a9eecf08c1c2c21c9d83ad0279acb4ea96546fae4c15c6455ab9ee804d057809: Status 404 returned error can't find the container with id a9eecf08c1c2c21c9d83ad0279acb4ea96546fae4c15c6455ab9ee804d057809
Jul 02 19:50:59.471640 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:59.471620    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541e48fc_bb7c_49ec_a7c8_b72ba27ed643.slice/crio-5d1011bef1513367aedeed3bfbc1b1d2b064894a703d632203f9f4071d994481 WatchSource:0}: Error finding container 5d1011bef1513367aedeed3bfbc1b1d2b064894a703d632203f9f4071d994481: Status 404 returned error can't find the container with id 5d1011bef1513367aedeed3bfbc1b1d2b064894a703d632203f9f4071d994481
Jul 02 19:50:59.474117 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:59.473268    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod837aef9a_cbf2_40e7_9e36_cd22cdf20419.slice/crio-2eacff01d5290b70ea19ca377de1cc669ef32d3663df1bd5c002eed2828b5705 WatchSource:0}: Error finding container 2eacff01d5290b70ea19ca377de1cc669ef32d3663df1bd5c002eed2828b5705: Status 404 returned error can't find the container with id 2eacff01d5290b70ea19ca377de1cc669ef32d3663df1bd5c002eed2828b5705
Jul 02 19:50:59.478029 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:59.474759    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c722c47_d54a_4fa2_98f5_07009751d2e3.slice/crio-5ab5a3e6560cd203934021ea65363717be28ca94d7a9e8e608849b872611f793 WatchSource:0}: Error finding container 5ab5a3e6560cd203934021ea65363717be28ca94d7a9e8e608849b872611f793: Status 404 returned error can't find the container with id 5ab5a3e6560cd203934021ea65363717be28ca94d7a9e8e608849b872611f793
Jul 02 19:50:59.478029 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:50:59.477233    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74366c9_55c2_489e_87f5_039729691572.slice/crio-32c86e4043caeb78dc882362351c571cb2d2ab3de3a223f69e941af9b5f3f45a WatchSource:0}: Error finding container 32c86e4043caeb78dc882362351c571cb2d2ab3de3a223f69e941af9b5f3f45a: Status 404 returned error can't find the container with id 32c86e4043caeb78dc882362351c571cb2d2ab3de3a223f69e941af9b5f3f45a
Jul 02 19:50:59.673828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:59.673621    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:50:59.674023 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:59.673872    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs\") pod \"network-metrics-daemon-cpx79\" (UID: \"77025d92-7c39-45a3-a54c-4ff7a1ec2d39\") " pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:50:59.674023 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:59.673775    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:50:59.674111 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:59.674031    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:50:59.674111 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:59.674032    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret podName:5f320b8c-773b-46d2-b6ae-4057cf92f04b nodeName:}" failed. No retries permitted until 2026-07-02 19:51:01.674001444 +0000 UTC m=+6.036148511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret") pod "global-pull-secret-syncer-ktd42" (UID: "5f320b8c-773b-46d2-b6ae-4057cf92f04b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:50:59.674191 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:59.674123    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs podName:77025d92-7c39-45a3-a54c-4ff7a1ec2d39 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:01.67409266 +0000 UTC m=+6.036239717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs") pod "network-metrics-daemon-cpx79" (UID: "77025d92-7c39-45a3-a54c-4ff7a1ec2d39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:50:59.875594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:50:59.875512    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs79w\" (UniqueName: \"kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w\") pod \"network-check-target-lskk6\" (UID: \"8e059bc7-1ecb-40a6-8123-36df05326642\") " pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:50:59.875908 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:59.875757    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:50:59.875908 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:59.875779    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:50:59.875908 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:59.875794    2556 projected.go:196] Error preparing data for projected volume kube-api-access-fs79w for pod openshift-network-diagnostics/network-check-target-lskk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:50:59.875908 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:50:59.875861    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w podName:8e059bc7-1ecb-40a6-8123-36df05326642 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:01.875840935 +0000 UTC m=+6.237988001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fs79w" (UniqueName: "kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w") pod "network-check-target-lskk6" (UID: "8e059bc7-1ecb-40a6-8123-36df05326642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:00.104169 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.103399    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:45:58 +0000 UTC" deadline="2028-03-04 14:23:43.562020446 +0000 UTC"
Jul 02 19:51:00.104169 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.103466    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14658h32m43.458558928s"
Jul 02 19:51:00.193547 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.192754    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:00.193547 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:00.192910    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:00.193547 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.193334    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:00.193547 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:00.193459    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:00.217751 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.216825    2556 generic.go:356] "Generic (PLEG): container finished" podID="89047581411ffd8e8378adff77958cbf" containerID="44455d7e4e2e7d96f8dc8e7459a4f04bb83c48c4552398f286a55f76c572a395" exitCode=0
Jul 02 19:51:00.217751 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.216922    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal" event={"ID":"89047581411ffd8e8378adff77958cbf","Type":"ContainerDied","Data":"44455d7e4e2e7d96f8dc8e7459a4f04bb83c48c4552398f286a55f76c572a395"}
Jul 02 19:51:00.232265 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.232164    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bvtcx" event={"ID":"c74366c9-55c2-489e-87f5-039729691572","Type":"ContainerStarted","Data":"32c86e4043caeb78dc882362351c571cb2d2ab3de3a223f69e941af9b5f3f45a"}
Jul 02 19:51:00.240305 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.240268    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9" event={"ID":"541e48fc-bb7c-49ec-a7c8-b72ba27ed643","Type":"ContainerStarted","Data":"5d1011bef1513367aedeed3bfbc1b1d2b064894a703d632203f9f4071d994481"}
Jul 02 19:51:00.256392 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.256328    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnpsf" event={"ID":"40bf2d56-28e2-45ff-b807-2c3517a4e7d6","Type":"ContainerStarted","Data":"a9eecf08c1c2c21c9d83ad0279acb4ea96546fae4c15c6455ab9ee804d057809"}
Jul 02 19:51:00.263726 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.262418    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rcpst" event={"ID":"829fd4e9-6a1f-4b4d-8cd3-42b944b487b2","Type":"ContainerStarted","Data":"a73bdf49350c8b508a786df97adc97faf0979a228388a85706b8c43a0cda49ea"}
Jul 02 19:51:00.264658 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.264562    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-484fq" event={"ID":"cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6","Type":"ContainerStarted","Data":"6e81711cfd0b18aac4435968ce4f61814aa74a94887637740e0c3dd1671b96d1"}
Jul 02 19:51:00.269041 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.268310    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-14.ec2.internal" event={"ID":"d76ef9ff7b6cadafe54bfd3a40fd4b7d","Type":"ContainerStarted","Data":"6f0c4123c0ff164b66cbaaaea6ad70ae35377d712d7945719febd9ae98e69f72"}
Jul 02 19:51:00.271838 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.271752    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7gkfk" event={"ID":"e8773705-33e6-4a9b-bbaf-49a63596e417","Type":"ContainerStarted","Data":"74692a8c0bd0a8aaea74d503dba337aff05c4255e8a52f1b5d17d59460c113af"}
Jul 02 19:51:00.286063 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.286023    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq" event={"ID":"837aef9a-cbf2-40e7-9e36-cd22cdf20419","Type":"ContainerStarted","Data":"2eacff01d5290b70ea19ca377de1cc669ef32d3663df1bd5c002eed2828b5705"}
Jul 02 19:51:00.286566 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.286507    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-14.ec2.internal" podStartSLOduration=3.286486506 podStartE2EDuration="3.286486506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:00.286128382 +0000 UTC m=+4.648275440" watchObservedRunningTime="2026-07-02 19:51:00.286486506 +0000 UTC m=+4.648633573"
Jul 02 19:51:00.295333 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.295288    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cdzpb" event={"ID":"6c722c47-d54a-4fa2-98f5-07009751d2e3","Type":"ContainerStarted","Data":"5ab5a3e6560cd203934021ea65363717be28ca94d7a9e8e608849b872611f793"}
Jul 02 19:51:00.298485 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:00.298201    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cjdfp" event={"ID":"83131cdb-e91d-4f69-b23d-4a8455c6c0ca","Type":"ContainerStarted","Data":"595e0b073b893d2737f34a0b6293a5ffaa4fbaf87093f814618b60da96931502"}
Jul 02 19:51:01.191129 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:01.191089    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:01.191332 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:01.191236    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:01.319157 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:01.319028    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal" event={"ID":"89047581411ffd8e8378adff77958cbf","Type":"ContainerStarted","Data":"2c100b1af941f896594da8460cb8b298090a5cc5ea1cfe3b4b073644fbae6b45"}
Jul 02 19:51:01.694764 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:01.692941    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:01.694764 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:01.693002    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs\") pod \"network-metrics-daemon-cpx79\" (UID: \"77025d92-7c39-45a3-a54c-4ff7a1ec2d39\") " pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:01.694764 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:01.693162    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:01.694764 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:01.693224    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs podName:77025d92-7c39-45a3-a54c-4ff7a1ec2d39 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:05.693205834 +0000 UTC m=+10.055352896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs") pod "network-metrics-daemon-cpx79" (UID: "77025d92-7c39-45a3-a54c-4ff7a1ec2d39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:01.694764 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:01.693320    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:01.694764 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:01.693357    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret podName:5f320b8c-773b-46d2-b6ae-4057cf92f04b nodeName:}" failed. No retries permitted until 2026-07-02 19:51:05.693344627 +0000 UTC m=+10.055491671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret") pod "global-pull-secret-syncer-ktd42" (UID: "5f320b8c-773b-46d2-b6ae-4057cf92f04b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:01.895510 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:01.895470    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs79w\" (UniqueName: \"kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w\") pod \"network-check-target-lskk6\" (UID: \"8e059bc7-1ecb-40a6-8123-36df05326642\") " pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:01.895719 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:01.895702    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:51:01.895782 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:01.895731    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:51:01.895782 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:01.895745    2556 projected.go:196] Error preparing data for projected volume kube-api-access-fs79w for pod openshift-network-diagnostics/network-check-target-lskk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:01.895883 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:01.895802    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w podName:8e059bc7-1ecb-40a6-8123-36df05326642 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:05.89578434 +0000 UTC m=+10.257931382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fs79w" (UniqueName: "kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w") pod "network-check-target-lskk6" (UID: "8e059bc7-1ecb-40a6-8123-36df05326642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:02.191444 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:02.191365    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:02.191597 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:02.191504    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:02.191706 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:02.191681    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:02.191833 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:02.191811    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:03.190445 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:03.190407    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:03.190843 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:03.190540    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:04.190459 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:04.190422    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:04.190938 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:04.190579    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:04.191096 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:04.191074    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:04.191208 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:04.191187    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:05.190735 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:05.190701    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:05.191206 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:05.190831    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:05.726356 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:05.726316    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:05.726542 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:05.726381    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs\") pod \"network-metrics-daemon-cpx79\" (UID: \"77025d92-7c39-45a3-a54c-4ff7a1ec2d39\") " pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:05.726542 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:05.726524    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:05.726542 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:05.726525    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:05.726718 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:05.726586    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs podName:77025d92-7c39-45a3-a54c-4ff7a1ec2d39 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:13.726566297 +0000 UTC m=+18.088713342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs") pod "network-metrics-daemon-cpx79" (UID: "77025d92-7c39-45a3-a54c-4ff7a1ec2d39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:05.726718 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:05.726606    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret podName:5f320b8c-773b-46d2-b6ae-4057cf92f04b nodeName:}" failed. No retries permitted until 2026-07-02 19:51:13.726595124 +0000 UTC m=+18.088742180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret") pod "global-pull-secret-syncer-ktd42" (UID: "5f320b8c-773b-46d2-b6ae-4057cf92f04b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:05.928114 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:05.928072    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs79w\" (UniqueName: \"kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w\") pod \"network-check-target-lskk6\" (UID: \"8e059bc7-1ecb-40a6-8123-36df05326642\") " pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:05.928300 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:05.928246    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:51:05.928300 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:05.928289    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:51:05.928426 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:05.928303    2556 projected.go:196] Error preparing data for projected volume kube-api-access-fs79w for pod openshift-network-diagnostics/network-check-target-lskk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:05.928426 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:05.928372    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w podName:8e059bc7-1ecb-40a6-8123-36df05326642 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:13.928352377 +0000 UTC m=+18.290499436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fs79w" (UniqueName: "kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w") pod "network-check-target-lskk6" (UID: "8e059bc7-1ecb-40a6-8123-36df05326642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:06.191697 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:06.191613    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:06.192091 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:06.191716    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:06.192091 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:06.191795    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:06.192091 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:06.191903    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:07.190778 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:07.190748    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:07.190980 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:07.190869    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:08.190920 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:08.190885    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:08.191419 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:08.190885    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:08.191419 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:08.191030    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:08.191419 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:08.191097    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:09.190883 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:09.190847    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:09.191075 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:09.190975    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:10.193043 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:10.191213    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:10.193043 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:10.191376    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:10.193043 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:10.191214    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:10.193043 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:10.191819    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:11.191222 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:11.191018    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:11.191406 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:11.191341    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:11.344918 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:11.344802    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnpsf" event={"ID":"40bf2d56-28e2-45ff-b807-2c3517a4e7d6","Type":"ContainerStarted","Data":"66b053ad6683b3fb42ef70eee20b3ef98e82dd2511516d31d574b0e3254d6552"}
Jul 02 19:51:11.346797 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:11.346592    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rcpst" event={"ID":"829fd4e9-6a1f-4b4d-8cd3-42b944b487b2","Type":"ContainerStarted","Data":"cafe145a6a34e5d24cbd01c006c06dc389fb9a8ce2b2bca934c9cb69ad13cafc"}
Jul 02 19:51:11.348440 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:11.348387    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7gkfk" event={"ID":"e8773705-33e6-4a9b-bbaf-49a63596e417","Type":"ContainerStarted","Data":"fdb73b0e23bd279ee71a70b62defb74597fe489c18347e28ea59ac390886605e"}
Jul 02 19:51:11.350361 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:11.350296    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq" event={"ID":"837aef9a-cbf2-40e7-9e36-cd22cdf20419","Type":"ContainerStarted","Data":"11d09c5fe09b3e4aaec16b8d6ebd7b8b73d71c2d9f004c7927e42b3aa9cff7ea"}
Jul 02 19:51:11.352226 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:11.351973    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cdzpb" event={"ID":"6c722c47-d54a-4fa2-98f5-07009751d2e3","Type":"ContainerStarted","Data":"d3fb6632903a821b84c1f0b45b711346fd8f8f6dfe4479e301237f8543addde5"}
Jul 02 19:51:11.353800 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:11.353774    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cjdfp" event={"ID":"83131cdb-e91d-4f69-b23d-4a8455c6c0ca","Type":"ContainerStarted","Data":"95a70ae4e85346c4fc6de1e964d9551d8d5356702eb4eba985ed8baf4eb46533"}
Jul 02 19:51:11.368819 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:11.368771    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-14.ec2.internal" podStartSLOduration=14.368757028 podStartE2EDuration="14.368757028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:01.338253605 +0000 UTC m=+5.700400673" watchObservedRunningTime="2026-07-02 19:51:11.368757028 +0000 UTC m=+15.730904090"
Jul 02 19:51:11.386257 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:11.386200    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rcpst" podStartSLOduration=4.883159011 podStartE2EDuration="15.386180005s" totalImagesPullingTime="10.503020994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:11.385486358 +0000 UTC m=+15.747633419" watchObservedRunningTime="2026-07-02 19:51:11.386180005 +0000 UTC m=+15.748327068"
Jul 02 19:51:11.404750 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:11.404687    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7gkfk" podStartSLOduration=4.938030196 podStartE2EDuration="15.404664388s" totalImagesPullingTime="10.466634192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:11.404185057 +0000 UTC m=+15.766332121" watchObservedRunningTime="2026-07-02 19:51:11.404664388 +0000 UTC m=+15.766811451"
Jul 02 19:51:11.426630 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:11.426571    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cjdfp" podStartSLOduration=4.662759962 podStartE2EDuration="15.426555587s" totalImagesPullingTime="10.763795625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:11.426018665 +0000 UTC m=+15.788165727" watchObservedRunningTime="2026-07-02 19:51:11.426555587 +0000 UTC m=+15.788702649"
Jul 02 19:51:11.467780 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:11.467715    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cdzpb" podStartSLOduration=4.9762359499999995 podStartE2EDuration="15.467695045s" totalImagesPullingTime="10.491459095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:11.467600428 +0000 UTC m=+15.829747488" watchObservedRunningTime="2026-07-02 19:51:11.467695045 +0000 UTC m=+15.829842110"
Jul 02 19:51:12.190365 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:12.190286    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:12.190365 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:12.190337    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:12.190583 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:12.190442    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:12.190637 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:12.190590    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:12.306158 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:12.306116    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7gkfk"
Jul 02 19:51:12.306812 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:12.306789    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7gkfk"
Jul 02 19:51:12.360798 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:12.360474    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-484fq" event={"ID":"cd75a0d0-4b5e-4f2d-8e57-1682e503a7f6","Type":"ContainerStarted","Data":"1b3e96edcd6a9e5777ed7b039a40dd6b246394f4ab44a747183c5f8793cb2439"}
Jul 02 19:51:12.374939 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:12.374883    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-484fq" podStartSLOduration=5.874477191 podStartE2EDuration="16.374869187s" totalImagesPullingTime="10.500391996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:12.374689043 +0000 UTC m=+16.736836104" watchObservedRunningTime="2026-07-02 19:51:12.374869187 +0000 UTC m=+16.737016306"
Jul 02 19:51:13.190944 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:13.190908    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:13.191149 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:13.191036    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:13.360883 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:13.360853    2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 19:51:13.792992 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:13.792943    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:13.793173 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:13.793008    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs\") pod \"network-metrics-daemon-cpx79\" (UID: \"77025d92-7c39-45a3-a54c-4ff7a1ec2d39\") " pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:13.793173 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:13.793130    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:13.793258 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:13.793202    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret podName:5f320b8c-773b-46d2-b6ae-4057cf92f04b nodeName:}" failed. No retries permitted until 2026-07-02 19:51:29.793182493 +0000 UTC m=+34.155329549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret") pod "global-pull-secret-syncer-ktd42" (UID: "5f320b8c-773b-46d2-b6ae-4057cf92f04b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:13.793258 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:13.793137    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:13.793373 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:13.793300    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs podName:77025d92-7c39-45a3-a54c-4ff7a1ec2d39 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:29.793283831 +0000 UTC m=+34.155430885 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs") pod "network-metrics-daemon-cpx79" (UID: "77025d92-7c39-45a3-a54c-4ff7a1ec2d39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:13.994568 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:13.994529    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs79w\" (UniqueName: \"kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w\") pod \"network-check-target-lskk6\" (UID: \"8e059bc7-1ecb-40a6-8123-36df05326642\") " pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:13.994715 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:13.994679    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:51:13.994715 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:13.994696    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:51:13.994715 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:13.994705    2556 projected.go:196] Error preparing data for projected volume kube-api-access-fs79w for pod openshift-network-diagnostics/network-check-target-lskk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:13.994844 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:13.994761    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w podName:8e059bc7-1ecb-40a6-8123-36df05326642 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:29.994741336 +0000 UTC m=+34.356888392 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fs79w" (UniqueName: "kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w") pod "network-check-target-lskk6" (UID: "8e059bc7-1ecb-40a6-8123-36df05326642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:14.190992 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:14.190910    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:14.190992 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:14.190961    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:14.191205 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:14.191054    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:14.191261 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:14.191207    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:15.190320 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:15.190287    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:15.190919 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:15.190401    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:15.366641 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:15.366603    2556 generic.go:356] "Generic (PLEG): container finished" podID="40bf2d56-28e2-45ff-b807-2c3517a4e7d6" containerID="66b053ad6683b3fb42ef70eee20b3ef98e82dd2511516d31d574b0e3254d6552" exitCode=0
Jul 02 19:51:15.366792 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:15.366658    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnpsf" event={"ID":"40bf2d56-28e2-45ff-b807-2c3517a4e7d6","Type":"ContainerDied","Data":"66b053ad6683b3fb42ef70eee20b3ef98e82dd2511516d31d574b0e3254d6552"}
Jul 02 19:51:16.191956 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:16.191921    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:16.192535 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:16.192049    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:16.192535 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:16.192102    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:16.192535 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:16.192239    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:17.190974 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:17.190934    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:17.191165 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:17.191052    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:18.059445 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:18.059406    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7gkfk"
Jul 02 19:51:18.060010 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:18.059538    2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 19:51:18.060439 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:18.060413    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7gkfk"
Jul 02 19:51:18.190882 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:18.190843    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:18.191061 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:18.190974    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:18.191061 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:18.191023    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:18.191181 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:18.191138    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:18.979984 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:18.979739    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 19:51:19.144682 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:19.144053    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:51:18.979942683Z","UUID":"24f244d7-5863-4153-b570-e2fd650ec539","Handler":null,"Name":"","Endpoint":""}
Jul 02 19:51:19.145640 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:19.145614    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 19:51:19.145765 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:19.145653    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 19:51:19.191080 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:19.191052    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:19.191215 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:19.191159    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:19.375861 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:19.375828    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bvtcx" event={"ID":"c74366c9-55c2-489e-87f5-039729691572","Type":"ContainerStarted","Data":"fdaac890885e4de4400a864e0578a9669b825a25aa9f70cd42f4227ef86e9d17"}
Jul 02 19:51:19.378167 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:19.378140    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9" event={"ID":"541e48fc-bb7c-49ec-a7c8-b72ba27ed643","Type":"ContainerStarted","Data":"e00c90747653d30704a334361cd6c66263c58393924bea453403dc961e37ac52"}
Jul 02 19:51:19.378313 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:19.378207    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9" event={"ID":"541e48fc-bb7c-49ec-a7c8-b72ba27ed643","Type":"ContainerStarted","Data":"f52ee17cf966d32942fddff260ac5374a822da0141c551f207d8d31a3a0609a5"}
Jul 02 19:51:19.378313 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:19.378253    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9" event={"ID":"541e48fc-bb7c-49ec-a7c8-b72ba27ed643","Type":"ContainerStarted","Data":"8349d8493020815fe984494f0285e0d0afe26c6b0ef8ffc0a4a26425c0849230"}
Jul 02 19:51:19.378397 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:19.378319    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9" event={"ID":"541e48fc-bb7c-49ec-a7c8-b72ba27ed643","Type":"ContainerStarted","Data":"7910a0504d45adff66dccf634fabb3c04eedc795d9a7a715ce963dd070ef53b2"}
Jul 02 19:51:19.378397 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:19.378356    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9" event={"ID":"541e48fc-bb7c-49ec-a7c8-b72ba27ed643","Type":"ContainerStarted","Data":"f26527aa1d5f1bee0a1e14500fd8483aff38234ee147e155ad40409b2287360c"}
Jul 02 19:51:19.379670 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:19.379646    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq" event={"ID":"837aef9a-cbf2-40e7-9e36-cd22cdf20419","Type":"ContainerStarted","Data":"ad890f46b2b5444242a42be7f1c9471bb901061e49efbbb24b850e0847a61559"}
Jul 02 19:51:19.395070 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:19.394993    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bvtcx" podStartSLOduration=4.078466171 podStartE2EDuration="23.394977677s" totalImagesPullingTime="19.316511506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:19.39490522 +0000 UTC m=+23.757052283" watchObservedRunningTime="2026-07-02 19:51:19.394977677 +0000 UTC m=+23.757124730"
Jul 02 19:51:20.195336 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:20.195306    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:20.195763 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:20.195433    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:20.195763 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:20.195481    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:20.195763 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:20.195577    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:20.385091 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:20.385053    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9" event={"ID":"541e48fc-bb7c-49ec-a7c8-b72ba27ed643","Type":"ContainerStarted","Data":"78d6848fe185c8089b2ee1ba30c83f9955a7209bb3328aa241fbe98ce36c7ad0"}
Jul 02 19:51:20.387168 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:20.387133    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq" event={"ID":"837aef9a-cbf2-40e7-9e36-cd22cdf20419","Type":"ContainerStarted","Data":"32ce0159ef8b5220f5bafeb55da40745ed7145f315318a17e16560a2dc11b9b8"}
Jul 02 19:51:20.406534 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:20.406482    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fr2lq" podStartSLOduration=4.314912405 podStartE2EDuration="24.406466845s" totalImagesPullingTime="20.09155444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:20.406047661 +0000 UTC m=+24.768194720" watchObservedRunningTime="2026-07-02 19:51:20.406466845 +0000 UTC m=+24.768613934"
Jul 02 19:51:21.190463 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:21.190428    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:21.190706 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:21.190536    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:22.190874 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:22.190839    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:22.191490 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:22.190886    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:22.191490 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:22.190971    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:22.191490 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:22.191119    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:22.396584 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:22.396546    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9" event={"ID":"541e48fc-bb7c-49ec-a7c8-b72ba27ed643","Type":"ContainerStarted","Data":"e9d29dc80088dc9e45a02aea4b69d2d45828846d7ad3286e0ca2719ed7e340d3"}
Jul 02 19:51:23.190332 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:23.190298    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:23.190524 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:23.190421    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:24.193797 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:24.193724    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:24.194348 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:24.193834    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:24.194348 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:24.193882    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:24.194348 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:24.193980    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:24.404353 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:24.404318    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9" event={"ID":"541e48fc-bb7c-49ec-a7c8-b72ba27ed643","Type":"ContainerStarted","Data":"c94553ef17e2d9237b4446aa0a57b0c69a498d00ce547dc303cddb3573848d45"}
Jul 02 19:51:24.404605 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:24.404589    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:51:24.405095 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:24.405070    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:51:24.409545 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:24.409517    2556 generic.go:356] "Generic (PLEG): container finished" podID="40bf2d56-28e2-45ff-b807-2c3517a4e7d6" containerID="96e6a2a0251fa49d1c9880346ee517c355b9735c2c78397bcc54ba175449728e" exitCode=0
Jul 02 19:51:24.409693 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:24.409560    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnpsf" event={"ID":"40bf2d56-28e2-45ff-b807-2c3517a4e7d6","Type":"ContainerDied","Data":"96e6a2a0251fa49d1c9880346ee517c355b9735c2c78397bcc54ba175449728e"}
Jul 02 19:51:24.423413 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:24.423388    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:51:24.433021 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:24.432974    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9" podStartSLOduration=9.110421638 podStartE2EDuration="28.432961747s" totalImagesPullingTime="19.322540109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:24.432689727 +0000 UTC m=+28.794836790" watchObservedRunningTime="2026-07-02 19:51:24.432961747 +0000 UTC m=+28.795108809"
Jul 02 19:51:25.190472 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:25.190414    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:25.190748 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:25.190588    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:25.411973 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:25.411944    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:51:25.427409 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:25.427383    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:51:25.948567 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:25.948543    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cpx79"]
Jul 02 19:51:25.948706 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:25.948686    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:25.948819 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:25.948797    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:25.952290 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:25.952245    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ktd42"]
Jul 02 19:51:25.952406 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:25.952315    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lskk6"]
Jul 02 19:51:25.952406 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:25.952377    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:25.952518 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:25.952474    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:25.952632 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:25.952550    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:25.952678 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:25.952635    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:26.416030 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:26.415944    2556 generic.go:356] "Generic (PLEG): container finished" podID="40bf2d56-28e2-45ff-b807-2c3517a4e7d6" containerID="9bd994881f0e2672d4c67da4cdd22ae66d4d834245003c1858a03bfb46519147" exitCode=0
Jul 02 19:51:26.416397 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:26.416020    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnpsf" event={"ID":"40bf2d56-28e2-45ff-b807-2c3517a4e7d6","Type":"ContainerDied","Data":"9bd994881f0e2672d4c67da4cdd22ae66d4d834245003c1858a03bfb46519147"}
Jul 02 19:51:27.190682 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:27.190491    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:27.190875 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:27.190489    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:27.190875 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:27.190773    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:27.190875 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:27.190865    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:28.191084 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:28.190993    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:28.191582 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:28.191112    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:28.423748 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:28.423713    2556 generic.go:356] "Generic (PLEG): container finished" podID="40bf2d56-28e2-45ff-b807-2c3517a4e7d6" containerID="0942797fbb53b164af5476c303e45d9ef7bd46fc4308d310cacf7baf3f8c83a8" exitCode=0
Jul 02 19:51:28.423911 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:28.423762    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnpsf" event={"ID":"40bf2d56-28e2-45ff-b807-2c3517a4e7d6","Type":"ContainerDied","Data":"0942797fbb53b164af5476c303e45d9ef7bd46fc4308d310cacf7baf3f8c83a8"}
Jul 02 19:51:29.190603 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:29.190557    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:29.190774 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:29.190694    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:29.190856 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:29.190804    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:29.190951 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:29.190931    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:29.585178 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:29.585144    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:29.678236 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:29.678196    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:29.742910 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:29.742877    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:29.808007 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:29.807976    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:29.808162 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:29.808021    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs\") pod \"network-metrics-daemon-cpx79\" (UID: \"77025d92-7c39-45a3-a54c-4ff7a1ec2d39\") " pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:29.808162 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:29.808150    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:29.808162 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:29.808154    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:29.808310 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:29.808222    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret podName:5f320b8c-773b-46d2-b6ae-4057cf92f04b nodeName:}" failed. No retries permitted until 2026-07-02 19:52:01.808201896 +0000 UTC m=+66.170348958 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret") pod "global-pull-secret-syncer-ktd42" (UID: "5f320b8c-773b-46d2-b6ae-4057cf92f04b") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:29.808310 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:29.808242    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs podName:77025d92-7c39-45a3-a54c-4ff7a1ec2d39 nodeName:}" failed. No retries permitted until 2026-07-02 19:52:01.808233858 +0000 UTC m=+66.170380901 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs") pod "network-metrics-daemon-cpx79" (UID: "77025d92-7c39-45a3-a54c-4ff7a1ec2d39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:30.009464 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:30.009425    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs79w\" (UniqueName: \"kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w\") pod \"network-check-target-lskk6\" (UID: \"8e059bc7-1ecb-40a6-8123-36df05326642\") " pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:30.009660 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:30.009567    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:51:30.009660 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:30.009582    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:51:30.009660 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:30.009590    2556 projected.go:196] Error preparing data for projected volume kube-api-access-fs79w for pod openshift-network-diagnostics/network-check-target-lskk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:30.009660 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:30.009653    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w podName:8e059bc7-1ecb-40a6-8123-36df05326642 nodeName:}" failed. No retries permitted until 2026-07-02 19:52:02.009633846 +0000 UTC m=+66.371780909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fs79w" (UniqueName: "kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w") pod "network-check-target-lskk6" (UID: "8e059bc7-1ecb-40a6-8123-36df05326642") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:30.190917 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:30.190883    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:30.191095 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:30.191002    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:30.494171 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:30.494127    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:30.570329 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:30.570295    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:31.190869 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:31.190844    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:31.191499 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:31.190941    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ktd42" podUID="5f320b8c-773b-46d2-b6ae-4057cf92f04b"
Jul 02 19:51:31.191499 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:31.190999    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:31.191499 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:31.191106    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpx79" podUID="77025d92-7c39-45a3-a54c-4ff7a1ec2d39"
Jul 02 19:51:32.191182 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.191141    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:32.191589 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:32.191297    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lskk6" podUID="8e059bc7-1ecb-40a6-8123-36df05326642"
Jul 02 19:51:32.407862 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.407835    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-14.ec2.internal" event="NodeReady"
Jul 02 19:51:32.408036 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.407989    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 19:51:32.438612 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.438581    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnpsf" event={"ID":"40bf2d56-28e2-45ff-b807-2c3517a4e7d6","Type":"ContainerStarted","Data":"9da80723c27d362b050d7aecd46edd99e835d9da4c9c8bd1634415c5039eef2e"}
Jul 02 19:51:32.452927 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.452902    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6wcxs"]
Jul 02 19:51:32.454458 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.454442    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9t45c"]
Jul 02 19:51:32.454569 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.454552    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:32.456189 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.456168    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9t45c"
Jul 02 19:51:32.456996 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.456978    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 19:51:32.457066 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.457004    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 19:51:32.457066 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.457049    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-67xbm\""
Jul 02 19:51:32.458359 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.458336    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 19:51:32.458503 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.458485    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 19:51:32.458593 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.458579    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 19:51:32.458723 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.458712    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wlfnm\""
Jul 02 19:51:32.464340 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.464316    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9t45c"]
Jul 02 19:51:32.468935 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.468894    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6wcxs"]
Jul 02 19:51:32.528420 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.528382    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d404999-9d77-4025-bc72-a748f54296dc-tmp-dir\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:32.528568 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.528454    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmdf2\" (UniqueName: \"kubernetes.io/projected/0d404999-9d77-4025-bc72-a748f54296dc-kube-api-access-lmdf2\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:32.528568 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.528489    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0d404999-9d77-4025-bc72-a748f54296dc-config-volume\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:32.528722 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.528703    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:32.629640 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.629601    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmdf2\" (UniqueName: \"kubernetes.io/projected/0d404999-9d77-4025-bc72-a748f54296dc-kube-api-access-lmdf2\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:32.629640 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.629641    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0d404999-9d77-4025-bc72-a748f54296dc-config-volume\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:32.629898 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.629664    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/346f0394-8012-4390-bc10-f96ac365960e-cert\") pod \"ingress-canary-9t45c\" (UID: \"346f0394-8012-4390-bc10-f96ac365960e\") " pod="openshift-ingress-canary/ingress-canary-9t45c"
Jul 02 19:51:32.629898 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.629781    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhp6b\" (UniqueName: \"kubernetes.io/projected/346f0394-8012-4390-bc10-f96ac365960e-kube-api-access-bhp6b\") pod \"ingress-canary-9t45c\" (UID: \"346f0394-8012-4390-bc10-f96ac365960e\") " pod="openshift-ingress-canary/ingress-canary-9t45c"
Jul 02 19:51:32.629898 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.629828    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:32.629898 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.629886    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d404999-9d77-4025-bc72-a748f54296dc-tmp-dir\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:32.629898 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:32.629900    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:51:32.630168 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:32.629959    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls podName:0d404999-9d77-4025-bc72-a748f54296dc nodeName:}" failed. No retries permitted until 2026-07-02 19:51:33.129937363 +0000 UTC m=+37.492084427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls") pod "dns-default-6wcxs" (UID: "0d404999-9d77-4025-bc72-a748f54296dc") : secret "dns-default-metrics-tls" not found
Jul 02 19:51:32.630168 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.630128    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d404999-9d77-4025-bc72-a748f54296dc-tmp-dir\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:32.630370 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.630350    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0d404999-9d77-4025-bc72-a748f54296dc-config-volume\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:32.642188 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.642061    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmdf2\" (UniqueName: \"kubernetes.io/projected/0d404999-9d77-4025-bc72-a748f54296dc-kube-api-access-lmdf2\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:32.730182 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.730154    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/346f0394-8012-4390-bc10-f96ac365960e-cert\") pod \"ingress-canary-9t45c\" (UID: \"346f0394-8012-4390-bc10-f96ac365960e\") " pod="openshift-ingress-canary/ingress-canary-9t45c"
Jul 02 19:51:32.730386 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.730199    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhp6b\" (UniqueName: \"kubernetes.io/projected/346f0394-8012-4390-bc10-f96ac365960e-kube-api-access-bhp6b\") pod \"ingress-canary-9t45c\" (UID: \"346f0394-8012-4390-bc10-f96ac365960e\") " pod="openshift-ingress-canary/ingress-canary-9t45c"
Jul 02 19:51:32.732962 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.732942    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/346f0394-8012-4390-bc10-f96ac365960e-cert\") pod \"ingress-canary-9t45c\" (UID: \"346f0394-8012-4390-bc10-f96ac365960e\") " pod="openshift-ingress-canary/ingress-canary-9t45c"
Jul 02 19:51:32.738881 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.738850    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhp6b\" (UniqueName: \"kubernetes.io/projected/346f0394-8012-4390-bc10-f96ac365960e-kube-api-access-bhp6b\") pod \"ingress-canary-9t45c\" (UID: \"346f0394-8012-4390-bc10-f96ac365960e\") " pod="openshift-ingress-canary/ingress-canary-9t45c"
Jul 02 19:51:32.774946 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.774907    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9t45c"
Jul 02 19:51:32.912813 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:32.912777    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9t45c"]
Jul 02 19:51:32.917776 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:51:32.917737    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346f0394_8012_4390_bc10_f96ac365960e.slice/crio-3d6e790a57b462ced1435f6738dc483e861926bc499060ac624716544b1ee8c9 WatchSource:0}: Error finding container 3d6e790a57b462ced1435f6738dc483e861926bc499060ac624716544b1ee8c9: Status 404 returned error can't find the container with id 3d6e790a57b462ced1435f6738dc483e861926bc499060ac624716544b1ee8c9
Jul 02 19:51:33.133045 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:33.132948    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:33.133194 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:33.133104    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:51:33.133194 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:33.133176    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls podName:0d404999-9d77-4025-bc72-a748f54296dc nodeName:}" failed. No retries permitted until 2026-07-02 19:51:34.133161254 +0000 UTC m=+38.495308294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls") pod "dns-default-6wcxs" (UID: "0d404999-9d77-4025-bc72-a748f54296dc") : secret "dns-default-metrics-tls" not found
Jul 02 19:51:33.191113 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:33.191077    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:51:33.191251 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:33.191126    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:51:33.193758 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:33.193740    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkjw9\""
Jul 02 19:51:33.193825 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:33.193796    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:51:33.193871 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:33.193857    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:51:33.442719 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:33.442632    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9t45c" event={"ID":"346f0394-8012-4390-bc10-f96ac365960e","Type":"ContainerStarted","Data":"3d6e790a57b462ced1435f6738dc483e861926bc499060ac624716544b1ee8c9"}
Jul 02 19:51:33.446173 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:33.446139    2556 generic.go:356] "Generic (PLEG): container finished" podID="40bf2d56-28e2-45ff-b807-2c3517a4e7d6" containerID="9da80723c27d362b050d7aecd46edd99e835d9da4c9c8bd1634415c5039eef2e" exitCode=0
Jul 02 19:51:33.446334 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:33.446200    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnpsf" event={"ID":"40bf2d56-28e2-45ff-b807-2c3517a4e7d6","Type":"ContainerDied","Data":"9da80723c27d362b050d7aecd46edd99e835d9da4c9c8bd1634415c5039eef2e"}
Jul 02 19:51:34.140842 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:34.140797    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:34.141013 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:34.140960    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:51:34.141072 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:34.141044    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls podName:0d404999-9d77-4025-bc72-a748f54296dc nodeName:}" failed. No retries permitted until 2026-07-02 19:51:36.141021745 +0000 UTC m=+40.503168789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls") pod "dns-default-6wcxs" (UID: "0d404999-9d77-4025-bc72-a748f54296dc") : secret "dns-default-metrics-tls" not found
Jul 02 19:51:34.190822 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:34.190788    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:51:34.193590 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:34.193565    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:51:34.194009 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:34.193587    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kmhzg\""
Jul 02 19:51:34.194009 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:34.193729    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:51:34.451967 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:34.451878    2556 generic.go:356] "Generic (PLEG): container finished" podID="40bf2d56-28e2-45ff-b807-2c3517a4e7d6" containerID="3c28f73bce2288378c0874fd24f6ec22eb5978985834e1bcf1d75a7bb335ff9c" exitCode=0
Jul 02 19:51:34.451967 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:34.451942    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnpsf" event={"ID":"40bf2d56-28e2-45ff-b807-2c3517a4e7d6","Type":"ContainerDied","Data":"3c28f73bce2288378c0874fd24f6ec22eb5978985834e1bcf1d75a7bb335ff9c"}
Jul 02 19:51:34.694526 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:34.694492    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:34.794900 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:34.794867    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:35.458135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:35.457917    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xnpsf" event={"ID":"40bf2d56-28e2-45ff-b807-2c3517a4e7d6","Type":"ContainerStarted","Data":"edb9b7f071a6421f92abb1a95c10286b95fafac8fecb90cc28bdc21650b5a95b"}
Jul 02 19:51:35.488814 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:35.488784    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:35.515348 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:35.515267    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xnpsf" podStartSLOduration=14.493628294 podStartE2EDuration="39.515249393s" totalImagesPullingTime="25.021621099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:35.514002005 +0000 UTC m=+39.876149067" watchObservedRunningTime="2026-07-02 19:51:35.515249393 +0000 UTC m=+39.877396455"
Jul 02 19:51:35.585140 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:35.585106    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:35.691512 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:35.691473    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:35.784438 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:35.784394    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:36.154549 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:36.154466    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:36.154697 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:36.154586    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:51:36.154697 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:36.154638    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls podName:0d404999-9d77-4025-bc72-a748f54296dc nodeName:}" failed. No retries permitted until 2026-07-02 19:51:40.154623882 +0000 UTC m=+44.516770923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls") pod "dns-default-6wcxs" (UID: "0d404999-9d77-4025-bc72-a748f54296dc") : secret "dns-default-metrics-tls" not found
Jul 02 19:51:36.448888 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:36.448800    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:36.461587 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:36.461554    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9t45c" event={"ID":"346f0394-8012-4390-bc10-f96ac365960e","Type":"ContainerStarted","Data":"e2a8b63838d0ca168fea8924bda29a412580fc714f26b31662455bf9169675c6"}
Jul 02 19:51:36.478398 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:36.478344    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9t45c" podStartSLOduration=1.86515568 podStartE2EDuration="4.478327575s" totalImagesPullingTime="2.613171895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:36.476721735 +0000 UTC m=+40.838868797" watchObservedRunningTime="2026-07-02 19:51:36.478327575 +0000 UTC m=+40.840474615"
Jul 02 19:51:36.549764 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:36.549729    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:37.295638 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.295608    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lc269"]
Jul 02 19:51:37.328292 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.328243    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lc269"]
Jul 02 19:51:37.328442 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.328381    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.330685 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.330661    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 19:51:37.330857 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.330830    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 19:51:37.330927 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.330855    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 19:51:37.330979 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.330937    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 19:51:37.331035 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.331015    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lvrrb\""
Jul 02 19:51:37.338702 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.338667    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:37.398597 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.398541    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:37.464405 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.464366    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98842346-982e-4a6e-9136-3efbd770ac86-crio-socket\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.464895 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.464413    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98842346-982e-4a6e-9136-3efbd770ac86-data-volume\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.464895 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.464477    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.464895 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.464533    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98842346-982e-4a6e-9136-3efbd770ac86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.464895 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.464559    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7v46\" (UniqueName: \"kubernetes.io/projected/98842346-982e-4a6e-9136-3efbd770ac86-kube-api-access-r7v46\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.552466 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.552388    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-mntd7"]
Jul 02 19:51:37.552629 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.552596    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:37.565215 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.565180    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.565367 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.565290    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98842346-982e-4a6e-9136-3efbd770ac86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.565367 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.565337    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7v46\" (UniqueName: \"kubernetes.io/projected/98842346-982e-4a6e-9136-3efbd770ac86-kube-api-access-r7v46\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.565567 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:37.565541    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:51:37.565650 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:37.565578    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:37.565650 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:37.565614    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98842346-982e-4a6e-9136-3efbd770ac86-kube-rbac-proxy-cm podName:98842346-982e-4a6e-9136-3efbd770ac86 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:38.065593142 +0000 UTC m=+42.427740202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98842346-982e-4a6e-9136-3efbd770ac86-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lc269" (UID: "98842346-982e-4a6e-9136-3efbd770ac86") : configmap "kube-rbac-proxy" not found
Jul 02 19:51:37.565650 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:37.565639    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls podName:98842346-982e-4a6e-9136-3efbd770ac86 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:38.06562148 +0000 UTC m=+42.427768532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lc269" (UID: "98842346-982e-4a6e-9136-3efbd770ac86") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:37.565812 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.565712    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98842346-982e-4a6e-9136-3efbd770ac86-crio-socket\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.565812 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.565744    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98842346-982e-4a6e-9136-3efbd770ac86-data-volume\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.566120 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.566095    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98842346-982e-4a6e-9136-3efbd770ac86-data-volume\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.566210 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.566190    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98842346-982e-4a6e-9136-3efbd770ac86-crio-socket\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.578399 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.578375    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-mntd7"]
Jul 02 19:51:37.578499 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.578466    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mntd7"
Jul 02 19:51:37.581566 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.581540    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6qss5\""
Jul 02 19:51:37.581566 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.581557    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 02 19:51:37.581724 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.581541    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 02 19:51:37.584928 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.584776    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7v46\" (UniqueName: \"kubernetes.io/projected/98842346-982e-4a6e-9136-3efbd770ac86-kube-api-access-r7v46\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:37.632784 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.632754    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:37.667073 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.667042    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mklkk\" (UniqueName: \"kubernetes.io/projected/437bbf26-d8c2-4325-84ae-a514ee741d67-kube-api-access-mklkk\") pod \"migrator-d57d58cc9-mntd7\" (UID: \"437bbf26-d8c2-4325-84ae-a514ee741d67\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mntd7"
Jul 02 19:51:37.723589 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.723555    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:37.767664 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.767627    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mklkk\" (UniqueName: \"kubernetes.io/projected/437bbf26-d8c2-4325-84ae-a514ee741d67-kube-api-access-mklkk\") pod \"migrator-d57d58cc9-mntd7\" (UID: \"437bbf26-d8c2-4325-84ae-a514ee741d67\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mntd7"
Jul 02 19:51:37.776154 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.776123    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:37.777154 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.777131    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mklkk\" (UniqueName: \"kubernetes.io/projected/437bbf26-d8c2-4325-84ae-a514ee741d67-kube-api-access-mklkk\") pod \"migrator-d57d58cc9-mntd7\" (UID: \"437bbf26-d8c2-4325-84ae-a514ee741d67\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mntd7"
Jul 02 19:51:37.891094 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:37.891008    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mntd7"
Jul 02 19:51:38.037172 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:38.036914    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-mntd7"]
Jul 02 19:51:38.041325 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:51:38.041295    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod437bbf26_d8c2_4325_84ae_a514ee741d67.slice/crio-a5061b42c59f2dfdae653e91eb1f4419e00b5c03ef88a7666e4e72bb51441ec7 WatchSource:0}: Error finding container a5061b42c59f2dfdae653e91eb1f4419e00b5c03ef88a7666e4e72bb51441ec7: Status 404 returned error can't find the container with id a5061b42c59f2dfdae653e91eb1f4419e00b5c03ef88a7666e4e72bb51441ec7
Jul 02 19:51:38.070346 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:38.070311    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:38.070491 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:38.070374    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98842346-982e-4a6e-9136-3efbd770ac86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:38.070491 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:38.070470    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:38.073616 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:38.070755    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:51:38.073616 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:38.070865    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98842346-982e-4a6e-9136-3efbd770ac86-kube-rbac-proxy-cm podName:98842346-982e-4a6e-9136-3efbd770ac86 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:39.070824616 +0000 UTC m=+43.432971674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98842346-982e-4a6e-9136-3efbd770ac86-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lc269" (UID: "98842346-982e-4a6e-9136-3efbd770ac86") : configmap "kube-rbac-proxy" not found
Jul 02 19:51:38.073616 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:38.070884    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls podName:98842346-982e-4a6e-9136-3efbd770ac86 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:39.070873503 +0000 UTC m=+43.433020543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lc269" (UID: "98842346-982e-4a6e-9136-3efbd770ac86") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:38.171878 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:38.171767    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:38.251508 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:38.251471    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:38.445124 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:38.445042    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:38.468791 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:38.468756    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mntd7" event={"ID":"437bbf26-d8c2-4325-84ae-a514ee741d67","Type":"ContainerStarted","Data":"a5061b42c59f2dfdae653e91eb1f4419e00b5c03ef88a7666e4e72bb51441ec7"}
Jul 02 19:51:38.546164 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:38.546130    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:38.845115 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:38.845079    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:38.945661 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:38.945631    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:39.077672 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:39.077636    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:39.077829 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:39.077689    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98842346-982e-4a6e-9136-3efbd770ac86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:39.077829 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:39.077754    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:51:39.077829 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:39.077789    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:39.077916 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:39.077845    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls podName:98842346-982e-4a6e-9136-3efbd770ac86 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:41.077831095 +0000 UTC m=+45.439978140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lc269" (UID: "98842346-982e-4a6e-9136-3efbd770ac86") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:39.077916 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:39.077863    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98842346-982e-4a6e-9136-3efbd770ac86-kube-rbac-proxy-cm podName:98842346-982e-4a6e-9136-3efbd770ac86 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:41.077853728 +0000 UTC m=+45.440000768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98842346-982e-4a6e-9136-3efbd770ac86-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lc269" (UID: "98842346-982e-4a6e-9136-3efbd770ac86") : configmap "kube-rbac-proxy" not found
Jul 02 19:51:39.383883 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:39.383850    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:39.484145 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:39.484114    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:39.489828 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:39.489808    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rcpst_829fd4e9-6a1f-4b4d-8cd3-42b944b487b2/dns-node-resolver/0.log"
Jul 02 19:51:40.079561 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:40.079483    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:40.090812 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:40.090790    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cdzpb_6c722c47-d54a-4fa2-98f5-07009751d2e3/node-ca/0.log"
Jul 02 19:51:40.180968 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:40.180936    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:40.186016 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:40.185992    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:40.186159 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:40.186142    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:51:40.186216 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:40.186202    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls podName:0d404999-9d77-4025-bc72-a748f54296dc nodeName:}" failed. No retries permitted until 2026-07-02 19:51:48.186187585 +0000 UTC m=+52.548334628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls") pod "dns-default-6wcxs" (UID: "0d404999-9d77-4025-bc72-a748f54296dc") : secret "dns-default-metrics-tls" not found
Jul 02 19:51:40.474865 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:40.474829    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mntd7" event={"ID":"437bbf26-d8c2-4325-84ae-a514ee741d67","Type":"ContainerStarted","Data":"bbd0f0f9ec43f53c53e7be1febdfc18b29011e902891ae9191f384940a546b17"}
Jul 02 19:51:40.475049 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:40.474887    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mntd7" event={"ID":"437bbf26-d8c2-4325-84ae-a514ee741d67","Type":"ContainerStarted","Data":"09bb6e5d67cadd84042356477fabc924dc674aa9a17d31c084707498aa0bf8c4"}
Jul 02 19:51:40.495690 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:40.495636    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mntd7" podStartSLOduration=1.7757107410000001 podStartE2EDuration="3.495616551s" totalImagesPullingTime="1.71990581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:40.495399507 +0000 UTC m=+44.857546570" watchObservedRunningTime="2026-07-02 19:51:40.495616551 +0000 UTC m=+44.857763615"
Jul 02 19:51:40.636327 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:40.636295    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:40.739972 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:40.739878    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:41.091471 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:41.091388    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9t45c_346f0394-8012-4390-bc10-f96ac365960e/serve-healthcheck-canary/0.log"
Jul 02 19:51:41.093544 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:41.093524    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98842346-982e-4a6e-9136-3efbd770ac86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:41.093620 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:41.093597    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:41.093700 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:41.093688    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:41.093747 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:41.093739    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls podName:98842346-982e-4a6e-9136-3efbd770ac86 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:45.093725967 +0000 UTC m=+49.455873010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lc269" (UID: "98842346-982e-4a6e-9136-3efbd770ac86") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:41.094108 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:41.094092    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98842346-982e-4a6e-9136-3efbd770ac86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:41.257941 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:41.257909    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:44.294701 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:44.294658    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:44.396040 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:44.395985    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:44.706184 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:44.706093    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:44.808565 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:44.808540    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:44.914421 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:44.914388    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:45.024122 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:45.024090    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:45.123693 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:45.123653    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:45.123870 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:45.123788    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:45.123870 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:51:45.123852    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls podName:98842346-982e-4a6e-9136-3efbd770ac86 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:53.123833354 +0000 UTC m=+57.485980397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lc269" (UID: "98842346-982e-4a6e-9136-3efbd770ac86") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:45.127742 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:45.127717    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:45.275634 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:45.275548    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:45.677955 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:45.677864    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:46.109898 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:46.109868    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:46.900251 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:46.900216    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:47.275758 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:47.275723    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:47.471532 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:47.471498    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:47.571991 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:47.571900    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:47.677745 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:47.675469    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:47.874923 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:47.874829    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:48.246077 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:48.246042    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:48.249584 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:48.249556    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d404999-9d77-4025-bc72-a748f54296dc-metrics-tls\") pod \"dns-default-6wcxs\" (UID: \"0d404999-9d77-4025-bc72-a748f54296dc\") " pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:48.368972 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:48.368932    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:48.472254 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:48.472181    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:48.519268 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:48.519179    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6wcxs"]
Jul 02 19:51:48.522146 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:51:48.522120    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d404999_9d77_4025_bc72_a748f54296dc.slice/crio-e309fb82a6406bbbee7eee901a44305e7025f8253295d2798130b4f14b72c8c4 WatchSource:0}: Error finding container e309fb82a6406bbbee7eee901a44305e7025f8253295d2798130b4f14b72c8c4: Status 404 returned error can't find the container with id e309fb82a6406bbbee7eee901a44305e7025f8253295d2798130b4f14b72c8c4
Jul 02 19:51:48.584332 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:48.584296    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:49.070492 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:49.070440    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:49.282690 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:49.282640    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:49.481585 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:49.481552    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:49.498993 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:49.498951    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6wcxs" event={"ID":"0d404999-9d77-4025-bc72-a748f54296dc","Type":"ContainerStarted","Data":"e309fb82a6406bbbee7eee901a44305e7025f8253295d2798130b4f14b72c8c4"}
Jul 02 19:51:49.582187 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:49.582154    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:49.682135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:49.682102    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:49.880631 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:49.880537    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:50.674781 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:50.674746    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:51.102659 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:51.102628    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:51.276469 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:51.276434    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:51.506497 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:51.506465    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6wcxs" event={"ID":"0d404999-9d77-4025-bc72-a748f54296dc","Type":"ContainerStarted","Data":"a38f5f5c22640607c0baa185f9cc5eeb5a69980e143a0936cf481f9c891af46f"}
Jul 02 19:51:51.506701 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:51.506523    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6wcxs" event={"ID":"0d404999-9d77-4025-bc72-a748f54296dc","Type":"ContainerStarted","Data":"4ebbc3848563e4f287139ccd2c28d9d8a389544ef0bc190b951b446daba1bfcb"}
Jul 02 19:51:51.506701 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:51.506587    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:51:51.524207 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:51.524156    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6wcxs" podStartSLOduration=17.59238584 podStartE2EDuration="19.524136906s" totalImagesPullingTime="1.931751066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:51.523441429 +0000 UTC m=+55.885588490" watchObservedRunningTime="2026-07-02 19:51:51.524136906 +0000 UTC m=+55.886283969"
Jul 02 19:51:51.734350 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:51.734312    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:52.085210 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:52.085173    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:52.317386 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:52.317354    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:52.471958 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:52.471929    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:52.917578 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:52.917495    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:53.082365 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:53.082332    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:53.181529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:53.181447    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:53.183751 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:53.183722    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98842346-982e-4a6e-9136-3efbd770ac86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc269\" (UID: \"98842346-982e-4a6e-9136-3efbd770ac86\") " pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:53.237266 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:53.237234    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lc269"
Jul 02 19:51:53.293228 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:53.293185    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:53.361057 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:53.361026    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lc269"]
Jul 02 19:51:53.364982 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:51:53.364948    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98842346_982e_4a6e_9136_3efbd770ac86.slice/crio-947a8a1084da374d679fe7fe303854e73710209542f339dd829204c805a8d306 WatchSource:0}: Error finding container 947a8a1084da374d679fe7fe303854e73710209542f339dd829204c805a8d306: Status 404 returned error can't find the container with id 947a8a1084da374d679fe7fe303854e73710209542f339dd829204c805a8d306
Jul 02 19:51:53.512720 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:53.512682    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lc269" event={"ID":"98842346-982e-4a6e-9136-3efbd770ac86","Type":"ContainerStarted","Data":"947a8a1084da374d679fe7fe303854e73710209542f339dd829204c805a8d306"}
Jul 02 19:51:53.678676 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:53.678638    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:53.839543 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:53.839439    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:53.940401 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:53.940334    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:54.277969 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:54.277905    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:54.668143 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:54.668062    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:55.071264 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:55.071227    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:55.327855 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:55.327772    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:55.474462 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:55.474422    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:57.435625 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:57.435593    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j9dh9"
Jul 02 19:51:58.527520 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:58.527481    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lc269" event={"ID":"98842346-982e-4a6e-9136-3efbd770ac86","Type":"ContainerStarted","Data":"0ad0e85192a43bf5e270ce5388dd8560ca29fe0918906175a1f32f45be11c4ea"}
Jul 02 19:51:58.527889 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:58.527565    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lc269" event={"ID":"98842346-982e-4a6e-9136-3efbd770ac86","Type":"ContainerStarted","Data":"e8a2fcfc09bd75264a41b3fd1818e67f55dd1ff17e7d41b066172b3285a07ebf"}
Jul 02 19:51:59.981819 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:51:59.981761    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:00.082766 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:00.082725    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:00.140306 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:00.140254    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:00.278739 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:00.278608    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:00.660138 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:00.660050    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:00.764989 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:00.764940    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:01.172801 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:01.172769    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:01.301327 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:01.301295    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:01.365318 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:01.365292    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:01.511737 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:01.511714    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6wcxs"
Jul 02 19:52:01.538713 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:01.538682    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lc269" event={"ID":"98842346-982e-4a6e-9136-3efbd770ac86","Type":"ContainerStarted","Data":"a5791d8da472006f1eca2c18dfbdd79bf61c646e94af7d5c43df8b233afa9749"}
Jul 02 19:52:01.560596 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:01.560541    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lc269" podStartSLOduration=17.182549239 podStartE2EDuration="24.560522446s" totalImagesPullingTime="7.377973207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:51:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:01.560238943 +0000 UTC m=+65.922386005" watchObservedRunningTime="2026-07-02 19:52:01.560522446 +0000 UTC m=+65.922669509"
Jul 02 19:52:01.687717 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:01.687678    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:01.847057 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:01.846971    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:52:01.847057 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:01.847028    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs\") pod \"network-metrics-daemon-cpx79\" (UID: \"77025d92-7c39-45a3-a54c-4ff7a1ec2d39\") " pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:52:01.854805 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:01.854782    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:52:01.855114 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:01.855096    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:52:01.860351 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:01.860330    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77025d92-7c39-45a3-a54c-4ff7a1ec2d39-metrics-certs\") pod \"network-metrics-daemon-cpx79\" (UID: \"77025d92-7c39-45a3-a54c-4ff7a1ec2d39\") " pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:52:01.860455 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:01.860381    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f320b8c-773b-46d2-b6ae-4057cf92f04b-original-pull-secret\") pod \"global-pull-secret-syncer-ktd42\" (UID: \"5f320b8c-773b-46d2-b6ae-4057cf92f04b\") " pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:52:02.001200 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.001161    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ktd42"
Jul 02 19:52:02.017823 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.017800    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkjw9\""
Jul 02 19:52:02.026899 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.026871    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpx79"
Jul 02 19:52:02.048216 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.048183    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs79w\" (UniqueName: \"kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w\") pod \"network-check-target-lskk6\" (UID: \"8e059bc7-1ecb-40a6-8123-36df05326642\") " pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:52:02.056401 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.056357    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:52:02.059487 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.059456    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:02.061007 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.060988    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:52:02.072854 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.072779    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs79w\" (UniqueName: \"kubernetes.io/projected/8e059bc7-1ecb-40a6-8123-36df05326642-kube-api-access-fs79w\") pod \"network-check-target-lskk6\" (UID: \"8e059bc7-1ecb-40a6-8123-36df05326642\") " pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:52:02.104459 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.104382    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kmhzg\""
Jul 02 19:52:02.111868 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.111839    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:52:02.129606 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.129567    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj"]
Jul 02 19:52:02.134396 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.133733    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"]
Jul 02 19:52:02.135259 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.134872    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj"
Jul 02 19:52:02.136906 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.136882    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.139525 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.139471    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 19:52:02.141460 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.140587    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-lx6bz\""
Jul 02 19:52:02.141460 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.140703    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 19:52:02.145816 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.144095    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 19:52:02.146716 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.146687    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj"]
Jul 02 19:52:02.146916 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.146896    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 02 19:52:02.147137 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.147117    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 02 19:52:02.147307 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.147266    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 02 19:52:02.147751 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.147730    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 02 19:52:02.147983 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.147966    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 02 19:52:02.148073 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.148055    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"]
Jul 02 19:52:02.148638 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.148616    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-hub\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.148688 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.148653    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.148756 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.148685    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-ca\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.148803 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.148773    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88np8\" (UniqueName: \"kubernetes.io/projected/e666bc76-1f38-475a-a088-9e84bbe95220-kube-api-access-88np8\") pod \"managed-serviceaccount-addon-agent-7849975544-8vdhj\" (UID: \"e666bc76-1f38-475a-a088-9e84bbe95220\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj"
Jul 02 19:52:02.148837 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.148814    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.148876 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.148839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfbws\" (UniqueName: \"kubernetes.io/projected/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-kube-api-access-xfbws\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.148917 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.148899    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.149009 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.148923    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e666bc76-1f38-475a-a088-9e84bbe95220-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7849975544-8vdhj\" (UID: \"e666bc76-1f38-475a-a088-9e84bbe95220\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj"
Jul 02 19:52:02.155316 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.155236    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ktd42"]
Jul 02 19:52:02.166986 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:52:02.166205    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f320b8c_773b_46d2_b6ae_4057cf92f04b.slice/crio-1065cd0212987506c7ee75073985280489647727cb817cad5a2279ae345deefa WatchSource:0}: Error finding container 1065cd0212987506c7ee75073985280489647727cb817cad5a2279ae345deefa: Status 404 returned error can't find the container with id 1065cd0212987506c7ee75073985280489647727cb817cad5a2279ae345deefa
Jul 02 19:52:02.173530 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.173496    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:02.186697 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.186614    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cpx79"]
Jul 02 19:52:02.249812 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.249782    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88np8\" (UniqueName: \"kubernetes.io/projected/e666bc76-1f38-475a-a088-9e84bbe95220-kube-api-access-88np8\") pod \"managed-serviceaccount-addon-agent-7849975544-8vdhj\" (UID: \"e666bc76-1f38-475a-a088-9e84bbe95220\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj"
Jul 02 19:52:02.249994 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.249816    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.249994 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.249836    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfbws\" (UniqueName: \"kubernetes.io/projected/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-kube-api-access-xfbws\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.249994 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.249860    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.250156 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.250030    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e666bc76-1f38-475a-a088-9e84bbe95220-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7849975544-8vdhj\" (UID: \"e666bc76-1f38-475a-a088-9e84bbe95220\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj"
Jul 02 19:52:02.250156 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.250074    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-hub\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.250156 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.250101    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.250341 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.250233    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-ca\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.250787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.250721    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.252564 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.252540    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-ca\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.252818 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.252798    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-hub\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.252862 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.252836    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.252894 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.252840    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.252947 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.252921    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e666bc76-1f38-475a-a088-9e84bbe95220-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7849975544-8vdhj\" (UID: \"e666bc76-1f38-475a-a088-9e84bbe95220\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj"
Jul 02 19:52:02.265494 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.265470    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lskk6"]
Jul 02 19:52:02.268590 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:52:02.268566    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e059bc7_1ecb_40a6_8123_36df05326642.slice/crio-e5d4249bd04730e0831cb0f6e8727899f544b07f1248e3c069992e7bb1a97646 WatchSource:0}: Error finding container e5d4249bd04730e0831cb0f6e8727899f544b07f1248e3c069992e7bb1a97646: Status 404 returned error can't find the container with id e5d4249bd04730e0831cb0f6e8727899f544b07f1248e3c069992e7bb1a97646
Jul 02 19:52:02.271028 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.271000    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfbws\" (UniqueName: \"kubernetes.io/projected/37cbeaeb-b74c-4ea4-a6fd-90da00e21391-kube-api-access-xfbws\") pod \"cluster-proxy-proxy-agent-77fb585cf4-m46l8\" (UID: \"37cbeaeb-b74c-4ea4-a6fd-90da00e21391\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.271518 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.271500    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88np8\" (UniqueName: \"kubernetes.io/projected/e666bc76-1f38-475a-a088-9e84bbe95220-kube-api-access-88np8\") pod \"managed-serviceaccount-addon-agent-7849975544-8vdhj\" (UID: \"e666bc76-1f38-475a-a088-9e84bbe95220\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj"
Jul 02 19:52:02.324944 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.324899    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:02.409365 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.409241    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:02.466865 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.466835    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj"
Jul 02 19:52:02.475216 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.475190    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"
Jul 02 19:52:02.508208 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.508169    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:02.544238 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.544123    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cpx79" event={"ID":"77025d92-7c39-45a3-a54c-4ff7a1ec2d39","Type":"ContainerStarted","Data":"ae4248191cc1a9b066ea381578ee16bf0d348798ac27811b5103fc6cf77c4180"}
Jul 02 19:52:02.545395 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.545370    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lskk6" event={"ID":"8e059bc7-1ecb-40a6-8123-36df05326642","Type":"ContainerStarted","Data":"e5d4249bd04730e0831cb0f6e8727899f544b07f1248e3c069992e7bb1a97646"}
Jul 02 19:52:02.546764 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.546741    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ktd42" event={"ID":"5f320b8c-773b-46d2-b6ae-4057cf92f04b","Type":"ContainerStarted","Data":"1065cd0212987506c7ee75073985280489647727cb817cad5a2279ae345deefa"}
Jul 02 19:52:02.588228 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.588164    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:02.610917 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.610884    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj"]
Jul 02 19:52:02.614842 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:52:02.614811    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode666bc76_1f38_475a_a088_9e84bbe95220.slice/crio-baa4848bd510bed01894b22d5da9f90e7aba824ac136f737ff4d5b70fa522eb2 WatchSource:0}: Error finding container baa4848bd510bed01894b22d5da9f90e7aba824ac136f737ff4d5b70fa522eb2: Status 404 returned error can't find the container with id baa4848bd510bed01894b22d5da9f90e7aba824ac136f737ff4d5b70fa522eb2
Jul 02 19:52:02.633112 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:02.633081    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8"]
Jul 02 19:52:02.637211 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:52:02.637175    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37cbeaeb_b74c_4ea4_a6fd_90da00e21391.slice/crio-2dc7487ebf63f90e6deafb9bcdcafcc603b049d948c305d683b07518c88cff7f WatchSource:0}: Error finding container 2dc7487ebf63f90e6deafb9bcdcafcc603b049d948c305d683b07518c88cff7f: Status 404 returned error can't find the container with id 2dc7487ebf63f90e6deafb9bcdcafcc603b049d948c305d683b07518c88cff7f
Jul 02 19:52:03.298732 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:03.298668    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:03.353240 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:03.353206    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:03.552463 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:03.552347    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj" event={"ID":"e666bc76-1f38-475a-a088-9e84bbe95220","Type":"ContainerStarted","Data":"baa4848bd510bed01894b22d5da9f90e7aba824ac136f737ff4d5b70fa522eb2"}
Jul 02 19:52:03.554162 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:03.554125    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8" event={"ID":"37cbeaeb-b74c-4ea4-a6fd-90da00e21391","Type":"ContainerStarted","Data":"2dc7487ebf63f90e6deafb9bcdcafcc603b049d948c305d683b07518c88cff7f"}
Jul 02 19:52:03.992869 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:03.992823    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:04.105180 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:04.100818    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:04.183837 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:04.183794    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:04.575835 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:04.575012    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cpx79" event={"ID":"77025d92-7c39-45a3-a54c-4ff7a1ec2d39","Type":"ContainerStarted","Data":"83c1ec47222f5fa182a1f8dbb1676903ae9d960aa7439c5dcb672bdb9890ea25"}
Jul 02 19:52:04.575835 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:04.575113    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cpx79" event={"ID":"77025d92-7c39-45a3-a54c-4ff7a1ec2d39","Type":"ContainerStarted","Data":"a3462e5e1d6696feba178d72c0dd565c5783c7678245e579d7e9a196e0877641"}
Jul 02 19:52:04.594962 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:04.594829    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cpx79" podStartSLOduration=67.050502528 podStartE2EDuration="1m8.594807863s" totalImagesPullingTime="1.544305335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:04.594400355 +0000 UTC m=+68.956547417" watchObservedRunningTime="2026-07-02 19:52:04.594807863 +0000 UTC m=+68.956954927"
Jul 02 19:52:04.687875 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:04.687790    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:04.790484 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:04.790413    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:05.330456 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:05.330423    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:05.774243 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:05.774207    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:05.843722 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:05.843639    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:05.905946 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:05.905912    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:06.562800 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:06.562752    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:06.664095 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:06.664057    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:06.777548 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:06.777510    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:07.080626 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:07.080591    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:07.181598 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:07.181563    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:07.241523 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:07.241491    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:08.862417 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:08.862364    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:08.964607 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:08.964570    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:10.599737 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:10.599699    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lskk6" event={"ID":"8e059bc7-1ecb-40a6-8123-36df05326642","Type":"ContainerStarted","Data":"b4008e53f79dbcf6b67ddcd7a61c0bfb7c86cca123b721aaefc2b850e63a34aa"}
Jul 02 19:52:10.600515 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:10.599813    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:52:10.601455 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:10.601428    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ktd42" event={"ID":"5f320b8c-773b-46d2-b6ae-4057cf92f04b","Type":"ContainerStarted","Data":"4497786124ed8b998f6b99f556ab43e42e51c6d5980eec32c552155bc3b49923"}
Jul 02 19:52:10.602853 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:10.602830    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj" event={"ID":"e666bc76-1f38-475a-a088-9e84bbe95220","Type":"ContainerStarted","Data":"1b1ce951c71faaa4e5845e0194e0ee05be8577c7e20a80a6a0f497eacc9b8471"}
Jul 02 19:52:10.604769 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:10.604748    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8" event={"ID":"37cbeaeb-b74c-4ea4-a6fd-90da00e21391","Type":"ContainerStarted","Data":"35cf5a775d3ac3ba46e95e0d197394fa8410b862355a41905717649d008a8acc"}
Jul 02 19:52:10.604872 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:10.604782    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8" event={"ID":"37cbeaeb-b74c-4ea4-a6fd-90da00e21391","Type":"ContainerStarted","Data":"38cbdc1fe4e052dee4ccddb638e7a5d59f1c22393cfd6fbcdcbdeeca805d2832"}
Jul 02 19:52:10.604872 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:10.604799    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8" event={"ID":"37cbeaeb-b74c-4ea4-a6fd-90da00e21391","Type":"ContainerStarted","Data":"40249ed4c20354e23f09e5f542b58a96c82a9d231a24c6ecd681bfe265e06b9b"}
Jul 02 19:52:10.635022 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:10.634896    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lskk6" podStartSLOduration=66.953140082 podStartE2EDuration="1m14.63487488s" totalImagesPullingTime="7.681734798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:10.620238785 +0000 UTC m=+74.982385852" watchObservedRunningTime="2026-07-02 19:52:10.63487488 +0000 UTC m=+74.997021943"
Jul 02 19:52:10.635452 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:10.635418    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7849975544-8vdhj" podStartSLOduration=1.301618312 podStartE2EDuration="8.635405236s" totalImagesPullingTime="7.333786924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:10.634717944 +0000 UTC m=+74.996865006" watchObservedRunningTime="2026-07-02 19:52:10.635405236 +0000 UTC m=+74.997552317"
Jul 02 19:52:10.655896 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:10.655834    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fb585cf4-m46l8" podStartSLOduration=1.3329844739999999 podStartE2EDuration="8.655814698s" totalImagesPullingTime="7.322830224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:10.655613473 +0000 UTC m=+75.017760537" watchObservedRunningTime="2026-07-02 19:52:10.655814698 +0000 UTC m=+75.017961762"
Jul 02 19:52:10.670882 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:10.670829    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ktd42" podStartSLOduration=66.896932497 podStartE2EDuration="1m14.670814765s" totalImagesPullingTime="7.773882268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:10.670244332 +0000 UTC m=+75.032391394" watchObservedRunningTime="2026-07-02 19:52:10.670814765 +0000 UTC m=+75.032961828"
Jul 02 19:52:11.208995 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:11.208961    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:11.310083 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:11.310047    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:13.174923 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:13.174888    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:13.278564 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:13.278536    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:13.375555 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:13.375522    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:15.507501 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:15.507467    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:15.609154 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:15.609119    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:15.667734 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:15.667698    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:16.166416 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:16.166388    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:16.265900 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:16.265867    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:17.751932 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:17.751900    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:18.894702 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:18.894658    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:19.608751 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:19.608710    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:19.673578 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:19.673539    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:23.549633 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:23.549591    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:24.097978 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:24.097945    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:24.791635 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:24.791603    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:24.856772 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:24.856743    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:25.907720 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:25.907686    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:26.008776 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.008730    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:26.348379 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.348344    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:26.556686 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.556653    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:26.652293 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.652182    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fdq5h"]
Jul 02 19:52:26.658033 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.658006    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.660668 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.660624    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 19:52:26.660856 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.660841    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 19:52:26.660925 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.660882    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 19:52:26.660925 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.660885    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 19:52:26.661473 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.661453    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 19:52:26.661537 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.661488    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2q68n\""
Jul 02 19:52:26.661589 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.661580    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 19:52:26.698369 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.698339    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:26.721537 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.721503    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-wtmp\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.721537 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.721536    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.721747 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.721555    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-tls\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.721747 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.721607    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.721747 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.721634    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-root\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.721747 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.721692    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-sys\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.721747 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.721709    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvxph\" (UniqueName: \"kubernetes.io/projected/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-kube-api-access-rvxph\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.721747 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.721731    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-textfile\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.721940 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.721824    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-metrics-client-ca\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.787563 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.787533    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:26.822786 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.822745    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-sys\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.822786 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.822787    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvxph\" (UniqueName: \"kubernetes.io/projected/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-kube-api-access-rvxph\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.823020 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.822810    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-textfile\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.823020 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.822849    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-metrics-client-ca\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.823020 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.822857    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-sys\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.823020 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.822876    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-wtmp\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.823020 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.822902    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.823020 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.822930    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-tls\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.823020 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.822960    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.823020 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.822982    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-root\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.823436 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.823043    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-wtmp\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.823436 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.823070    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-root\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.823436 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.823372    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-textfile\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.823621 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.823602    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-metrics-client-ca\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.823674 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.823656    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-accelerators-collector-config\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.825303 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.825287    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.825502 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.825485    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-node-exporter-tls\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.837659 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.837634    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvxph\" (UniqueName: \"kubernetes.io/projected/994ad059-8b9b-4abc-9e2f-e7b25aeaf843-kube-api-access-rvxph\") pod \"node-exporter-fdq5h\" (UID: \"994ad059-8b9b-4abc-9e2f-e7b25aeaf843\") " pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.888532 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.888495    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:26.966945 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:26.966874    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fdq5h"
Jul 02 19:52:26.980044 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:52:26.979998    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994ad059_8b9b_4abc_9e2f_e7b25aeaf843.slice/crio-a06bce37d0a5fd46e2b317b4e0b1147ced4f179bd8d910f5f18b80daa7997470 WatchSource:0}: Error finding container a06bce37d0a5fd46e2b317b4e0b1147ced4f179bd8d910f5f18b80daa7997470: Status 404 returned error can't find the container with id a06bce37d0a5fd46e2b317b4e0b1147ced4f179bd8d910f5f18b80daa7997470
Jul 02 19:52:27.058632 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:27.058599    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:27.152241 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:27.152206    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:27.505724 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:27.505696    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:27.608696 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:27.608664    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:27.663690 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:27.663639    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdq5h" event={"ID":"994ad059-8b9b-4abc-9e2f-e7b25aeaf843","Type":"ContainerStarted","Data":"a06bce37d0a5fd46e2b317b4e0b1147ced4f179bd8d910f5f18b80daa7997470"}
Jul 02 19:52:27.676399 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:27.676365    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:27.752265 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:27.752228    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:27.839457 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:27.839377    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:27.938048 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:27.938018    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:28.011550 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.011501    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:28.597536 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.597505    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6879868db8-tqmrc"]
Jul 02 19:52:28.603501 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.603475    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:28.619528 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.619495    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6879868db8-tqmrc"]
Jul 02 19:52:28.619668 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.619593    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.621916 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.621892    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 02 19:52:28.622121 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.622108    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 02 19:52:28.622354 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.622262    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 02 19:52:28.622354 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.622311    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pqssf\""
Jul 02 19:52:28.622354 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.622332    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 02 19:52:28.622532 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.622358    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 02 19:52:28.622620 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.622605    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-braj7km2mbap3\""
Jul 02 19:52:28.668226 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.668195    2556 generic.go:356] "Generic (PLEG): container finished" podID="994ad059-8b9b-4abc-9e2f-e7b25aeaf843" containerID="1c82890132b19b240a932eac1c83544c785b75f7747e19e0509ac366446e1017" exitCode=0
Jul 02 19:52:28.668401 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.668267    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdq5h" event={"ID":"994ad059-8b9b-4abc-9e2f-e7b25aeaf843","Type":"ContainerDied","Data":"1c82890132b19b240a932eac1c83544c785b75f7747e19e0509ac366446e1017"}
Jul 02 19:52:28.736945 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.736919    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.737084 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.736955    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.737084 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.736977    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-grpc-tls\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.737084 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.737042    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dbq8\" (UniqueName: \"kubernetes.io/projected/9981b0a4-8efd-47e8-89b9-df6159fab993-kube-api-access-2dbq8\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.737084 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.737075    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-tls\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.737266 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.737109    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9981b0a4-8efd-47e8-89b9-df6159fab993-metrics-client-ca\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.737266 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.737170    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.737266 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.737255    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.838538 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.838504    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-tls\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.838689 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.838557    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9981b0a4-8efd-47e8-89b9-df6159fab993-metrics-client-ca\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.838689 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.838589    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.838689 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.838613    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.838689 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.838653    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.838689 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.838685    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.838935 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.838715    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-grpc-tls\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.838935 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.838778    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dbq8\" (UniqueName: \"kubernetes.io/projected/9981b0a4-8efd-47e8-89b9-df6159fab993-kube-api-access-2dbq8\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.839426 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.839398    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9981b0a4-8efd-47e8-89b9-df6159fab993-metrics-client-ca\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.841253 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.841227    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-tls\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.841253 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.841242    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.841799 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.841772    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.841880 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.841781    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-grpc-tls\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.841880 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.841823    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.841961 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.841889    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9981b0a4-8efd-47e8-89b9-df6159fab993-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.846767 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.846746    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dbq8\" (UniqueName: \"kubernetes.io/projected/9981b0a4-8efd-47e8-89b9-df6159fab993-kube-api-access-2dbq8\") pod \"thanos-querier-6879868db8-tqmrc\" (UID: \"9981b0a4-8efd-47e8-89b9-df6159fab993\") " pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:28.928440 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:28.928404    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:29.066023 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:29.065996    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6879868db8-tqmrc"]
Jul 02 19:52:29.068371 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:52:29.068342    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9981b0a4_8efd_47e8_89b9_df6159fab993.slice/crio-b5da44d042ea8201b9f935df80412a143353a9ed8bcffda8ee7b48ab8bc74c85 WatchSource:0}: Error finding container b5da44d042ea8201b9f935df80412a143353a9ed8bcffda8ee7b48ab8bc74c85: Status 404 returned error can't find the container with id b5da44d042ea8201b9f935df80412a143353a9ed8bcffda8ee7b48ab8bc74c85
Jul 02 19:52:29.155455 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:29.155374    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:29.256495 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:29.256458    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:29.675757 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:29.675722    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdq5h" event={"ID":"994ad059-8b9b-4abc-9e2f-e7b25aeaf843","Type":"ContainerStarted","Data":"edf2a15969e121043b4099ec0a556fde344784fde2fcef2d9d471b5914495d43"}
Jul 02 19:52:29.675962 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:29.675795    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fdq5h" event={"ID":"994ad059-8b9b-4abc-9e2f-e7b25aeaf843","Type":"ContainerStarted","Data":"672f4dff1a256c9554a0cf00da7b32f27c90ba8fde5069df6531277d37daf152"}
Jul 02 19:52:29.677143 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:29.677115    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc" event={"ID":"9981b0a4-8efd-47e8-89b9-df6159fab993","Type":"ContainerStarted","Data":"b5da44d042ea8201b9f935df80412a143353a9ed8bcffda8ee7b48ab8bc74c85"}
Jul 02 19:52:29.699470 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:29.699406    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fdq5h" podStartSLOduration=2.473754108 podStartE2EDuration="3.69938895s" totalImagesPullingTime="1.154943992s" totalInitContainerRuntime="70.69085ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:29.698893288 +0000 UTC m=+94.061040351" watchObservedRunningTime="2026-07-02 19:52:29.69938895 +0000 UTC m=+94.061536038"
Jul 02 19:52:29.770577 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:29.770541    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:29.867536 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:29.867498    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:29.993466 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:29.993435    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:30.093533 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:30.093493    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:30.505511 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:30.505479    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:31.371430 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:31.371342    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:31.431352 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:31.431319    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:31.686113 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:31.686032    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc" event={"ID":"9981b0a4-8efd-47e8-89b9-df6159fab993","Type":"ContainerStarted","Data":"a3ab9bc5a493b21d2fe4ecd9bff0188ae9375ae65fd9da5a92bb9551d7cb32e8"}
Jul 02 19:52:31.686113 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:31.686096    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc" event={"ID":"9981b0a4-8efd-47e8-89b9-df6159fab993","Type":"ContainerStarted","Data":"2f1df858bd6d6157e384ded299011184dc86b00baa28721ffe5869e03066d731"}
Jul 02 19:52:31.686301 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:31.686122    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc" event={"ID":"9981b0a4-8efd-47e8-89b9-df6159fab993","Type":"ContainerStarted","Data":"5430dfa00e2297038e0ee6fbcdc3ce3127daca5962ffc8f37545001869b3e869"}
Jul 02 19:52:31.940511 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:31.940433    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:32.002661 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:32.002617    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:32.096610 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:32.096579    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:32.499371 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:32.499334    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:32.692338 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:32.692245    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc" event={"ID":"9981b0a4-8efd-47e8-89b9-df6159fab993","Type":"ContainerStarted","Data":"236b78a06facd7d27f9b5cc1de3c936b24a5b7fd5c2c3c7ab669c2ad66d0f7cd"}
Jul 02 19:52:32.692338 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:32.692334    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc" event={"ID":"9981b0a4-8efd-47e8-89b9-df6159fab993","Type":"ContainerStarted","Data":"1747820cd925a2f6b881dd5a1b88effeafae9d24dc2c75b962eb448b8895a974"}
Jul 02 19:52:32.692536 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:32.692368    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc" event={"ID":"9981b0a4-8efd-47e8-89b9-df6159fab993","Type":"ContainerStarted","Data":"ece4cf814a26afeea1c602a2872dc1a66ead50a720ce0601f623e69f1ebe31d0"}
Jul 02 19:52:32.692536 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:32.692428    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:32.716669 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:32.716611    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc" podStartSLOduration=1.617624537 podStartE2EDuration="4.716593758s" totalImagesPullingTime="3.098969221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:32.71481015 +0000 UTC m=+97.076957224" watchObservedRunningTime="2026-07-02 19:52:32.716593758 +0000 UTC m=+97.078740822"
Jul 02 19:52:32.889610 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:32.889580    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:38.701372 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:38.701340    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6879868db8-tqmrc"
Jul 02 19:52:38.837814 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:38.837779    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:38.901593 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:38.901537    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:41.610963 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:41.610933    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lskk6"
Jul 02 19:52:43.077383 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:43.077349    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:43.178541 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:43.178505    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:43.279935 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:43.279878    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:47.918405 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:47.918371    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:53.847890 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:53.847855    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:52:53.960165 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:52:53.960135    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:53:45.790736 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:53:45.790704    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:53:45.907380 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:53:45.907347    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:53:55.645172 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:53:55.645099    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:53:55.697532 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:53:55.697500    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:54:06.998465 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:54:06.998428    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:54:07.053719 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:54:07.053685    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:54:07.119928 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:54:07.119874    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:54:33.325993 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:54:33.325955    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:01.023374 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:01.023323    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:01.123919 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:01.123877    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:01.435320 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:01.435193    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:01.538527 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:01.538491    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:01.636700 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:01.636671    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:02.189868 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:02.189805    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:02.276208 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:02.276131    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:12.246976 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:12.246923    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:12.305332 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:12.305296    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:12.360519 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:12.360463    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:13.014234 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:13.014188    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:13.070399 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:13.070364    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:23.849610 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:23.849575    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:23.950042 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:23.950012    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:56.051984 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:56.051954    2556 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 19:55:57.323389 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:57.323356    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:58.702428 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:55:58.702393    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:00.042292 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:00.042240    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:24.004338 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:24.004254    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:24.984885 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:24.984848    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:27.622155 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:27.622126    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:27.722512 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:27.722482    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:28.898318 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:28.898260    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:29.005773 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:29.005740    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:29.982103 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:29.982067    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:30.074150 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:30.074122    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:30.997098 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:30.997067    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:31.993333 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:31.993300    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:32.170420 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:32.170388    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:35.002750 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:35.002719    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:35.103480 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:35.103449    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:37.902638 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:37.902605    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:38.003220 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:38.003179    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:40.782151 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:40.782116    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:43.418135 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:43.418099    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:43.525353 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:43.525321    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:45.126916 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.126883    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v"]
Jul 02 19:56:45.129929 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.129907    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v"
Jul 02 19:56:45.132564 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.132542    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:56:45.133636 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.133621    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2llh8\""
Jul 02 19:56:45.133715 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.133628    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 19:56:45.141936 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.141896    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v"]
Jul 02 19:56:45.219721 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.219682    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b392b1a2-f614-461b-a9a5-7e3e356b8e35-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8fr4v\" (UID: \"b392b1a2-f614-461b-a9a5-7e3e356b8e35\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v"
Jul 02 19:56:45.219721 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.219720    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfftn\" (UniqueName: \"kubernetes.io/projected/b392b1a2-f614-461b-a9a5-7e3e356b8e35-kube-api-access-mfftn\") pod \"openshift-lws-operator-fd8ccff4c-8fr4v\" (UID: \"b392b1a2-f614-461b-a9a5-7e3e356b8e35\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v"
Jul 02 19:56:45.320076 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.320020    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b392b1a2-f614-461b-a9a5-7e3e356b8e35-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8fr4v\" (UID: \"b392b1a2-f614-461b-a9a5-7e3e356b8e35\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v"
Jul 02 19:56:45.320076 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.320080    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfftn\" (UniqueName: \"kubernetes.io/projected/b392b1a2-f614-461b-a9a5-7e3e356b8e35-kube-api-access-mfftn\") pod \"openshift-lws-operator-fd8ccff4c-8fr4v\" (UID: \"b392b1a2-f614-461b-a9a5-7e3e356b8e35\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v"
Jul 02 19:56:45.320494 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.320472    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b392b1a2-f614-461b-a9a5-7e3e356b8e35-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8fr4v\" (UID: \"b392b1a2-f614-461b-a9a5-7e3e356b8e35\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v"
Jul 02 19:56:45.339676 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.339641    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfftn\" (UniqueName: \"kubernetes.io/projected/b392b1a2-f614-461b-a9a5-7e3e356b8e35-kube-api-access-mfftn\") pod \"openshift-lws-operator-fd8ccff4c-8fr4v\" (UID: \"b392b1a2-f614-461b-a9a5-7e3e356b8e35\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v"
Jul 02 19:56:45.438645 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.438562    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v"
Jul 02 19:56:45.576967 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.576930    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v"]
Jul 02 19:56:45.581172 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:56:45.581133    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb392b1a2_f614_461b_a9a5_7e3e356b8e35.slice/crio-d5bbcb0183fdcd06f9588954f44ffc0bb014b7ae90013158cdb08021fc38453e WatchSource:0}: Error finding container d5bbcb0183fdcd06f9588954f44ffc0bb014b7ae90013158cdb08021fc38453e: Status 404 returned error can't find the container with id d5bbcb0183fdcd06f9588954f44ffc0bb014b7ae90013158cdb08021fc38453e
Jul 02 19:56:45.583031 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:45.583014    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:56:46.532477 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:46.532415    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v" event={"ID":"b392b1a2-f614-461b-a9a5-7e3e356b8e35","Type":"ContainerStarted","Data":"d5bbcb0183fdcd06f9588954f44ffc0bb014b7ae90013158cdb08021fc38453e"}
Jul 02 19:56:48.541715 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:48.541679    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v" event={"ID":"b392b1a2-f614-461b-a9a5-7e3e356b8e35","Type":"ContainerStarted","Data":"8b72aa380ec7237ef59b2ac420b46fb6722ad220137148b6777e7456a1fd1a7a"}
Jul 02 19:56:48.558383 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:48.558330    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8fr4v" podStartSLOduration=0.933497753 podStartE2EDuration="3.558314134s" totalImagesPullingTime="2.624816381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:48.557337361 +0000 UTC m=+352.919484425" watchObservedRunningTime="2026-07-02 19:56:48.558314134 +0000 UTC m=+352.920461196"
Jul 02 19:56:49.289182 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:49.289138    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:49.389550 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:49.389521    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:51.354678 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:56:51.354643    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:03.721963 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:03.721927    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:03.991447 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:03.991358    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:04.696008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:04.695975    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:04.798181 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:04.798148    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:05.456291 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.456249    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:05.776737 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.776703    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:05.884249 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.884219    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:05.912116 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.912086    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"]
Jul 02 19:57:05.915594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.915573    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:05.920475 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.920443    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 19:57:05.920745 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.920729    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 19:57:05.921558 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.921537    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 19:57:05.921641 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.921565    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s6hdw\""
Jul 02 19:57:05.923626 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.923610    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 19:57:05.937054 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.937025    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"]
Jul 02 19:57:05.960524 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.960486    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-tmp\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:05.960715 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.960559    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmlgv\" (UniqueName: \"kubernetes.io/projected/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-kube-api-access-xmlgv\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:05.960715 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.960592    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-manifests\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:05.960715 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.960613    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:05.960715 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:05.960632    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:06.061386 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.061295    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmlgv\" (UniqueName: \"kubernetes.io/projected/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-kube-api-access-xmlgv\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:06.061386 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.061341    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-manifests\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:06.061386 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.061360    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:06.061386 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.061381    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:06.061724 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.061409    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-tmp\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:06.061783 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.061732    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-manifests\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:06.063631 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.063600    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-tmp\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:06.063960 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.063937    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:06.063960 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.063937    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:06.070572 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.070548    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmlgv\" (UniqueName: \"kubernetes.io/projected/f783ce27-7d7f-4dfe-9c57-5c78419d2ec3-kube-api-access-xmlgv\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7\" (UID: \"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:06.095401 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.095362    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:06.202190 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.202152    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:06.225410 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.225375    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:06.298768 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.298738    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:06.362686 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.362600    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"]
Jul 02 19:57:06.366986 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:57:06.366952    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf783ce27_7d7f_4dfe_9c57_5c78419d2ec3.slice/crio-1840d70b686d69d3e4abf1ba24c9b6142888a2210d413a62d5ca2bb16604462e WatchSource:0}: Error finding container 1840d70b686d69d3e4abf1ba24c9b6142888a2210d413a62d5ca2bb16604462e: Status 404 returned error can't find the container with id 1840d70b686d69d3e4abf1ba24c9b6142888a2210d413a62d5ca2bb16604462e
Jul 02 19:57:06.405065 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.405011    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:06.507799 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.507773    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:06.604356 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:06.604325    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7" event={"ID":"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3","Type":"ContainerStarted","Data":"1840d70b686d69d3e4abf1ba24c9b6142888a2210d413a62d5ca2bb16604462e"}
Jul 02 19:57:09.616476 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:09.616383    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7" event={"ID":"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3","Type":"ContainerStarted","Data":"f075107f7434b715db7ae0612685b8a830672d4832361f8a10fc82e9acd3c98a"}
Jul 02 19:57:10.621711 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:10.621678    2556 generic.go:356] "Generic (PLEG): container finished" podID="f783ce27-7d7f-4dfe-9c57-5c78419d2ec3" containerID="f075107f7434b715db7ae0612685b8a830672d4832361f8a10fc82e9acd3c98a" exitCode=0
Jul 02 19:57:10.622078 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:10.621724    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7" event={"ID":"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3","Type":"ContainerDied","Data":"f075107f7434b715db7ae0612685b8a830672d4832361f8a10fc82e9acd3c98a"}
Jul 02 19:57:11.626993 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:11.626952    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7" event={"ID":"f783ce27-7d7f-4dfe-9c57-5c78419d2ec3","Type":"ContainerStarted","Data":"456697c8d6932c2b688a2ae0acfbe1e61b6ada1cf2e4eda6dd5a6f2e2d081017"}
Jul 02 19:57:11.627374 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:11.627093    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:11.650871 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:11.650785    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7" podStartSLOduration=2.28237106 podStartE2EDuration="6.650756727s" totalImagesPullingTime="3.285089766s" totalInitContainerRuntime="1.083295901s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:11.649196079 +0000 UTC m=+376.011343119" watchObservedRunningTime="2026-07-02 19:57:11.650756727 +0000 UTC m=+376.012903788"
Jul 02 19:57:17.004478 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:17.004446    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:17.103912 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:17.103878    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:17.426144 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:17.426062    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:17.528119 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:17.528091    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:17.854875 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:17.854839    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:17.950515 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:17.950486    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:22.632921 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:22.632885    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7"
Jul 02 19:57:24.896020 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:24.895988    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:25.844802 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:25.844764    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:25.977871 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:25.977836    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:26.823357 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:26.823326    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bd6vw"]
Jul 02 19:57:26.832001 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:26.831978    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw"
Jul 02 19:57:26.836870 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:26.836838    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 02 19:57:26.837103 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:26.837082    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pqw9w\""
Jul 02 19:57:26.839596 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:26.839551    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bd6vw"]
Jul 02 19:57:26.907051 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:26.907021    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:26.927203 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:26.927163    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf6qr\" (UniqueName: \"kubernetes.io/projected/2e5d1976-c12b-447b-8f88-3fa010aa72fc-kube-api-access-wf6qr\") pod \"odh-model-controller-7998c67dc4-bd6vw\" (UID: \"2e5d1976-c12b-447b-8f88-3fa010aa72fc\") " pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw"
Jul 02 19:57:26.927385 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:26.927209    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e5d1976-c12b-447b-8f88-3fa010aa72fc-cert\") pod \"odh-model-controller-7998c67dc4-bd6vw\" (UID: \"2e5d1976-c12b-447b-8f88-3fa010aa72fc\") " pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw"
Jul 02 19:57:27.005336 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.005299    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:27.027626 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.027583    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf6qr\" (UniqueName: \"kubernetes.io/projected/2e5d1976-c12b-447b-8f88-3fa010aa72fc-kube-api-access-wf6qr\") pod \"odh-model-controller-7998c67dc4-bd6vw\" (UID: \"2e5d1976-c12b-447b-8f88-3fa010aa72fc\") " pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw"
Jul 02 19:57:27.027626 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.027620    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e5d1976-c12b-447b-8f88-3fa010aa72fc-cert\") pod \"odh-model-controller-7998c67dc4-bd6vw\" (UID: \"2e5d1976-c12b-447b-8f88-3fa010aa72fc\") " pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw"
Jul 02 19:57:27.027892 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:57:27.027751    2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 02 19:57:27.027892 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:57:27.027818    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e5d1976-c12b-447b-8f88-3fa010aa72fc-cert podName:2e5d1976-c12b-447b-8f88-3fa010aa72fc nodeName:}" failed. No retries permitted until 2026-07-02 19:57:27.527801537 +0000 UTC m=+391.889948582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2e5d1976-c12b-447b-8f88-3fa010aa72fc-cert") pod "odh-model-controller-7998c67dc4-bd6vw" (UID: "2e5d1976-c12b-447b-8f88-3fa010aa72fc") : secret "odh-model-controller-webhook-cert" not found
Jul 02 19:57:27.037501 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.037472    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf6qr\" (UniqueName: \"kubernetes.io/projected/2e5d1976-c12b-447b-8f88-3fa010aa72fc-kube-api-access-wf6qr\") pod \"odh-model-controller-7998c67dc4-bd6vw\" (UID: \"2e5d1976-c12b-447b-8f88-3fa010aa72fc\") " pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw"
Jul 02 19:57:27.105376 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.105291    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:27.343299 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.343224    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:27.400357 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.400259    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-prrxv"]
Jul 02 19:57:27.402389 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.402368    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-prrxv"
Jul 02 19:57:27.404750 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.404728    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 02 19:57:27.404750 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.404740    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8wvgp\""
Jul 02 19:57:27.414023 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.413990    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-prrxv"]
Jul 02 19:57:27.531662 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.531623    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e93e23-cdc6-4aa2-b12f-ed63d35290bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-prrxv\" (UID: \"28e93e23-cdc6-4aa2-b12f-ed63d35290bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-prrxv"
Jul 02 19:57:27.531662 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.531658    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9s7m\" (UniqueName: \"kubernetes.io/projected/28e93e23-cdc6-4aa2-b12f-ed63d35290bb-kube-api-access-w9s7m\") pod \"model-serving-api-54d89bd5fc-prrxv\" (UID: \"28e93e23-cdc6-4aa2-b12f-ed63d35290bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-prrxv"
Jul 02 19:57:27.531868 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.531755    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e5d1976-c12b-447b-8f88-3fa010aa72fc-cert\") pod \"odh-model-controller-7998c67dc4-bd6vw\" (UID: \"2e5d1976-c12b-447b-8f88-3fa010aa72fc\") " pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw"
Jul 02 19:57:27.534112 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.534090    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e5d1976-c12b-447b-8f88-3fa010aa72fc-cert\") pod \"odh-model-controller-7998c67dc4-bd6vw\" (UID: \"2e5d1976-c12b-447b-8f88-3fa010aa72fc\") " pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw"
Jul 02 19:57:27.540455 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.540432    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:27.632681 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.632644    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e93e23-cdc6-4aa2-b12f-ed63d35290bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-prrxv\" (UID: \"28e93e23-cdc6-4aa2-b12f-ed63d35290bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-prrxv"
Jul 02 19:57:27.632681 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.632681    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9s7m\" (UniqueName: \"kubernetes.io/projected/28e93e23-cdc6-4aa2-b12f-ed63d35290bb-kube-api-access-w9s7m\") pod \"model-serving-api-54d89bd5fc-prrxv\" (UID: \"28e93e23-cdc6-4aa2-b12f-ed63d35290bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-prrxv"
Jul 02 19:57:27.632883 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:57:27.632795    2556 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 02 19:57:27.632883 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:57:27.632862    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28e93e23-cdc6-4aa2-b12f-ed63d35290bb-tls-certs podName:28e93e23-cdc6-4aa2-b12f-ed63d35290bb nodeName:}" failed. No retries permitted until 2026-07-02 19:57:28.132845583 +0000 UTC m=+392.494992644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/28e93e23-cdc6-4aa2-b12f-ed63d35290bb-tls-certs") pod "model-serving-api-54d89bd5fc-prrxv" (UID: "28e93e23-cdc6-4aa2-b12f-ed63d35290bb") : secret "model-serving-api-tls" not found
Jul 02 19:57:27.644093 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.644065    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9s7m\" (UniqueName: \"kubernetes.io/projected/28e93e23-cdc6-4aa2-b12f-ed63d35290bb-kube-api-access-w9s7m\") pod \"model-serving-api-54d89bd5fc-prrxv\" (UID: \"28e93e23-cdc6-4aa2-b12f-ed63d35290bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-prrxv"
Jul 02 19:57:27.742566 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.742533    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw"
Jul 02 19:57:27.872448 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.872411    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bd6vw"]
Jul 02 19:57:27.875434 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:57:27.875398    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5d1976_c12b_447b_8f88_3fa010aa72fc.slice/crio-82c4ecdfa94545bd1200de38d32a92db0b596f09b84004da7b24de2d5a852e5a WatchSource:0}: Error finding container 82c4ecdfa94545bd1200de38d32a92db0b596f09b84004da7b24de2d5a852e5a: Status 404 returned error can't find the container with id 82c4ecdfa94545bd1200de38d32a92db0b596f09b84004da7b24de2d5a852e5a
Jul 02 19:57:27.974464 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:27.974412    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:28.138170 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:28.138085    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e93e23-cdc6-4aa2-b12f-ed63d35290bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-prrxv\" (UID: \"28e93e23-cdc6-4aa2-b12f-ed63d35290bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-prrxv"
Jul 02 19:57:28.140548 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:28.140527    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28e93e23-cdc6-4aa2-b12f-ed63d35290bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-prrxv\" (UID: \"28e93e23-cdc6-4aa2-b12f-ed63d35290bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-prrxv"
Jul 02 19:57:28.312445 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:28.312401    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-prrxv"
Jul 02 19:57:28.439660 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:28.439626    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-prrxv"]
Jul 02 19:57:28.442425 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:57:28.442398    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e93e23_cdc6_4aa2_b12f_ed63d35290bb.slice/crio-87931c3196c77a323955193598a4dc8e04f1b0ba68ead1462a82c0543465b3f3 WatchSource:0}: Error finding container 87931c3196c77a323955193598a4dc8e04f1b0ba68ead1462a82c0543465b3f3: Status 404 returned error can't find the container with id 87931c3196c77a323955193598a4dc8e04f1b0ba68ead1462a82c0543465b3f3
Jul 02 19:57:28.686482 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:28.686387    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-prrxv" event={"ID":"28e93e23-cdc6-4aa2-b12f-ed63d35290bb","Type":"ContainerStarted","Data":"87931c3196c77a323955193598a4dc8e04f1b0ba68ead1462a82c0543465b3f3"}
Jul 02 19:57:28.687673 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:28.687636    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw" event={"ID":"2e5d1976-c12b-447b-8f88-3fa010aa72fc","Type":"ContainerStarted","Data":"82c4ecdfa94545bd1200de38d32a92db0b596f09b84004da7b24de2d5a852e5a"}
Jul 02 19:57:31.702036 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:31.701994    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-prrxv" event={"ID":"28e93e23-cdc6-4aa2-b12f-ed63d35290bb","Type":"ContainerStarted","Data":"691d1d54a0af675e9f6ad3f9607040e1fccf55f34d0efd06688b732987bcfe07"}
Jul 02 19:57:31.702529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:31.702115    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-prrxv"
Jul 02 19:57:31.703661 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:31.703638    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw" event={"ID":"2e5d1976-c12b-447b-8f88-3fa010aa72fc","Type":"ContainerStarted","Data":"2901d9c3860903f783aa3744e6efb3e8ae8f051c1a0e5d309c465471d18d14c5"}
Jul 02 19:57:31.703773 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:31.703694    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw"
Jul 02 19:57:31.755481 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:31.755427    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-prrxv" podStartSLOduration=2.149735586 podStartE2EDuration="4.755410542s" totalImagesPullingTime="2.605674956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:31.733488097 +0000 UTC m=+396.095635158" watchObservedRunningTime="2026-07-02 19:57:31.755410542 +0000 UTC m=+396.117557607"
Jul 02 19:57:31.756288 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:31.756232    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw" podStartSLOduration=2.578412692 podStartE2EDuration="5.756213962s" totalImagesPullingTime="3.17780127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:31.756136009 +0000 UTC m=+396.118283070" watchObservedRunningTime="2026-07-02 19:57:31.756213962 +0000 UTC m=+396.118361026"
Jul 02 19:57:37.165109 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.165076    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:37.259818 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.259787    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"]
Jul 02 19:57:37.262144 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.262125    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"
Jul 02 19:57:37.272001 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.271978    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 19:57:37.272145 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.271998    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 19:57:37.272199 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.272162    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 19:57:37.272952 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.272937    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 19:57:37.273066 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.273051    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9r2xv\""
Jul 02 19:57:37.284665 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.284634    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:37.285037 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.285018    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"]
Jul 02 19:57:37.356071 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.356035    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"]
Jul 02 19:57:37.358363 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.358347    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"
Jul 02 19:57:37.362221 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.362194    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 02 19:57:37.362355 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.362223    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qhtmf\""
Jul 02 19:57:37.373862 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.373832    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"]
Jul 02 19:57:37.375003 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.374981    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp"]
Jul 02 19:57:37.376913 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.376898    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp"
Jul 02 19:57:37.380450 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.380431    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 02 19:57:37.380676 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.380661    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-rshrt\""
Jul 02 19:57:37.392922 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.392895    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp"]
Jul 02 19:57:37.410045 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.410012    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a982badb-8c88-4845-b7cc-3c3f02b57462-tls-certs\") pod \"kube-auth-proxy-79ff5d7d55-9sdcp\" (UID: \"a982badb-8c88-4845-b7cc-3c3f02b57462\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"
Jul 02 19:57:37.410225 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.410069    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a982badb-8c88-4845-b7cc-3c3f02b57462-tmp\") pod \"kube-auth-proxy-79ff5d7d55-9sdcp\" (UID: \"a982badb-8c88-4845-b7cc-3c3f02b57462\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"
Jul 02 19:57:37.410225 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.410156    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fwq9\" (UniqueName: \"kubernetes.io/projected/a982badb-8c88-4845-b7cc-3c3f02b57462-kube-api-access-7fwq9\") pod \"kube-auth-proxy-79ff5d7d55-9sdcp\" (UID: \"a982badb-8c88-4845-b7cc-3c3f02b57462\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"
Jul 02 19:57:37.421884 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.421805    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:37.510619 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.510583    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fd53444-4cea-4048-9565-5ed36cdab02b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cxpqp\" (UID: \"1fd53444-4cea-4048-9565-5ed36cdab02b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp"
Jul 02 19:57:37.510824 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.510631    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/358b6db0-b1e1-4e66-83d8-ad6cf6eeed50-cert\") pod \"kserve-controller-manager-d6f4b65b8-djdxw\" (UID: \"358b6db0-b1e1-4e66-83d8-ad6cf6eeed50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"
Jul 02 19:57:37.510824 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.510672    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp6wl\" (UniqueName: \"kubernetes.io/projected/1fd53444-4cea-4048-9565-5ed36cdab02b-kube-api-access-vp6wl\") pod \"llmisvc-controller-manager-777c6bd7d5-cxpqp\" (UID: \"1fd53444-4cea-4048-9565-5ed36cdab02b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp"
Jul 02 19:57:37.510824 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.510702    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a982badb-8c88-4845-b7cc-3c3f02b57462-tmp\") pod \"kube-auth-proxy-79ff5d7d55-9sdcp\" (UID: \"a982badb-8c88-4845-b7cc-3c3f02b57462\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"
Jul 02 19:57:37.510824 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.510728    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbjnm\" (UniqueName: \"kubernetes.io/projected/358b6db0-b1e1-4e66-83d8-ad6cf6eeed50-kube-api-access-nbjnm\") pod \"kserve-controller-manager-d6f4b65b8-djdxw\" (UID: \"358b6db0-b1e1-4e66-83d8-ad6cf6eeed50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"
Jul 02 19:57:37.510824 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.510806    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fwq9\" (UniqueName: \"kubernetes.io/projected/a982badb-8c88-4845-b7cc-3c3f02b57462-kube-api-access-7fwq9\") pod \"kube-auth-proxy-79ff5d7d55-9sdcp\" (UID: \"a982badb-8c88-4845-b7cc-3c3f02b57462\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"
Jul 02 19:57:37.511005 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.510884    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a982badb-8c88-4845-b7cc-3c3f02b57462-tls-certs\") pod \"kube-auth-proxy-79ff5d7d55-9sdcp\" (UID: \"a982badb-8c88-4845-b7cc-3c3f02b57462\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"
Jul 02 19:57:37.512934 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.512902    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a982badb-8c88-4845-b7cc-3c3f02b57462-tmp\") pod \"kube-auth-proxy-79ff5d7d55-9sdcp\" (UID: \"a982badb-8c88-4845-b7cc-3c3f02b57462\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"
Jul 02 19:57:37.513166 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.513150    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a982badb-8c88-4845-b7cc-3c3f02b57462-tls-certs\") pod \"kube-auth-proxy-79ff5d7d55-9sdcp\" (UID: \"a982badb-8c88-4845-b7cc-3c3f02b57462\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"
Jul 02 19:57:37.523682 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.523628    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:37.524544 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.524524    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fwq9\" (UniqueName: \"kubernetes.io/projected/a982badb-8c88-4845-b7cc-3c3f02b57462-kube-api-access-7fwq9\") pod \"kube-auth-proxy-79ff5d7d55-9sdcp\" (UID: \"a982badb-8c88-4845-b7cc-3c3f02b57462\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"
Jul 02 19:57:37.572155 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.572117    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"
Jul 02 19:57:37.612035 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.612001    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fd53444-4cea-4048-9565-5ed36cdab02b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cxpqp\" (UID: \"1fd53444-4cea-4048-9565-5ed36cdab02b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp"
Jul 02 19:57:37.612035 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.612041    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/358b6db0-b1e1-4e66-83d8-ad6cf6eeed50-cert\") pod \"kserve-controller-manager-d6f4b65b8-djdxw\" (UID: \"358b6db0-b1e1-4e66-83d8-ad6cf6eeed50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"
Jul 02 19:57:37.612302 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.612072    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp6wl\" (UniqueName: \"kubernetes.io/projected/1fd53444-4cea-4048-9565-5ed36cdab02b-kube-api-access-vp6wl\") pod \"llmisvc-controller-manager-777c6bd7d5-cxpqp\" (UID: \"1fd53444-4cea-4048-9565-5ed36cdab02b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp"
Jul 02 19:57:37.612302 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.612095    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbjnm\" (UniqueName: \"kubernetes.io/projected/358b6db0-b1e1-4e66-83d8-ad6cf6eeed50-kube-api-access-nbjnm\") pod \"kserve-controller-manager-d6f4b65b8-djdxw\" (UID: \"358b6db0-b1e1-4e66-83d8-ad6cf6eeed50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"
Jul 02 19:57:37.612491 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:57:37.612463    2556 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 02 19:57:37.612553 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:57:37.612544    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/358b6db0-b1e1-4e66-83d8-ad6cf6eeed50-cert podName:358b6db0-b1e1-4e66-83d8-ad6cf6eeed50 nodeName:}" failed. No retries permitted until 2026-07-02 19:57:38.112526777 +0000 UTC m=+402.474673816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/358b6db0-b1e1-4e66-83d8-ad6cf6eeed50-cert") pod "kserve-controller-manager-d6f4b65b8-djdxw" (UID: "358b6db0-b1e1-4e66-83d8-ad6cf6eeed50") : secret "kserve-webhook-server-cert" not found
Jul 02 19:57:37.614524 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.614496    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fd53444-4cea-4048-9565-5ed36cdab02b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cxpqp\" (UID: \"1fd53444-4cea-4048-9565-5ed36cdab02b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp"
Jul 02 19:57:37.627877 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.627850    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp6wl\" (UniqueName: \"kubernetes.io/projected/1fd53444-4cea-4048-9565-5ed36cdab02b-kube-api-access-vp6wl\") pod \"llmisvc-controller-manager-777c6bd7d5-cxpqp\" (UID: \"1fd53444-4cea-4048-9565-5ed36cdab02b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp"
Jul 02 19:57:37.637529 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.637499    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbjnm\" (UniqueName: \"kubernetes.io/projected/358b6db0-b1e1-4e66-83d8-ad6cf6eeed50-kube-api-access-nbjnm\") pod \"kserve-controller-manager-d6f4b65b8-djdxw\" (UID: \"358b6db0-b1e1-4e66-83d8-ad6cf6eeed50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"
Jul 02 19:57:37.659859 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.659832    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:37.687320 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.687233    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp"
Jul 02 19:57:37.769663 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:57:37.769637    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda982badb_8c88_4845_b7cc_3c3f02b57462.slice/crio-a4fde6a431f7706ca177e774063f37c40bd550294167631ae34e4e51971c01cd WatchSource:0}: Error finding container a4fde6a431f7706ca177e774063f37c40bd550294167631ae34e4e51971c01cd: Status 404 returned error can't find the container with id a4fde6a431f7706ca177e774063f37c40bd550294167631ae34e4e51971c01cd
Jul 02 19:57:37.809161 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.809127    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp"]
Jul 02 19:57:37.854835 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.854813    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp"]
Jul 02 19:57:37.855690 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:57:37.855656    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1fd53444_4cea_4048_9565_5ed36cdab02b.slice/crio-f00332ac4c148a72291da24a920cc2adbc34c4f77d973b0894b0c1bd39ad8a1d WatchSource:0}: Error finding container f00332ac4c148a72291da24a920cc2adbc34c4f77d973b0894b0c1bd39ad8a1d: Status 404 returned error can't find the container with id f00332ac4c148a72291da24a920cc2adbc34c4f77d973b0894b0c1bd39ad8a1d
Jul 02 19:57:37.869317 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:37.869265    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:38.066310 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:38.066261    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:38.116085 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:38.116051    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/358b6db0-b1e1-4e66-83d8-ad6cf6eeed50-cert\") pod \"kserve-controller-manager-d6f4b65b8-djdxw\" (UID: \"358b6db0-b1e1-4e66-83d8-ad6cf6eeed50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"
Jul 02 19:57:38.118494 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:38.118473    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/358b6db0-b1e1-4e66-83d8-ad6cf6eeed50-cert\") pod \"kserve-controller-manager-d6f4b65b8-djdxw\" (UID: \"358b6db0-b1e1-4e66-83d8-ad6cf6eeed50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"
Jul 02 19:57:38.267738 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:38.267702    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"
Jul 02 19:57:38.439694 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:38.439659    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"]
Jul 02 19:57:38.443994 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:57:38.443966    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358b6db0_b1e1_4e66_83d8_ad6cf6eeed50.slice/crio-0371732ef7b5f8863384c88acfe708e925d047f42c1c0904a9b84dd006b90304 WatchSource:0}: Error finding container 0371732ef7b5f8863384c88acfe708e925d047f42c1c0904a9b84dd006b90304: Status 404 returned error can't find the container with id 0371732ef7b5f8863384c88acfe708e925d047f42c1c0904a9b84dd006b90304
Jul 02 19:57:38.733799 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:38.733758    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp" event={"ID":"1fd53444-4cea-4048-9565-5ed36cdab02b","Type":"ContainerStarted","Data":"f00332ac4c148a72291da24a920cc2adbc34c4f77d973b0894b0c1bd39ad8a1d"}
Jul 02 19:57:38.735261 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:38.735229    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp" event={"ID":"a982badb-8c88-4845-b7cc-3c3f02b57462","Type":"ContainerStarted","Data":"a4fde6a431f7706ca177e774063f37c40bd550294167631ae34e4e51971c01cd"}
Jul 02 19:57:38.737342 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:38.737316    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw" event={"ID":"358b6db0-b1e1-4e66-83d8-ad6cf6eeed50","Type":"ContainerStarted","Data":"0371732ef7b5f8863384c88acfe708e925d047f42c1c0904a9b84dd006b90304"}
Jul 02 19:57:40.127481 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:40.127401    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:40.305574 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:40.305533    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:41.691924 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.691892    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:41.818268 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.818233    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"]
Jul 02 19:57:41.826614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.826592    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:41.830612 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.830561    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 02 19:57:41.830612 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.830606    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 02 19:57:41.832225 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.832208    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pzz8q\""
Jul 02 19:57:41.835292 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.835257    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 19:57:41.835393 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.835348    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 02 19:57:41.903157 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.903129    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"]
Jul 02 19:57:41.947523 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.947496    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7887f30d-53e6-49cf-bc76-03ece410dc3d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:41.947843 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.947539    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7887f30d-53e6-49cf-bc76-03ece410dc3d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:41.947843 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.947587    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7887f30d-53e6-49cf-bc76-03ece410dc3d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:41.947843 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.947606    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7887f30d-53e6-49cf-bc76-03ece410dc3d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:41.947843 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.947673    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq29c\" (UniqueName: \"kubernetes.io/projected/7887f30d-53e6-49cf-bc76-03ece410dc3d-kube-api-access-kq29c\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:41.947843 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.947740    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7887f30d-53e6-49cf-bc76-03ece410dc3d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:41.947843 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.947782    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7887f30d-53e6-49cf-bc76-03ece410dc3d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:41.996888 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:41.996845    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:42.049183 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.049143    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7887f30d-53e6-49cf-bc76-03ece410dc3d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.049183 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.049192    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7887f30d-53e6-49cf-bc76-03ece410dc3d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.049434 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.049235    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7887f30d-53e6-49cf-bc76-03ece410dc3d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.049434 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.049263    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7887f30d-53e6-49cf-bc76-03ece410dc3d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.049434 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.049314    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7887f30d-53e6-49cf-bc76-03ece410dc3d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.049434 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.049344    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7887f30d-53e6-49cf-bc76-03ece410dc3d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.049434 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.049374    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq29c\" (UniqueName: \"kubernetes.io/projected/7887f30d-53e6-49cf-bc76-03ece410dc3d-kube-api-access-kq29c\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.050112 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.050083    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7887f30d-53e6-49cf-bc76-03ece410dc3d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.051943 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.051908    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7887f30d-53e6-49cf-bc76-03ece410dc3d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.052053 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.051970    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7887f30d-53e6-49cf-bc76-03ece410dc3d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.052174 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.052154    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7887f30d-53e6-49cf-bc76-03ece410dc3d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.052213 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.052163    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7887f30d-53e6-49cf-bc76-03ece410dc3d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.076887 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.076861    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7887f30d-53e6-49cf-bc76-03ece410dc3d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.083756 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.083729    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq29c\" (UniqueName: \"kubernetes.io/projected/7887f30d-53e6-49cf-bc76-03ece410dc3d-kube-api-access-kq29c\") pod \"istiod-openshift-gateway-94bb8fbfd-5pkpm\" (UID: \"7887f30d-53e6-49cf-bc76-03ece410dc3d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.136849 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.136813    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:42.311630 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:57:42.311601    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7887f30d_53e6_49cf_bc76_03ece410dc3d.slice/crio-1360b41dddffb0022779678182f08c90c3920e9b6894f3a0faa60f9e5c58ca19 WatchSource:0}: Error finding container 1360b41dddffb0022779678182f08c90c3920e9b6894f3a0faa60f9e5c58ca19: Status 404 returned error can't find the container with id 1360b41dddffb0022779678182f08c90c3920e9b6894f3a0faa60f9e5c58ca19
Jul 02 19:57:42.314537 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.314495    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"]
Jul 02 19:57:42.710490 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.710391    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bd6vw"
Jul 02 19:57:42.712486 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.712464    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-prrxv"
Jul 02 19:57:42.757361 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.757312    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp" event={"ID":"a982badb-8c88-4845-b7cc-3c3f02b57462","Type":"ContainerStarted","Data":"0454151ae293b7a5443d1b5ef7ea3436689b69466adf0390dec278603a9749ab"}
Jul 02 19:57:42.758950 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.758920    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw" event={"ID":"358b6db0-b1e1-4e66-83d8-ad6cf6eeed50","Type":"ContainerStarted","Data":"b95d3dab256d37bbdda822551e59f45db50c98bf48b9ef50361f1ef0a45a0819"}
Jul 02 19:57:42.759094 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.758977    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"
Jul 02 19:57:42.760491 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.760462    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp" event={"ID":"1fd53444-4cea-4048-9565-5ed36cdab02b","Type":"ContainerStarted","Data":"5787f7c20c5f38db10d9f017b5896d5a5f5fa875de4014ac17a3294d4c0a0e87"}
Jul 02 19:57:42.760627 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.760518    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp"
Jul 02 19:57:42.761695 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.761677    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm" event={"ID":"7887f30d-53e6-49cf-bc76-03ece410dc3d","Type":"ContainerStarted","Data":"1360b41dddffb0022779678182f08c90c3920e9b6894f3a0faa60f9e5c58ca19"}
Jul 02 19:57:42.891585 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.891525    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp" podStartSLOduration=1.9186706550000001 podStartE2EDuration="5.891507927s" totalImagesPullingTime="3.972837272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:42.890745239 +0000 UTC m=+407.252892301" watchObservedRunningTime="2026-07-02 19:57:42.891507927 +0000 UTC m=+407.253654989"
Jul 02 19:57:42.949197 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:42.949141    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw" podStartSLOduration=2.570522907 podStartE2EDuration="5.949123499s" totalImagesPullingTime="3.378600592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:42.945788903 +0000 UTC m=+407.307935967" watchObservedRunningTime="2026-07-02 19:57:42.949123499 +0000 UTC m=+407.311270560"
Jul 02 19:57:43.032476 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:43.032423    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-9sdcp" podStartSLOduration=1.9805603330000001 podStartE2EDuration="6.032405982s" totalImagesPullingTime="4.051845649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:43.031690248 +0000 UTC m=+407.393837341" watchObservedRunningTime="2026-07-02 19:57:43.032405982 +0000 UTC m=+407.394553044"
Jul 02 19:57:43.794606 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:43.794572    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:43.993877 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:43.993845    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:44.816705 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:44.816664    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:45.456493 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:45.456442    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:57:45.456603 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:45.456532    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 19:57:45.778369 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:45.778337    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm" event={"ID":"7887f30d-53e6-49cf-bc76-03ece410dc3d","Type":"ContainerStarted","Data":"e671413ef80f642e0282e3dc0398e471714c2102e2dc020875b55015512561f6"}
Jul 02 19:57:45.778555 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:45.778484    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:45.814833 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:45.814767    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm" podStartSLOduration=1.6727370449999999 podStartE2EDuration="4.814746624s" totalImagesPullingTime="3.142009579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:45.812193645 +0000 UTC m=+410.174340707" watchObservedRunningTime="2026-07-02 19:57:45.814746624 +0000 UTC m=+410.176893689"
Jul 02 19:57:46.382409 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:46.382366    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:46.526364 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:46.526330    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:46.784358 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:46.784325    2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-5pkpm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 19:57:46.784519 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:46.784380    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm" podUID="7887f30d-53e6-49cf-bc76-03ece410dc3d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 19:57:47.552619 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:47.552582    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:47.751432 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:47.751397    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:47.894137 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:47.894048    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:57:49.783252 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:49.783219    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5pkpm"
Jul 02 19:57:52.666941 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:57:52.666910    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:58:13.769695 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:13.769659    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cxpqp"
Jul 02 19:58:13.773090 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:13.773066    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-djdxw"
Jul 02 19:58:27.269852 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:27.269817    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:58:27.367689 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:27.367658    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:58:27.536455 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:27.536369    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:58:28.196435 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:28.196398    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:58:28.407244 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:28.407206    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:58:30.737054 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:30.737017    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:58:30.806042 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:30.805996    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:58:32.547806 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:32.547772    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:58:32.618452 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:32.618419    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:58:57.162945 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:57.162913    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:58:57.264564 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:57.264529    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:58:57.373888 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:58:57.373835    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:00.767573 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:00.767546    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:01.046501 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:01.046422    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:01.591594 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:01.591561    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:04.795077 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:04.795046    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:04.906914 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:04.906875    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:07.232005 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:07.231972    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:08.465360 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:08.465327    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:08.566829 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:08.566780    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:08.668868 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:08.668837    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:09.059097 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.059052    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:09.067989 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.067953    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"]
Jul 02 19:59:09.071185 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.071110    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:09.075233 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.075207    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 19:59:09.076369 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.076354    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 19:59:09.076447 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.076374    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-249s6\""
Jul 02 19:59:09.085790 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.085766    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"]
Jul 02 19:59:09.130864 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.130829    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67xzw\" (UniqueName: \"kubernetes.io/projected/2995fb97-cc60-4b08-9c23-367682223210-kube-api-access-67xzw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75692\" (UID: \"2995fb97-cc60-4b08-9c23-367682223210\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:09.131037 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.130877    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2995fb97-cc60-4b08-9c23-367682223210-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75692\" (UID: \"2995fb97-cc60-4b08-9c23-367682223210\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:09.231471 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.231431    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67xzw\" (UniqueName: \"kubernetes.io/projected/2995fb97-cc60-4b08-9c23-367682223210-kube-api-access-67xzw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75692\" (UID: \"2995fb97-cc60-4b08-9c23-367682223210\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:09.231471 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.231476    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2995fb97-cc60-4b08-9c23-367682223210-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75692\" (UID: \"2995fb97-cc60-4b08-9c23-367682223210\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:09.231851 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.231835    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2995fb97-cc60-4b08-9c23-367682223210-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75692\" (UID: \"2995fb97-cc60-4b08-9c23-367682223210\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:09.241633 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.241604    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67xzw\" (UniqueName: \"kubernetes.io/projected/2995fb97-cc60-4b08-9c23-367682223210-kube-api-access-67xzw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75692\" (UID: \"2995fb97-cc60-4b08-9c23-367682223210\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:09.381843 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.381748    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:09.528348 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:09.528324    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"]
Jul 02 19:59:09.531124 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:59:09.531099    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2995fb97_cc60_4b08_9c23_367682223210.slice/crio-f06093145c67f49e4132510d9e93e76351fb87291935a53f34bf91dacaf88bab WatchSource:0}: Error finding container f06093145c67f49e4132510d9e93e76351fb87291935a53f34bf91dacaf88bab: Status 404 returned error can't find the container with id f06093145c67f49e4132510d9e93e76351fb87291935a53f34bf91dacaf88bab
Jul 02 19:59:10.130167 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:10.130122    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692" event={"ID":"2995fb97-cc60-4b08-9c23-367682223210","Type":"ContainerStarted","Data":"f06093145c67f49e4132510d9e93e76351fb87291935a53f34bf91dacaf88bab"}
Jul 02 19:59:10.193826 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:10.193790    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:12.286447 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:12.286403    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:13.780827 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:13.780781    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:13.883054 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:13.883024    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:16.156898 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:16.156806    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692" event={"ID":"2995fb97-cc60-4b08-9c23-367682223210","Type":"ContainerStarted","Data":"08b7e74368b2e5667f597f920ae13b65154cfed5b3075de352546e89393e9946"}
Jul 02 19:59:16.157338 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:16.156948    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:16.183523 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:16.183466    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692" podStartSLOduration=0.830441158 podStartE2EDuration="7.183447231s" totalImagesPullingTime="6.353006073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:16.181131656 +0000 UTC m=+500.543278718" watchObservedRunningTime="2026-07-02 19:59:16.183447231 +0000 UTC m=+500.545594293"
Jul 02 19:59:17.780489 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:17.780455    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:17.912421 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:17.912392    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:18.191015 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:18.190923    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:18.295614 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:18.295578    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:18.777421 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:18.777381    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:19.217869 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:19.217790    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:22.215534 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:22.215496    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:22.318120 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:22.318090    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:27.163040 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:27.163009    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:28.782229 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:28.782192    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"]
Jul 02 19:59:28.785294 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:28.785257    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:28.803869 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:28.803827    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"]
Jul 02 19:59:28.831487 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:28.831458    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:28.888197 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:28.888161    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j7hl\" (UniqueName: \"kubernetes.io/projected/59cfc73d-06ac-4d84-b1a1-85ea929f06ff-kube-api-access-9j7hl\") pod \"kuadrant-operator-controller-manager-55467d9f7-9njst\" (UID: \"59cfc73d-06ac-4d84-b1a1-85ea929f06ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:28.888395 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:28.888219    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59cfc73d-06ac-4d84-b1a1-85ea929f06ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9njst\" (UID: \"59cfc73d-06ac-4d84-b1a1-85ea929f06ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:28.949415 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:28.949381    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:28.988851 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:28.988819    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59cfc73d-06ac-4d84-b1a1-85ea929f06ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9njst\" (UID: \"59cfc73d-06ac-4d84-b1a1-85ea929f06ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:28.989008 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:28.988895    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j7hl\" (UniqueName: \"kubernetes.io/projected/59cfc73d-06ac-4d84-b1a1-85ea929f06ff-kube-api-access-9j7hl\") pod \"kuadrant-operator-controller-manager-55467d9f7-9njst\" (UID: \"59cfc73d-06ac-4d84-b1a1-85ea929f06ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:28.989238 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:28.989211    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59cfc73d-06ac-4d84-b1a1-85ea929f06ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9njst\" (UID: \"59cfc73d-06ac-4d84-b1a1-85ea929f06ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:28.998004 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:28.997980    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j7hl\" (UniqueName: \"kubernetes.io/projected/59cfc73d-06ac-4d84-b1a1-85ea929f06ff-kube-api-access-9j7hl\") pod \"kuadrant-operator-controller-manager-55467d9f7-9njst\" (UID: \"59cfc73d-06ac-4d84-b1a1-85ea929f06ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:29.063163 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.063062    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"]
Jul 02 19:59:29.063401 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.063385    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:29.068499 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.068471    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"]
Jul 02 19:59:29.084457 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.084422    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"]
Jul 02 19:59:29.084705 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.084677    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692" podUID="2995fb97-cc60-4b08-9c23-367682223210" containerName="manager" containerID="cri-o://08b7e74368b2e5667f597f920ae13b65154cfed5b3075de352546e89393e9946" gracePeriod=2
Jul 02 19:59:29.089500 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.089461    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"]
Jul 02 19:59:29.092872 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.092850    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"
Jul 02 19:59:29.097304 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.097244    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"]
Jul 02 19:59:29.106510 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:59:29.106475    2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"2995fb97-cc60-4b08-9c23-367682223210\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-75692\": pods \"kuadrant-operator-controller-manager-8684c9ff49-75692\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:29.109485 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:59:29.109244    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75692\" is forbidden: User \"system:node:ip-10-0-130-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-14.ec2.internal' and this object" podUID="2995fb97-cc60-4b08-9c23-367682223210" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:29.110427 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.110399    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"]
Jul 02 19:59:29.112470 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.112444    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"]
Jul 02 19:59:29.112906 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.112888    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2995fb97-cc60-4b08-9c23-367682223210" containerName="manager"
Jul 02 19:59:29.112984 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.112909    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2995fb97-cc60-4b08-9c23-367682223210" containerName="manager"
Jul 02 19:59:29.113083 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.113055    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2995fb97-cc60-4b08-9c23-367682223210" containerName="manager"
Jul 02 19:59:29.116334 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.116264    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"
Jul 02 19:59:29.130777 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.130748    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"]
Jul 02 19:59:29.156128 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:59:29.156090    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75692\" is forbidden: User \"system:node:ip-10-0-130-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-14.ec2.internal' and this object" podUID="2995fb97-cc60-4b08-9c23-367682223210" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:29.190700 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.190665    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldxs8\" (UniqueName: \"kubernetes.io/projected/f38f346a-1056-4a54-815a-935b4e65c484-kube-api-access-ldxs8\") pod \"kuadrant-operator-controller-manager-55467d9f7-gf54j\" (UID: \"f38f346a-1056-4a54-815a-935b4e65c484\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"
Jul 02 19:59:29.190860 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.190749    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f38f346a-1056-4a54-815a-935b4e65c484-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gf54j\" (UID: \"f38f346a-1056-4a54-815a-935b4e65c484\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"
Jul 02 19:59:29.190860 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.190796    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d87da08f-6123-4643-aa13-b33986e08ad6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vlpd5\" (UID: \"d87da08f-6123-4643-aa13-b33986e08ad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"
Jul 02 19:59:29.190860 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.190821    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qszsk\" (UniqueName: \"kubernetes.io/projected/d87da08f-6123-4643-aa13-b33986e08ad6-kube-api-access-qszsk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vlpd5\" (UID: \"d87da08f-6123-4643-aa13-b33986e08ad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"
Jul 02 19:59:29.211339 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.211305    2556 generic.go:356] "Generic (PLEG): container finished" podID="2995fb97-cc60-4b08-9c23-367682223210" containerID="08b7e74368b2e5667f597f920ae13b65154cfed5b3075de352546e89393e9946" exitCode=0
Jul 02 19:59:29.291917 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.291877    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldxs8\" (UniqueName: \"kubernetes.io/projected/f38f346a-1056-4a54-815a-935b4e65c484-kube-api-access-ldxs8\") pod \"kuadrant-operator-controller-manager-55467d9f7-gf54j\" (UID: \"f38f346a-1056-4a54-815a-935b4e65c484\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"
Jul 02 19:59:29.292112 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.291941    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f38f346a-1056-4a54-815a-935b4e65c484-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gf54j\" (UID: \"f38f346a-1056-4a54-815a-935b4e65c484\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"
Jul 02 19:59:29.292112 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.291980    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d87da08f-6123-4643-aa13-b33986e08ad6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vlpd5\" (UID: \"d87da08f-6123-4643-aa13-b33986e08ad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"
Jul 02 19:59:29.292112 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.292006    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qszsk\" (UniqueName: \"kubernetes.io/projected/d87da08f-6123-4643-aa13-b33986e08ad6-kube-api-access-qszsk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vlpd5\" (UID: \"d87da08f-6123-4643-aa13-b33986e08ad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"
Jul 02 19:59:29.292477 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.292458    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d87da08f-6123-4643-aa13-b33986e08ad6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vlpd5\" (UID: \"d87da08f-6123-4643-aa13-b33986e08ad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"
Jul 02 19:59:29.292527 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.292494    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f38f346a-1056-4a54-815a-935b4e65c484-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gf54j\" (UID: \"f38f346a-1056-4a54-815a-935b4e65c484\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"
Jul 02 19:59:29.305473 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.305450    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldxs8\" (UniqueName: \"kubernetes.io/projected/f38f346a-1056-4a54-815a-935b4e65c484-kube-api-access-ldxs8\") pod \"kuadrant-operator-controller-manager-55467d9f7-gf54j\" (UID: \"f38f346a-1056-4a54-815a-935b4e65c484\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"
Jul 02 19:59:29.309063 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.309034    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qszsk\" (UniqueName: \"kubernetes.io/projected/d87da08f-6123-4643-aa13-b33986e08ad6-kube-api-access-qszsk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vlpd5\" (UID: \"d87da08f-6123-4643-aa13-b33986e08ad6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"
Jul 02 19:59:29.321000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.320944    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:29.323640 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:59:29.323605    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75692\" is forbidden: User \"system:node:ip-10-0-130-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-14.ec2.internal' and this object" podUID="2995fb97-cc60-4b08-9c23-367682223210" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:29.393303 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.393257    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2995fb97-cc60-4b08-9c23-367682223210-extensions-socket-volume\") pod \"2995fb97-cc60-4b08-9c23-367682223210\" (UID: \"2995fb97-cc60-4b08-9c23-367682223210\") "
Jul 02 19:59:29.393443 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.393344    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67xzw\" (UniqueName: \"kubernetes.io/projected/2995fb97-cc60-4b08-9c23-367682223210-kube-api-access-67xzw\") pod \"2995fb97-cc60-4b08-9c23-367682223210\" (UID: \"2995fb97-cc60-4b08-9c23-367682223210\") "
Jul 02 19:59:29.393789 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.393765    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2995fb97-cc60-4b08-9c23-367682223210-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2995fb97-cc60-4b08-9c23-367682223210" (UID: "2995fb97-cc60-4b08-9c23-367682223210"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:59:29.395479 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.395459    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2995fb97-cc60-4b08-9c23-367682223210-kube-api-access-67xzw" (OuterVolumeSpecName: "kube-api-access-67xzw") pod "2995fb97-cc60-4b08-9c23-367682223210" (UID: "2995fb97-cc60-4b08-9c23-367682223210"). InnerVolumeSpecName "kube-api-access-67xzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:59:29.465188 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.465148    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"
Jul 02 19:59:29.471239 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.471218    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"
Jul 02 19:59:29.494954 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.494915    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2995fb97-cc60-4b08-9c23-367682223210-extensions-socket-volume\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 19:59:29.494954 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.494954    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67xzw\" (UniqueName: \"kubernetes.io/projected/2995fb97-cc60-4b08-9c23-367682223210-kube-api-access-67xzw\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 19:59:29.642506 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.642481    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"]
Jul 02 19:59:29.644900 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:59:29.644874    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38f346a_1056_4a54_815a_935b4e65c484.slice/crio-8d13999fd7e12738cb019f77749c43982825400778381e56143a9e66c8c67397 WatchSource:0}: Error finding container 8d13999fd7e12738cb019f77749c43982825400778381e56143a9e66c8c67397: Status 404 returned error can't find the container with id 8d13999fd7e12738cb019f77749c43982825400778381e56143a9e66c8c67397
Jul 02 19:59:29.674948 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:29.674925    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"]
Jul 02 19:59:29.676732 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:59:29.676700    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87da08f_6123_4643_aa13_b33986e08ad6.slice/crio-57491cba773094d06260f7857d4d9cf0cce63c1429a124d059706649ad502cbc WatchSource:0}: Error finding container 57491cba773094d06260f7857d4d9cf0cce63c1429a124d059706649ad502cbc: Status 404 returned error can't find the container with id 57491cba773094d06260f7857d4d9cf0cce63c1429a124d059706649ad502cbc
Jul 02 19:59:30.196619 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:30.196584    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2995fb97-cc60-4b08-9c23-367682223210" path="/var/lib/kubelet/pods/2995fb97-cc60-4b08-9c23-367682223210/volumes"
Jul 02 19:59:30.222596 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:30.222563    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j" event={"ID":"f38f346a-1056-4a54-815a-935b4e65c484","Type":"ContainerStarted","Data":"27696db3e391be3db143fc7f5534347a95916a9e86af6312adf87d11406b0623"}
Jul 02 19:59:30.222785 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:30.222663    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"
Jul 02 19:59:30.222785 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:30.222688    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j" event={"ID":"f38f346a-1056-4a54-815a-935b4e65c484","Type":"ContainerStarted","Data":"8d13999fd7e12738cb019f77749c43982825400778381e56143a9e66c8c67397"}
Jul 02 19:59:30.224227 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:30.224202    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5" event={"ID":"d87da08f-6123-4643-aa13-b33986e08ad6","Type":"ContainerStarted","Data":"7979506e2b8ef0aec00d5f7d1ea54d8f571335b1f3cc3d1f29fa03dd227d9aae"}
Jul 02 19:59:30.224342 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:30.224247    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5" event={"ID":"d87da08f-6123-4643-aa13-b33986e08ad6","Type":"ContainerStarted","Data":"57491cba773094d06260f7857d4d9cf0cce63c1429a124d059706649ad502cbc"}
Jul 02 19:59:30.224342 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:30.224288    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"
Jul 02 19:59:30.225463 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:30.225445    2556 scope.go:117] "RemoveContainer" containerID="08b7e74368b2e5667f597f920ae13b65154cfed5b3075de352546e89393e9946"
Jul 02 19:59:30.225574 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:30.225483    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75692"
Jul 02 19:59:30.250479 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:30.250405    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j" podStartSLOduration=1.250387538 podStartE2EDuration="1.250387538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:30.247977895 +0000 UTC m=+514.610124956" watchObservedRunningTime="2026-07-02 19:59:30.250387538 +0000 UTC m=+514.612534600"
Jul 02 19:59:30.278927 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:30.278823    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5" podStartSLOduration=1.278806464 podStartE2EDuration="1.278806464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:30.278360193 +0000 UTC m=+514.640507257" watchObservedRunningTime="2026-07-02 19:59:30.278806464 +0000 UTC m=+514.640953526"
Jul 02 19:59:31.610507 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:59:31.610460    2556 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-9njst_kuadrant-system_59cfc73d-06ac-4d84-b1a1-85ea929f06ff_0(8f438cd518de9a513aa294b9600191ecffe159161a02c7223b8d6fa7c69bb0ab): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-9njst to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 02 19:59:31.610781 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:59:31.610530    2556 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-9njst_kuadrant-system_59cfc73d-06ac-4d84-b1a1-85ea929f06ff_0(8f438cd518de9a513aa294b9600191ecffe159161a02c7223b8d6fa7c69bb0ab): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-9njst to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:32.234309 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:32.234262    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:32.242218 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:32.242188    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:32.244591 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:59:32.244560    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9njst\" is forbidden: User \"system:node:ip-10-0-130-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-14.ec2.internal' and this object" podUID="59cfc73d-06ac-4d84-b1a1-85ea929f06ff" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:32.316827 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:32.316781    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59cfc73d-06ac-4d84-b1a1-85ea929f06ff-extensions-socket-volume\") pod \"59cfc73d-06ac-4d84-b1a1-85ea929f06ff\" (UID: \"59cfc73d-06ac-4d84-b1a1-85ea929f06ff\") "
Jul 02 19:59:32.317014 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:32.316858    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j7hl\" (UniqueName: \"kubernetes.io/projected/59cfc73d-06ac-4d84-b1a1-85ea929f06ff-kube-api-access-9j7hl\") pod \"59cfc73d-06ac-4d84-b1a1-85ea929f06ff\" (UID: \"59cfc73d-06ac-4d84-b1a1-85ea929f06ff\") "
Jul 02 19:59:32.317063 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:32.317040    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59cfc73d-06ac-4d84-b1a1-85ea929f06ff-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "59cfc73d-06ac-4d84-b1a1-85ea929f06ff" (UID: "59cfc73d-06ac-4d84-b1a1-85ea929f06ff"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:59:32.318996 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:32.318973    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59cfc73d-06ac-4d84-b1a1-85ea929f06ff-kube-api-access-9j7hl" (OuterVolumeSpecName: "kube-api-access-9j7hl") pod "59cfc73d-06ac-4d84-b1a1-85ea929f06ff" (UID: "59cfc73d-06ac-4d84-b1a1-85ea929f06ff"). InnerVolumeSpecName "kube-api-access-9j7hl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:59:32.417546 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:32.417513    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j7hl\" (UniqueName: \"kubernetes.io/projected/59cfc73d-06ac-4d84-b1a1-85ea929f06ff-kube-api-access-9j7hl\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 19:59:32.417546 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:32.417540    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59cfc73d-06ac-4d84-b1a1-85ea929f06ff-extensions-socket-volume\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 19:59:33.132833 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:33.132801    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:33.237928 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:33.237894    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:33.238855 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:33.238816    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:33.241386 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:59:33.241349    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9njst\" is forbidden: User \"system:node:ip-10-0-130-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-14.ec2.internal' and this object" podUID="59cfc73d-06ac-4d84-b1a1-85ea929f06ff" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:33.246520 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:59:33.246492    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9njst\" is forbidden: User \"system:node:ip-10-0-130-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-14.ec2.internal' and this object" podUID="59cfc73d-06ac-4d84-b1a1-85ea929f06ff" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9njst"
Jul 02 19:59:34.195823 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:34.195777    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59cfc73d-06ac-4d84-b1a1-85ea929f06ff" path="/var/lib/kubelet/pods/59cfc73d-06ac-4d84-b1a1-85ea929f06ff/volumes"
Jul 02 19:59:36.856048 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:36.856015    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:36.956372 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:36.956314    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:37.056886 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:37.056842    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:37.161808 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:37.161720    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:41.232169 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.232135    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"
Jul 02 19:59:41.232578 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.232531    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"
Jul 02 19:59:41.312931 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.312897    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"]
Jul 02 19:59:41.313129 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.313088    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5" podUID="d87da08f-6123-4643-aa13-b33986e08ad6" containerName="manager" containerID="cri-o://7979506e2b8ef0aec00d5f7d1ea54d8f571335b1f3cc3d1f29fa03dd227d9aae" gracePeriod=10
Jul 02 19:59:41.552692 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.552662    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"
Jul 02 19:59:41.582003 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.581960    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"]
Jul 02 19:59:41.582364 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.582348    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87da08f-6123-4643-aa13-b33986e08ad6" containerName="manager"
Jul 02 19:59:41.582459 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.582367    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87da08f-6123-4643-aa13-b33986e08ad6" containerName="manager"
Jul 02 19:59:41.582523 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.582465    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d87da08f-6123-4643-aa13-b33986e08ad6" containerName="manager"
Jul 02 19:59:41.585261 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.585226    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"
Jul 02 19:59:41.600967 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.600935    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"]
Jul 02 19:59:41.692787 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.692753    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d87da08f-6123-4643-aa13-b33986e08ad6-extensions-socket-volume\") pod \"d87da08f-6123-4643-aa13-b33986e08ad6\" (UID: \"d87da08f-6123-4643-aa13-b33986e08ad6\") "
Jul 02 19:59:41.692931 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.692850    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qszsk\" (UniqueName: \"kubernetes.io/projected/d87da08f-6123-4643-aa13-b33986e08ad6-kube-api-access-qszsk\") pod \"d87da08f-6123-4643-aa13-b33986e08ad6\" (UID: \"d87da08f-6123-4643-aa13-b33986e08ad6\") "
Jul 02 19:59:41.692931 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.692919    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370c73a6-d7b8-442f-8f13-e51117d1e7cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gsr8k\" (UID: \"370c73a6-d7b8-442f-8f13-e51117d1e7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"
Jul 02 19:59:41.693039 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.692967    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgz92\" (UniqueName: \"kubernetes.io/projected/370c73a6-d7b8-442f-8f13-e51117d1e7cf-kube-api-access-qgz92\") pod \"kuadrant-operator-controller-manager-86878c769f-gsr8k\" (UID: \"370c73a6-d7b8-442f-8f13-e51117d1e7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"
Jul 02 19:59:41.693154 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.693132    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d87da08f-6123-4643-aa13-b33986e08ad6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d87da08f-6123-4643-aa13-b33986e08ad6" (UID: "d87da08f-6123-4643-aa13-b33986e08ad6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:59:41.694980 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.694959    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d87da08f-6123-4643-aa13-b33986e08ad6-kube-api-access-qszsk" (OuterVolumeSpecName: "kube-api-access-qszsk") pod "d87da08f-6123-4643-aa13-b33986e08ad6" (UID: "d87da08f-6123-4643-aa13-b33986e08ad6"). InnerVolumeSpecName "kube-api-access-qszsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:59:41.793581 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.793483    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgz92\" (UniqueName: \"kubernetes.io/projected/370c73a6-d7b8-442f-8f13-e51117d1e7cf-kube-api-access-qgz92\") pod \"kuadrant-operator-controller-manager-86878c769f-gsr8k\" (UID: \"370c73a6-d7b8-442f-8f13-e51117d1e7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"
Jul 02 19:59:41.793581 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.793542    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370c73a6-d7b8-442f-8f13-e51117d1e7cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gsr8k\" (UID: \"370c73a6-d7b8-442f-8f13-e51117d1e7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"
Jul 02 19:59:41.793581 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.793584    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qszsk\" (UniqueName: \"kubernetes.io/projected/d87da08f-6123-4643-aa13-b33986e08ad6-kube-api-access-qszsk\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 19:59:41.793853 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.793594    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d87da08f-6123-4643-aa13-b33986e08ad6-extensions-socket-volume\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 19:59:41.793907 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.793888    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370c73a6-d7b8-442f-8f13-e51117d1e7cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gsr8k\" (UID: \"370c73a6-d7b8-442f-8f13-e51117d1e7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"
Jul 02 19:59:41.804325 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.804301    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgz92\" (UniqueName: \"kubernetes.io/projected/370c73a6-d7b8-442f-8f13-e51117d1e7cf-kube-api-access-qgz92\") pod \"kuadrant-operator-controller-manager-86878c769f-gsr8k\" (UID: \"370c73a6-d7b8-442f-8f13-e51117d1e7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"
Jul 02 19:59:41.895469 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:41.895430    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"
Jul 02 19:59:42.045591 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.045514    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"]
Jul 02 19:59:42.051155 ip-10-0-130-14 kubenswrapper[2556]: W0702 19:59:42.051123    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod370c73a6_d7b8_442f_8f13_e51117d1e7cf.slice/crio-287af2772fd8d1fa02e6cf3a62e6e79dbe4437b3f69017d7f96f154103b9457e WatchSource:0}: Error finding container 287af2772fd8d1fa02e6cf3a62e6e79dbe4437b3f69017d7f96f154103b9457e: Status 404 returned error can't find the container with id 287af2772fd8d1fa02e6cf3a62e6e79dbe4437b3f69017d7f96f154103b9457e
Jul 02 19:59:42.279475 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.279444    2556 generic.go:356] "Generic (PLEG): container finished" podID="d87da08f-6123-4643-aa13-b33986e08ad6" containerID="7979506e2b8ef0aec00d5f7d1ea54d8f571335b1f3cc3d1f29fa03dd227d9aae" exitCode=0
Jul 02 19:59:42.279977 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.279491    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"
Jul 02 19:59:42.279977 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.279520    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5" event={"ID":"d87da08f-6123-4643-aa13-b33986e08ad6","Type":"ContainerDied","Data":"7979506e2b8ef0aec00d5f7d1ea54d8f571335b1f3cc3d1f29fa03dd227d9aae"}
Jul 02 19:59:42.279977 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.279566    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5" event={"ID":"d87da08f-6123-4643-aa13-b33986e08ad6","Type":"ContainerDied","Data":"57491cba773094d06260f7857d4d9cf0cce63c1429a124d059706649ad502cbc"}
Jul 02 19:59:42.279977 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.279589    2556 scope.go:117] "RemoveContainer" containerID="7979506e2b8ef0aec00d5f7d1ea54d8f571335b1f3cc3d1f29fa03dd227d9aae"
Jul 02 19:59:42.281000 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.280970    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:42.281400 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.281379    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k" event={"ID":"370c73a6-d7b8-442f-8f13-e51117d1e7cf","Type":"ContainerStarted","Data":"a7da058585561e689c0ce8eff5dd54f800a36c0fb8f66e99703199bdf6a7ee03"}
Jul 02 19:59:42.281488 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.281432    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"
Jul 02 19:59:42.281488 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.281450    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k" event={"ID":"370c73a6-d7b8-442f-8f13-e51117d1e7cf","Type":"ContainerStarted","Data":"287af2772fd8d1fa02e6cf3a62e6e79dbe4437b3f69017d7f96f154103b9457e"}
Jul 02 19:59:42.288444 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.288425    2556 scope.go:117] "RemoveContainer" containerID="7979506e2b8ef0aec00d5f7d1ea54d8f571335b1f3cc3d1f29fa03dd227d9aae"
Jul 02 19:59:42.288697 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:59:42.288681    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7979506e2b8ef0aec00d5f7d1ea54d8f571335b1f3cc3d1f29fa03dd227d9aae\": container with ID starting with 7979506e2b8ef0aec00d5f7d1ea54d8f571335b1f3cc3d1f29fa03dd227d9aae not found: ID does not exist" containerID="7979506e2b8ef0aec00d5f7d1ea54d8f571335b1f3cc3d1f29fa03dd227d9aae"
Jul 02 19:59:42.288745 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.288705    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7979506e2b8ef0aec00d5f7d1ea54d8f571335b1f3cc3d1f29fa03dd227d9aae"} err="failed to get container status \"7979506e2b8ef0aec00d5f7d1ea54d8f571335b1f3cc3d1f29fa03dd227d9aae\": rpc error: code = NotFound desc = could not find container \"7979506e2b8ef0aec00d5f7d1ea54d8f571335b1f3cc3d1f29fa03dd227d9aae\": container with ID starting with 7979506e2b8ef0aec00d5f7d1ea54d8f571335b1f3cc3d1f29fa03dd227d9aae not found: ID does not exist"
Jul 02 19:59:42.308125 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.308051    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"]
Jul 02 19:59:42.316592 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.316563    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vlpd5"]
Jul 02 19:59:42.351127 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.351069    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k" podStartSLOduration=1.351050668 podStartE2EDuration="1.351050668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:42.350768926 +0000 UTC m=+526.712915989" watchObservedRunningTime="2026-07-02 19:59:42.351050668 +0000 UTC m=+526.713197730"
Jul 02 19:59:42.384248 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:42.384213    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:44.196456 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:44.196413    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d87da08f-6123-4643-aa13-b33986e08ad6" path="/var/lib/kubelet/pods/d87da08f-6123-4643-aa13-b33986e08ad6/volumes"
Jul 02 19:59:50.448019 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:50.447929    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:50.522824 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:50.522790    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:53.288561 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:53.288532    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"
Jul 02 19:59:53.345921 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:53.345887    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"]
Jul 02 19:59:53.346117 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:53.346078    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j" podUID="f38f346a-1056-4a54-815a-935b4e65c484" containerName="manager" containerID="cri-o://27696db3e391be3db143fc7f5534347a95916a9e86af6312adf87d11406b0623" gracePeriod=10
Jul 02 19:59:53.595782 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:53.595754    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"
Jul 02 19:59:53.689503 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:53.689465    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldxs8\" (UniqueName: \"kubernetes.io/projected/f38f346a-1056-4a54-815a-935b4e65c484-kube-api-access-ldxs8\") pod \"f38f346a-1056-4a54-815a-935b4e65c484\" (UID: \"f38f346a-1056-4a54-815a-935b4e65c484\") "
Jul 02 19:59:53.689503 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:53.689509    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f38f346a-1056-4a54-815a-935b4e65c484-extensions-socket-volume\") pod \"f38f346a-1056-4a54-815a-935b4e65c484\" (UID: \"f38f346a-1056-4a54-815a-935b4e65c484\") "
Jul 02 19:59:53.689979 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:53.689950    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f38f346a-1056-4a54-815a-935b4e65c484-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f38f346a-1056-4a54-815a-935b4e65c484" (UID: "f38f346a-1056-4a54-815a-935b4e65c484"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:59:53.691569 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:53.691550    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f38f346a-1056-4a54-815a-935b4e65c484-kube-api-access-ldxs8" (OuterVolumeSpecName: "kube-api-access-ldxs8") pod "f38f346a-1056-4a54-815a-935b4e65c484" (UID: "f38f346a-1056-4a54-815a-935b4e65c484"). InnerVolumeSpecName "kube-api-access-ldxs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:59:53.789989 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:53.789955    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldxs8\" (UniqueName: \"kubernetes.io/projected/f38f346a-1056-4a54-815a-935b4e65c484-kube-api-access-ldxs8\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 19:59:53.789989 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:53.789983    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f38f346a-1056-4a54-815a-935b4e65c484-extensions-socket-volume\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 19:59:54.337804 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:54.337763    2556 generic.go:356] "Generic (PLEG): container finished" podID="f38f346a-1056-4a54-815a-935b4e65c484" containerID="27696db3e391be3db143fc7f5534347a95916a9e86af6312adf87d11406b0623" exitCode=0
Jul 02 19:59:54.338193 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:54.337814    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"
Jul 02 19:59:54.338193 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:54.337828    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j" event={"ID":"f38f346a-1056-4a54-815a-935b4e65c484","Type":"ContainerDied","Data":"27696db3e391be3db143fc7f5534347a95916a9e86af6312adf87d11406b0623"}
Jul 02 19:59:54.338193 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:54.337882    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j" event={"ID":"f38f346a-1056-4a54-815a-935b4e65c484","Type":"ContainerDied","Data":"8d13999fd7e12738cb019f77749c43982825400778381e56143a9e66c8c67397"}
Jul 02 19:59:54.338193 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:54.337912    2556 scope.go:117] "RemoveContainer" containerID="27696db3e391be3db143fc7f5534347a95916a9e86af6312adf87d11406b0623"
Jul 02 19:59:54.346231 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:54.346211    2556 scope.go:117] "RemoveContainer" containerID="27696db3e391be3db143fc7f5534347a95916a9e86af6312adf87d11406b0623"
Jul 02 19:59:54.346564 ip-10-0-130-14 kubenswrapper[2556]: E0702 19:59:54.346534    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27696db3e391be3db143fc7f5534347a95916a9e86af6312adf87d11406b0623\": container with ID starting with 27696db3e391be3db143fc7f5534347a95916a9e86af6312adf87d11406b0623 not found: ID does not exist" containerID="27696db3e391be3db143fc7f5534347a95916a9e86af6312adf87d11406b0623"
Jul 02 19:59:54.346628 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:54.346578    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27696db3e391be3db143fc7f5534347a95916a9e86af6312adf87d11406b0623"} err="failed to get container status \"27696db3e391be3db143fc7f5534347a95916a9e86af6312adf87d11406b0623\": rpc error: code = NotFound desc = could not find container \"27696db3e391be3db143fc7f5534347a95916a9e86af6312adf87d11406b0623\": container with ID starting with 27696db3e391be3db143fc7f5534347a95916a9e86af6312adf87d11406b0623 not found: ID does not exist"
Jul 02 19:59:54.364975 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:54.364945    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"]
Jul 02 19:59:54.371374 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:54.371350    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gf54j"]
Jul 02 19:59:56.195947 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:56.195915    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f38f346a-1056-4a54-815a-935b4e65c484" path="/var/lib/kubelet/pods/f38f346a-1056-4a54-815a-935b4e65c484/volumes"
Jul 02 19:59:57.749689 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:57.749655    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:57.997462 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:57.997427    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 19:59:59.986597 ip-10-0-130-14 kubenswrapper[2556]: I0702 19:59:59.986565    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:00.086301 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:00.086247    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:14.805818 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.805784    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"]
Jul 02 20:00:14.806227 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.806093    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f38f346a-1056-4a54-815a-935b4e65c484" containerName="manager"
Jul 02 20:00:14.806227 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.806104    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f38f346a-1056-4a54-815a-935b4e65c484" containerName="manager"
Jul 02 20:00:14.806227 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.806159    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f38f346a-1056-4a54-815a-935b4e65c484" containerName="manager"
Jul 02 20:00:14.810491 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.810468    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"
Jul 02 20:00:14.813020 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.812995    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 20:00:14.813136 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.813040    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6kbnp\""
Jul 02 20:00:14.818285 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.818235    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"]
Jul 02 20:00:14.861940 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.861898    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmmnv\" (UniqueName: \"kubernetes.io/projected/21786723-9f64-420a-afa6-f23bb7384258-kube-api-access-dmmnv\") pod \"limitador-limitador-64c94fd64f-rbvbc\" (UID: \"21786723-9f64-420a-afa6-f23bb7384258\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"
Jul 02 20:00:14.862097 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.861962    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21786723-9f64-420a-afa6-f23bb7384258-config-file\") pod \"limitador-limitador-64c94fd64f-rbvbc\" (UID: \"21786723-9f64-420a-afa6-f23bb7384258\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"
Jul 02 20:00:14.876556 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.876521    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:14.899485 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.899445    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"]
Jul 02 20:00:14.962396 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.962359    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21786723-9f64-420a-afa6-f23bb7384258-config-file\") pod \"limitador-limitador-64c94fd64f-rbvbc\" (UID: \"21786723-9f64-420a-afa6-f23bb7384258\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"
Jul 02 20:00:14.962576 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.962435    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmmnv\" (UniqueName: \"kubernetes.io/projected/21786723-9f64-420a-afa6-f23bb7384258-kube-api-access-dmmnv\") pod \"limitador-limitador-64c94fd64f-rbvbc\" (UID: \"21786723-9f64-420a-afa6-f23bb7384258\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"
Jul 02 20:00:14.962987 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.962966    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21786723-9f64-420a-afa6-f23bb7384258-config-file\") pod \"limitador-limitador-64c94fd64f-rbvbc\" (UID: \"21786723-9f64-420a-afa6-f23bb7384258\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"
Jul 02 20:00:14.972309 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.972255    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmmnv\" (UniqueName: \"kubernetes.io/projected/21786723-9f64-420a-afa6-f23bb7384258-kube-api-access-dmmnv\") pod \"limitador-limitador-64c94fd64f-rbvbc\" (UID: \"21786723-9f64-420a-afa6-f23bb7384258\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"
Jul 02 20:00:14.974680 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:14.974652    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:15.121863 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:15.121774    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"
Jul 02 20:00:15.260368 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:15.260303    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"]
Jul 02 20:00:15.263080 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:00:15.263054    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21786723_9f64_420a_afa6_f23bb7384258.slice/crio-5c0fcf214b0d02da30ebdedbdccb96c4a7b3778d972e8bc68a8eafca91e4cf45 WatchSource:0}: Error finding container 5c0fcf214b0d02da30ebdedbdccb96c4a7b3778d972e8bc68a8eafca91e4cf45: Status 404 returned error can't find the container with id 5c0fcf214b0d02da30ebdedbdccb96c4a7b3778d972e8bc68a8eafca91e4cf45
Jul 02 20:00:15.429115 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:15.429039    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc" event={"ID":"21786723-9f64-420a-afa6-f23bb7384258","Type":"ContainerStarted","Data":"5c0fcf214b0d02da30ebdedbdccb96c4a7b3778d972e8bc68a8eafca91e4cf45"}
Jul 02 20:00:15.685867 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:15.685786    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:15.790154 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:15.790122    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:18.446511 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:18.446471    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc" event={"ID":"21786723-9f64-420a-afa6-f23bb7384258","Type":"ContainerStarted","Data":"6f2c367895a81a666884fe62a2c3dcad391edf5e3cc03412b0896474b556a768"}
Jul 02 20:00:18.447037 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:18.446587    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"
Jul 02 20:00:18.464257 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:18.464176    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc" podStartSLOduration=1.462316417 podStartE2EDuration="4.464158559s" totalImagesPullingTime="3.001842142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:18.463368918 +0000 UTC m=+562.825515981" watchObservedRunningTime="2026-07-02 20:00:18.464158559 +0000 UTC m=+562.826305621"
Jul 02 20:00:29.452328 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:29.452295    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"
Jul 02 20:00:29.992599 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:29.992558    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"]
Jul 02 20:00:29.992805 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:29.992764    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc" podUID="21786723-9f64-420a-afa6-f23bb7384258" containerName="limitador" containerID="cri-o://6f2c367895a81a666884fe62a2c3dcad391edf5e3cc03412b0896474b556a768" gracePeriod=30
Jul 02 20:00:30.497601 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:30.497566    2556 generic.go:356] "Generic (PLEG): container finished" podID="21786723-9f64-420a-afa6-f23bb7384258" containerID="6f2c367895a81a666884fe62a2c3dcad391edf5e3cc03412b0896474b556a768" exitCode=0
Jul 02 20:00:30.497944 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:30.497648    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc" event={"ID":"21786723-9f64-420a-afa6-f23bb7384258","Type":"ContainerDied","Data":"6f2c367895a81a666884fe62a2c3dcad391edf5e3cc03412b0896474b556a768"}
Jul 02 20:00:30.540072 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:30.540045    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"
Jul 02 20:00:30.603057 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:30.602966    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21786723-9f64-420a-afa6-f23bb7384258-config-file\") pod \"21786723-9f64-420a-afa6-f23bb7384258\" (UID: \"21786723-9f64-420a-afa6-f23bb7384258\") "
Jul 02 20:00:30.603057 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:30.603042    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmmnv\" (UniqueName: \"kubernetes.io/projected/21786723-9f64-420a-afa6-f23bb7384258-kube-api-access-dmmnv\") pod \"21786723-9f64-420a-afa6-f23bb7384258\" (UID: \"21786723-9f64-420a-afa6-f23bb7384258\") "
Jul 02 20:00:30.603422 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:30.603396    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21786723-9f64-420a-afa6-f23bb7384258-config-file" (OuterVolumeSpecName: "config-file") pod "21786723-9f64-420a-afa6-f23bb7384258" (UID: "21786723-9f64-420a-afa6-f23bb7384258"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:00:30.605084 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:30.605061    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21786723-9f64-420a-afa6-f23bb7384258-kube-api-access-dmmnv" (OuterVolumeSpecName: "kube-api-access-dmmnv") pod "21786723-9f64-420a-afa6-f23bb7384258" (UID: "21786723-9f64-420a-afa6-f23bb7384258"). InnerVolumeSpecName "kube-api-access-dmmnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:00:30.704540 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:30.704504    2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21786723-9f64-420a-afa6-f23bb7384258-config-file\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:00:30.704540 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:30.704534    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmmnv\" (UniqueName: \"kubernetes.io/projected/21786723-9f64-420a-afa6-f23bb7384258-kube-api-access-dmmnv\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:00:31.437814 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.437781    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-ws9cq"]
Jul 02 20:00:31.438241 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.438225    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21786723-9f64-420a-afa6-f23bb7384258" containerName="limitador"
Jul 02 20:00:31.438313 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.438245    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="21786723-9f64-420a-afa6-f23bb7384258" containerName="limitador"
Jul 02 20:00:31.438380 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.438368    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="21786723-9f64-420a-afa6-f23bb7384258" containerName="limitador"
Jul 02 20:00:31.441721 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.441703    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ws9cq"
Jul 02 20:00:31.444556 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.444530    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vspx7\""
Jul 02 20:00:31.444813 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.444795    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 02 20:00:31.448746 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.448713    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ws9cq"]
Jul 02 20:00:31.479560 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.479529    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:31.503802 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.503773    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"
Jul 02 20:00:31.504176 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.503774    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rbvbc" event={"ID":"21786723-9f64-420a-afa6-f23bb7384258","Type":"ContainerDied","Data":"5c0fcf214b0d02da30ebdedbdccb96c4a7b3778d972e8bc68a8eafca91e4cf45"}
Jul 02 20:00:31.504176 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.503906    2556 scope.go:117] "RemoveContainer" containerID="6f2c367895a81a666884fe62a2c3dcad391edf5e3cc03412b0896474b556a768"
Jul 02 20:00:31.510659 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.510631    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e467aafe-df10-4f34-ad3c-43ebc8cb9363-data\") pod \"postgres-69fb4594cf-ws9cq\" (UID: \"e467aafe-df10-4f34-ad3c-43ebc8cb9363\") " pod="opendatahub/postgres-69fb4594cf-ws9cq"
Jul 02 20:00:31.510790 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.510663    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cvc6\" (UniqueName: \"kubernetes.io/projected/e467aafe-df10-4f34-ad3c-43ebc8cb9363-kube-api-access-6cvc6\") pod \"postgres-69fb4594cf-ws9cq\" (UID: \"e467aafe-df10-4f34-ad3c-43ebc8cb9363\") " pod="opendatahub/postgres-69fb4594cf-ws9cq"
Jul 02 20:00:31.526408 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.526380    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"]
Jul 02 20:00:31.530923 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.530899    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rbvbc"]
Jul 02 20:00:31.611262 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.611233    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e467aafe-df10-4f34-ad3c-43ebc8cb9363-data\") pod \"postgres-69fb4594cf-ws9cq\" (UID: \"e467aafe-df10-4f34-ad3c-43ebc8cb9363\") " pod="opendatahub/postgres-69fb4594cf-ws9cq"
Jul 02 20:00:31.611262 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.611265    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cvc6\" (UniqueName: \"kubernetes.io/projected/e467aafe-df10-4f34-ad3c-43ebc8cb9363-kube-api-access-6cvc6\") pod \"postgres-69fb4594cf-ws9cq\" (UID: \"e467aafe-df10-4f34-ad3c-43ebc8cb9363\") " pod="opendatahub/postgres-69fb4594cf-ws9cq"
Jul 02 20:00:31.611625 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.611606    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e467aafe-df10-4f34-ad3c-43ebc8cb9363-data\") pod \"postgres-69fb4594cf-ws9cq\" (UID: \"e467aafe-df10-4f34-ad3c-43ebc8cb9363\") " pod="opendatahub/postgres-69fb4594cf-ws9cq"
Jul 02 20:00:31.621386 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.621358    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cvc6\" (UniqueName: \"kubernetes.io/projected/e467aafe-df10-4f34-ad3c-43ebc8cb9363-kube-api-access-6cvc6\") pod \"postgres-69fb4594cf-ws9cq\" (UID: \"e467aafe-df10-4f34-ad3c-43ebc8cb9363\") " pod="opendatahub/postgres-69fb4594cf-ws9cq"
Jul 02 20:00:31.753402 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.753367    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ws9cq"
Jul 02 20:00:31.889035 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:31.888983    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ws9cq"]
Jul 02 20:00:31.891329 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:00:31.891302    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode467aafe_df10_4f34_ad3c_43ebc8cb9363.slice/crio-791e1eca44a1cb5eb200f1c775e4a9dfd9afa846de71c3aebd358fd6e7f10242 WatchSource:0}: Error finding container 791e1eca44a1cb5eb200f1c775e4a9dfd9afa846de71c3aebd358fd6e7f10242: Status 404 returned error can't find the container with id 791e1eca44a1cb5eb200f1c775e4a9dfd9afa846de71c3aebd358fd6e7f10242
Jul 02 20:00:32.196705 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:32.196627    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21786723-9f64-420a-afa6-f23bb7384258" path="/var/lib/kubelet/pods/21786723-9f64-420a-afa6-f23bb7384258/volumes"
Jul 02 20:00:32.509572 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:32.509539    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ws9cq" event={"ID":"e467aafe-df10-4f34-ad3c-43ebc8cb9363","Type":"ContainerStarted","Data":"791e1eca44a1cb5eb200f1c775e4a9dfd9afa846de71c3aebd358fd6e7f10242"}
Jul 02 20:00:33.602543 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:33.602512    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:37.533613 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:37.533573    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ws9cq" event={"ID":"e467aafe-df10-4f34-ad3c-43ebc8cb9363","Type":"ContainerStarted","Data":"b96ac0bcf13dade0d77da9a69fceab2208f8bd69a1cb65789e3a30f59e443018"}
Jul 02 20:00:37.534023 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:37.533703    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-ws9cq"
Jul 02 20:00:37.554472 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:37.554420    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-ws9cq" podStartSLOduration=1.7404365259999999 podStartE2EDuration="6.554404574s" totalImagesPullingTime="4.813968048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:37.553203656 +0000 UTC m=+581.915350718" watchObservedRunningTime="2026-07-02 20:00:37.554404574 +0000 UTC m=+581.916551636"
Jul 02 20:00:43.567876 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:43.567847    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-ws9cq"
Jul 02 20:00:43.928007 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:43.927882    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:44.027580 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:44.027532    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:50.399174 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.399138    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f67fddfc6-bs6r2"]
Jul 02 20:00:50.418893 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.418857    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f67fddfc6-bs6r2"]
Jul 02 20:00:50.419055 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.418986    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f67fddfc6-bs6r2"
Jul 02 20:00:50.421848 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.421819    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 20:00:50.422015 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.421863    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-t5q97\""
Jul 02 20:00:50.422708 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.422695    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 20:00:50.427017 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.426993    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:50.523410 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.523377    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:50.571400 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.571357    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dcfceb83-a08e-474d-b40d-fe4fd46ef2b1-webhook-cert\") pod \"maas-controller-f67fddfc6-bs6r2\" (UID: \"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1\") " pod="opendatahub/maas-controller-f67fddfc6-bs6r2"
Jul 02 20:00:50.571590 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.571528    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tzff\" (UniqueName: \"kubernetes.io/projected/dcfceb83-a08e-474d-b40d-fe4fd46ef2b1-kube-api-access-2tzff\") pod \"maas-controller-f67fddfc6-bs6r2\" (UID: \"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1\") " pod="opendatahub/maas-controller-f67fddfc6-bs6r2"
Jul 02 20:00:50.595845 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.595814    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f7795d85f-8fmwh"]
Jul 02 20:00:50.620456 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.620418    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:50.629032 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.629000    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7795d85f-8fmwh"]
Jul 02 20:00:50.629176 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.629109    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7795d85f-8fmwh"
Jul 02 20:00:50.672526 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.672427    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzff\" (UniqueName: \"kubernetes.io/projected/dcfceb83-a08e-474d-b40d-fe4fd46ef2b1-kube-api-access-2tzff\") pod \"maas-controller-f67fddfc6-bs6r2\" (UID: \"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1\") " pod="opendatahub/maas-controller-f67fddfc6-bs6r2"
Jul 02 20:00:50.672526 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.672474    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dcfceb83-a08e-474d-b40d-fe4fd46ef2b1-webhook-cert\") pod \"maas-controller-f67fddfc6-bs6r2\" (UID: \"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1\") " pod="opendatahub/maas-controller-f67fddfc6-bs6r2"
Jul 02 20:00:50.674940 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.674921    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dcfceb83-a08e-474d-b40d-fe4fd46ef2b1-webhook-cert\") pod \"maas-controller-f67fddfc6-bs6r2\" (UID: \"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1\") " pod="opendatahub/maas-controller-f67fddfc6-bs6r2"
Jul 02 20:00:50.681535 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.681513    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tzff\" (UniqueName: \"kubernetes.io/projected/dcfceb83-a08e-474d-b40d-fe4fd46ef2b1-kube-api-access-2tzff\") pod \"maas-controller-f67fddfc6-bs6r2\" (UID: \"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1\") " pod="opendatahub/maas-controller-f67fddfc6-bs6r2"
Jul 02 20:00:50.690235 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.690187    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:50.730386 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.730351    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f67fddfc6-bs6r2"
Jul 02 20:00:50.773608 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.773572    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmt2h\" (UniqueName: \"kubernetes.io/projected/c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7-kube-api-access-fmt2h\") pod \"maas-controller-7f7795d85f-8fmwh\" (UID: \"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7\") " pod="opendatahub/maas-controller-7f7795d85f-8fmwh"
Jul 02 20:00:50.773783 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.773695    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7-webhook-cert\") pod \"maas-controller-7f7795d85f-8fmwh\" (UID: \"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7\") " pod="opendatahub/maas-controller-7f7795d85f-8fmwh"
Jul 02 20:00:50.875159 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.874874    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7-webhook-cert\") pod \"maas-controller-7f7795d85f-8fmwh\" (UID: \"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7\") " pod="opendatahub/maas-controller-7f7795d85f-8fmwh"
Jul 02 20:00:50.875159 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.874950    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmt2h\" (UniqueName: \"kubernetes.io/projected/c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7-kube-api-access-fmt2h\") pod \"maas-controller-7f7795d85f-8fmwh\" (UID: \"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7\") " pod="opendatahub/maas-controller-7f7795d85f-8fmwh"
Jul 02 20:00:50.877031 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.876998    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f67fddfc6-bs6r2"]
Jul 02 20:00:50.877954 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.877930    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7-webhook-cert\") pod \"maas-controller-7f7795d85f-8fmwh\" (UID: \"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7\") " pod="opendatahub/maas-controller-7f7795d85f-8fmwh"
Jul 02 20:00:50.880195 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:00:50.880166    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcfceb83_a08e_474d_b40d_fe4fd46ef2b1.slice/crio-348c952523a19751efd29dc547e0f93fe0f1c3756545cb7950157f21370f9712 WatchSource:0}: Error finding container 348c952523a19751efd29dc547e0f93fe0f1c3756545cb7950157f21370f9712: Status 404 returned error can't find the container with id 348c952523a19751efd29dc547e0f93fe0f1c3756545cb7950157f21370f9712
Jul 02 20:00:50.886902 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.886879    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmt2h\" (UniqueName: \"kubernetes.io/projected/c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7-kube-api-access-fmt2h\") pod \"maas-controller-7f7795d85f-8fmwh\" (UID: \"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7\") " pod="opendatahub/maas-controller-7f7795d85f-8fmwh"
Jul 02 20:00:50.939834 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:50.939748    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7795d85f-8fmwh"
Jul 02 20:00:51.102077 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:51.102043    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7795d85f-8fmwh"]
Jul 02 20:00:51.106418 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:00:51.106392    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3936ddc_aea5_4b2a_b2f3_0631ab09d5b7.slice/crio-2302cdaae9915dbab6b58e061074d40d6041dd956cf7fb75cd561abbbe0e1813 WatchSource:0}: Error finding container 2302cdaae9915dbab6b58e061074d40d6041dd956cf7fb75cd561abbbe0e1813: Status 404 returned error can't find the container with id 2302cdaae9915dbab6b58e061074d40d6041dd956cf7fb75cd561abbbe0e1813
Jul 02 20:00:51.595847 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:51.595800    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f67fddfc6-bs6r2" event={"ID":"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1","Type":"ContainerStarted","Data":"348c952523a19751efd29dc547e0f93fe0f1c3756545cb7950157f21370f9712"}
Jul 02 20:00:51.596922 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:51.596901    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7795d85f-8fmwh" event={"ID":"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7","Type":"ContainerStarted","Data":"2302cdaae9915dbab6b58e061074d40d6041dd956cf7fb75cd561abbbe0e1813"}
Jul 02 20:00:54.452492 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:54.452460    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:54.621334 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:54.621291    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7795d85f-8fmwh" event={"ID":"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7","Type":"ContainerStarted","Data":"b875752eb7a4fa8b6336d08e3ad3cfc03dbaed2e421237aa35caa277fa18b8b3"}
Jul 02 20:00:54.621524 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:54.621366    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f7795d85f-8fmwh"
Jul 02 20:00:54.622667 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:54.622642    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f67fddfc6-bs6r2" event={"ID":"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1","Type":"ContainerStarted","Data":"7dcbba15f2ca1fc3495f84bfc1068986fecdcd48d30dd0e820d321d82165ce26"}
Jul 02 20:00:54.622778 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:54.622763    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f67fddfc6-bs6r2"
Jul 02 20:00:54.674430 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:54.674399    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:00:54.688517 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:54.688377    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f7795d85f-8fmwh" podStartSLOduration=1.575209295 podStartE2EDuration="4.688354723s" totalImagesPullingTime="3.113145428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:54.686809306 +0000 UTC m=+599.048956368" watchObservedRunningTime="2026-07-02 20:00:54.688354723 +0000 UTC m=+599.050501786"
Jul 02 20:00:54.710005 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:00:54.709950    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f67fddfc6-bs6r2" podStartSLOduration=1.3758068780000001 podStartE2EDuration="4.709933298s" totalImagesPullingTime="3.33412642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:54.708722192 +0000 UTC m=+599.070869254" watchObservedRunningTime="2026-07-02 20:00:54.709933298 +0000 UTC m=+599.072080359"
Jul 02 20:01:05.639262 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:05.639230    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f7795d85f-8fmwh"
Jul 02 20:01:05.640651 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:05.639327    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f67fddfc6-bs6r2"
Jul 02 20:01:05.742825 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:05.742784    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f67fddfc6-bs6r2"]
Jul 02 20:01:05.743024 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:05.742999    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-f67fddfc6-bs6r2" podUID="dcfceb83-a08e-474d-b40d-fe4fd46ef2b1" containerName="manager" containerID="cri-o://7dcbba15f2ca1fc3495f84bfc1068986fecdcd48d30dd0e820d321d82165ce26" gracePeriod=30
Jul 02 20:01:05.985264 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:05.985239    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f67fddfc6-bs6r2"
Jul 02 20:01:06.002791 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.002756    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dcfceb83-a08e-474d-b40d-fe4fd46ef2b1-webhook-cert\") pod \"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1\" (UID: \"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1\") "
Jul 02 20:01:06.002966 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.002816    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tzff\" (UniqueName: \"kubernetes.io/projected/dcfceb83-a08e-474d-b40d-fe4fd46ef2b1-kube-api-access-2tzff\") pod \"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1\" (UID: \"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1\") "
Jul 02 20:01:06.005436 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.005403    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcfceb83-a08e-474d-b40d-fe4fd46ef2b1-kube-api-access-2tzff" (OuterVolumeSpecName: "kube-api-access-2tzff") pod "dcfceb83-a08e-474d-b40d-fe4fd46ef2b1" (UID: "dcfceb83-a08e-474d-b40d-fe4fd46ef2b1"). InnerVolumeSpecName "kube-api-access-2tzff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:01:06.005569 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.005430    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcfceb83-a08e-474d-b40d-fe4fd46ef2b1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dcfceb83-a08e-474d-b40d-fe4fd46ef2b1" (UID: "dcfceb83-a08e-474d-b40d-fe4fd46ef2b1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:01:06.104047 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.104010    2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dcfceb83-a08e-474d-b40d-fe4fd46ef2b1-webhook-cert\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:01:06.104047 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.104041    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tzff\" (UniqueName: \"kubernetes.io/projected/dcfceb83-a08e-474d-b40d-fe4fd46ef2b1-kube-api-access-2tzff\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:01:06.681035 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.680999    2556 generic.go:356] "Generic (PLEG): container finished" podID="dcfceb83-a08e-474d-b40d-fe4fd46ef2b1" containerID="7dcbba15f2ca1fc3495f84bfc1068986fecdcd48d30dd0e820d321d82165ce26" exitCode=0
Jul 02 20:01:06.681542 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.681050    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f67fddfc6-bs6r2"
Jul 02 20:01:06.681542 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.681084    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f67fddfc6-bs6r2" event={"ID":"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1","Type":"ContainerDied","Data":"7dcbba15f2ca1fc3495f84bfc1068986fecdcd48d30dd0e820d321d82165ce26"}
Jul 02 20:01:06.681542 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.681156    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f67fddfc6-bs6r2" event={"ID":"dcfceb83-a08e-474d-b40d-fe4fd46ef2b1","Type":"ContainerDied","Data":"348c952523a19751efd29dc547e0f93fe0f1c3756545cb7950157f21370f9712"}
Jul 02 20:01:06.681542 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.681178    2556 scope.go:117] "RemoveContainer" containerID="7dcbba15f2ca1fc3495f84bfc1068986fecdcd48d30dd0e820d321d82165ce26"
Jul 02 20:01:06.689357 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.689338    2556 scope.go:117] "RemoveContainer" containerID="7dcbba15f2ca1fc3495f84bfc1068986fecdcd48d30dd0e820d321d82165ce26"
Jul 02 20:01:06.689637 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:01:06.689614    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dcbba15f2ca1fc3495f84bfc1068986fecdcd48d30dd0e820d321d82165ce26\": container with ID starting with 7dcbba15f2ca1fc3495f84bfc1068986fecdcd48d30dd0e820d321d82165ce26 not found: ID does not exist" containerID="7dcbba15f2ca1fc3495f84bfc1068986fecdcd48d30dd0e820d321d82165ce26"
Jul 02 20:01:06.689736 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.689643    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dcbba15f2ca1fc3495f84bfc1068986fecdcd48d30dd0e820d321d82165ce26"} err="failed to get container status \"7dcbba15f2ca1fc3495f84bfc1068986fecdcd48d30dd0e820d321d82165ce26\": rpc error: code = NotFound desc = could not find container \"7dcbba15f2ca1fc3495f84bfc1068986fecdcd48d30dd0e820d321d82165ce26\": container with ID starting with 7dcbba15f2ca1fc3495f84bfc1068986fecdcd48d30dd0e820d321d82165ce26 not found: ID does not exist"
Jul 02 20:01:06.701300 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.701253    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f67fddfc6-bs6r2"]
Jul 02 20:01:06.707026 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:06.707001    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f67fddfc6-bs6r2"]
Jul 02 20:01:08.196577 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:08.196544    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcfceb83-a08e-474d-b40d-fe4fd46ef2b1" path="/var/lib/kubelet/pods/dcfceb83-a08e-474d-b40d-fe4fd46ef2b1/volumes"
Jul 02 20:01:25.826640 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:25.826609    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:01:26.493063 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.493019    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6fc994789-kclh4"]
Jul 02 20:01:26.493452 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.493434    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcfceb83-a08e-474d-b40d-fe4fd46ef2b1" containerName="manager"
Jul 02 20:01:26.493552 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.493455    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcfceb83-a08e-474d-b40d-fe4fd46ef2b1" containerName="manager"
Jul 02 20:01:26.493552 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.493545    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcfceb83-a08e-474d-b40d-fe4fd46ef2b1" containerName="manager"
Jul 02 20:01:26.496586 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.496563    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:26.499042 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.499020    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 02 20:01:26.499156 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.499099    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-m88m6\""
Jul 02 20:01:26.507220 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.507193    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6fc994789-kclh4"]
Jul 02 20:01:26.559611 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.559567    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ea84ede-2d2d-45cb-91b4-3796a9f25d71-openshift-service-ca\") pod \"maas-api-6fc994789-kclh4\" (UID: \"6ea84ede-2d2d-45cb-91b4-3796a9f25d71\") " pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:26.559611 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.559612    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ea84ede-2d2d-45cb-91b4-3796a9f25d71-maas-api-tls\") pod \"maas-api-6fc994789-kclh4\" (UID: \"6ea84ede-2d2d-45cb-91b4-3796a9f25d71\") " pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:26.559836 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.559631    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrd27\" (UniqueName: \"kubernetes.io/projected/6ea84ede-2d2d-45cb-91b4-3796a9f25d71-kube-api-access-hrd27\") pod \"maas-api-6fc994789-kclh4\" (UID: \"6ea84ede-2d2d-45cb-91b4-3796a9f25d71\") " pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:26.660119 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.660081    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ea84ede-2d2d-45cb-91b4-3796a9f25d71-openshift-service-ca\") pod \"maas-api-6fc994789-kclh4\" (UID: \"6ea84ede-2d2d-45cb-91b4-3796a9f25d71\") " pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:26.660341 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.660129    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ea84ede-2d2d-45cb-91b4-3796a9f25d71-maas-api-tls\") pod \"maas-api-6fc994789-kclh4\" (UID: \"6ea84ede-2d2d-45cb-91b4-3796a9f25d71\") " pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:26.660341 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.660154    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrd27\" (UniqueName: \"kubernetes.io/projected/6ea84ede-2d2d-45cb-91b4-3796a9f25d71-kube-api-access-hrd27\") pod \"maas-api-6fc994789-kclh4\" (UID: \"6ea84ede-2d2d-45cb-91b4-3796a9f25d71\") " pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:26.660341 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:01:26.660263    2556 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 02 20:01:26.660522 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:01:26.660384    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ea84ede-2d2d-45cb-91b4-3796a9f25d71-maas-api-tls podName:6ea84ede-2d2d-45cb-91b4-3796a9f25d71 nodeName:}" failed. No retries permitted until 2026-07-02 20:01:27.160360518 +0000 UTC m=+631.522507577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6ea84ede-2d2d-45cb-91b4-3796a9f25d71-maas-api-tls") pod "maas-api-6fc994789-kclh4" (UID: "6ea84ede-2d2d-45cb-91b4-3796a9f25d71") : secret "maas-api-serving-cert" not found
Jul 02 20:01:26.660836 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.660812    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ea84ede-2d2d-45cb-91b4-3796a9f25d71-openshift-service-ca\") pod \"maas-api-6fc994789-kclh4\" (UID: \"6ea84ede-2d2d-45cb-91b4-3796a9f25d71\") " pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:26.670212 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:26.670187    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrd27\" (UniqueName: \"kubernetes.io/projected/6ea84ede-2d2d-45cb-91b4-3796a9f25d71-kube-api-access-hrd27\") pod \"maas-api-6fc994789-kclh4\" (UID: \"6ea84ede-2d2d-45cb-91b4-3796a9f25d71\") " pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:27.009866 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.009835    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dbzf2"]
Jul 02 20:01:27.013313 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.013267    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-dbzf2"
Jul 02 20:01:27.016630 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.016609    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-crmbr\""
Jul 02 20:01:27.016767 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.016744    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 02 20:01:27.034538 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.034510    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dbzf2"]
Jul 02 20:01:27.066459 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.066416    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9ac2435-354e-446a-93a0-9a44767318e4-plugins-config-volume\") pod \"payload-processing-58f86c7798-dbzf2\" (UID: \"c9ac2435-354e-446a-93a0-9a44767318e4\") " pod="openshift-ingress/payload-processing-58f86c7798-dbzf2"
Jul 02 20:01:27.066625 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.066591    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9jlh\" (UniqueName: \"kubernetes.io/projected/c9ac2435-354e-446a-93a0-9a44767318e4-kube-api-access-x9jlh\") pod \"payload-processing-58f86c7798-dbzf2\" (UID: \"c9ac2435-354e-446a-93a0-9a44767318e4\") " pod="openshift-ingress/payload-processing-58f86c7798-dbzf2"
Jul 02 20:01:27.067837 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.067815    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-t82dn"]
Jul 02 20:01:27.071203 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.071184    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-t82dn"
Jul 02 20:01:27.079934 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.079906    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-t82dn"]
Jul 02 20:01:27.167933 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.167885    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b95h\" (UniqueName: \"kubernetes.io/projected/1a78d0de-750c-4ff4-b784-036b9c2ff5bf-kube-api-access-5b95h\") pod \"payload-pre-processing-7964457696-t82dn\" (UID: \"1a78d0de-750c-4ff4-b784-036b9c2ff5bf\") " pod="openshift-ingress/payload-pre-processing-7964457696-t82dn"
Jul 02 20:01:27.168120 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.167987    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ea84ede-2d2d-45cb-91b4-3796a9f25d71-maas-api-tls\") pod \"maas-api-6fc994789-kclh4\" (UID: \"6ea84ede-2d2d-45cb-91b4-3796a9f25d71\") " pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:27.168120 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.168017    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9jlh\" (UniqueName: \"kubernetes.io/projected/c9ac2435-354e-446a-93a0-9a44767318e4-kube-api-access-x9jlh\") pod \"payload-processing-58f86c7798-dbzf2\" (UID: \"c9ac2435-354e-446a-93a0-9a44767318e4\") " pod="openshift-ingress/payload-processing-58f86c7798-dbzf2"
Jul 02 20:01:27.168120 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.168049    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a78d0de-750c-4ff4-b784-036b9c2ff5bf-plugins-config-volume\") pod \"payload-pre-processing-7964457696-t82dn\" (UID: \"1a78d0de-750c-4ff4-b784-036b9c2ff5bf\") " pod="openshift-ingress/payload-pre-processing-7964457696-t82dn"
Jul 02 20:01:27.168120 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.168068    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9ac2435-354e-446a-93a0-9a44767318e4-plugins-config-volume\") pod \"payload-processing-58f86c7798-dbzf2\" (UID: \"c9ac2435-354e-446a-93a0-9a44767318e4\") " pod="openshift-ingress/payload-processing-58f86c7798-dbzf2"
Jul 02 20:01:27.169021 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.168999    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9ac2435-354e-446a-93a0-9a44767318e4-plugins-config-volume\") pod \"payload-processing-58f86c7798-dbzf2\" (UID: \"c9ac2435-354e-446a-93a0-9a44767318e4\") " pod="openshift-ingress/payload-processing-58f86c7798-dbzf2"
Jul 02 20:01:27.170701 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.170671    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ea84ede-2d2d-45cb-91b4-3796a9f25d71-maas-api-tls\") pod \"maas-api-6fc994789-kclh4\" (UID: \"6ea84ede-2d2d-45cb-91b4-3796a9f25d71\") " pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:27.177700 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.177653    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9jlh\" (UniqueName: \"kubernetes.io/projected/c9ac2435-354e-446a-93a0-9a44767318e4-kube-api-access-x9jlh\") pod \"payload-processing-58f86c7798-dbzf2\" (UID: \"c9ac2435-354e-446a-93a0-9a44767318e4\") " pod="openshift-ingress/payload-processing-58f86c7798-dbzf2"
Jul 02 20:01:27.269097 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.269007    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b95h\" (UniqueName: \"kubernetes.io/projected/1a78d0de-750c-4ff4-b784-036b9c2ff5bf-kube-api-access-5b95h\") pod \"payload-pre-processing-7964457696-t82dn\" (UID: \"1a78d0de-750c-4ff4-b784-036b9c2ff5bf\") " pod="openshift-ingress/payload-pre-processing-7964457696-t82dn"
Jul 02 20:01:27.269097 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.269078    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a78d0de-750c-4ff4-b784-036b9c2ff5bf-plugins-config-volume\") pod \"payload-pre-processing-7964457696-t82dn\" (UID: \"1a78d0de-750c-4ff4-b784-036b9c2ff5bf\") " pod="openshift-ingress/payload-pre-processing-7964457696-t82dn"
Jul 02 20:01:27.269747 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.269727    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a78d0de-750c-4ff4-b784-036b9c2ff5bf-plugins-config-volume\") pod \"payload-pre-processing-7964457696-t82dn\" (UID: \"1a78d0de-750c-4ff4-b784-036b9c2ff5bf\") " pod="openshift-ingress/payload-pre-processing-7964457696-t82dn"
Jul 02 20:01:27.285586 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.285554    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b95h\" (UniqueName: \"kubernetes.io/projected/1a78d0de-750c-4ff4-b784-036b9c2ff5bf-kube-api-access-5b95h\") pod \"payload-pre-processing-7964457696-t82dn\" (UID: \"1a78d0de-750c-4ff4-b784-036b9c2ff5bf\") " pod="openshift-ingress/payload-pre-processing-7964457696-t82dn"
Jul 02 20:01:27.323491 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.323444    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-dbzf2"
Jul 02 20:01:27.363577 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.363534    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:01:27.381844 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.381817    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-t82dn"
Jul 02 20:01:27.407448 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.407410    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:27.481331 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.477766    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dbzf2"]
Jul 02 20:01:27.547403 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.547246    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-t82dn"]
Jul 02 20:01:27.550040 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:01:27.550012    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a78d0de_750c_4ff4_b784_036b9c2ff5bf.slice/crio-29cdb5d51ed73d2ad0facaa5717f3da5b9e74ca5864016028e6cc2e7f96c278c WatchSource:0}: Error finding container 29cdb5d51ed73d2ad0facaa5717f3da5b9e74ca5864016028e6cc2e7f96c278c: Status 404 returned error can't find the container with id 29cdb5d51ed73d2ad0facaa5717f3da5b9e74ca5864016028e6cc2e7f96c278c
Jul 02 20:01:27.575447 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.575413    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6fc994789-kclh4"]
Jul 02 20:01:27.578303 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:01:27.578255    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea84ede_2d2d_45cb_91b4_3796a9f25d71.slice/crio-a21854756232448772c9c1331bd8592b07f7344d78e83ea97d79701a2f70b164 WatchSource:0}: Error finding container a21854756232448772c9c1331bd8592b07f7344d78e83ea97d79701a2f70b164: Status 404 returned error can't find the container with id a21854756232448772c9c1331bd8592b07f7344d78e83ea97d79701a2f70b164
Jul 02 20:01:27.772180 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.772145    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-t82dn" event={"ID":"1a78d0de-750c-4ff4-b784-036b9c2ff5bf","Type":"ContainerStarted","Data":"29cdb5d51ed73d2ad0facaa5717f3da5b9e74ca5864016028e6cc2e7f96c278c"}
Jul 02 20:01:27.773466 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.773439    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-dbzf2" event={"ID":"c9ac2435-354e-446a-93a0-9a44767318e4","Type":"ContainerStarted","Data":"eb87fe8d997febc19aa665a1a76c38a3cfdd826af780fdbcaf5e07903e61d777"}
Jul 02 20:01:27.774619 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:27.774596    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6fc994789-kclh4" event={"ID":"6ea84ede-2d2d-45cb-91b4-3796a9f25d71","Type":"ContainerStarted","Data":"a21854756232448772c9c1331bd8592b07f7344d78e83ea97d79701a2f70b164"}
Jul 02 20:01:29.785963 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:29.785928    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-t82dn" event={"ID":"1a78d0de-750c-4ff4-b784-036b9c2ff5bf","Type":"ContainerStarted","Data":"a4ef1f9ffea2b820c3ece50d735ed11222200dd6e6dd24fcda41789e0207a30f"}
Jul 02 20:01:29.786428 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:29.786100    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-t82dn"
Jul 02 20:01:29.787464 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:29.787441    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-dbzf2" event={"ID":"c9ac2435-354e-446a-93a0-9a44767318e4","Type":"ContainerStarted","Data":"21adac38a61dd3a30016085c6ec468005939493f05e1a7a0dabce5cc2a2601fd"}
Jul 02 20:01:29.787577 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:29.787482    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-dbzf2"
Jul 02 20:01:29.789004 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:29.788975    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6fc994789-kclh4" event={"ID":"6ea84ede-2d2d-45cb-91b4-3796a9f25d71","Type":"ContainerStarted","Data":"31559e6cb1ec0f15f16f39a5f0919d4e5c4853c646bd4079503b0ec4208e060f"}
Jul 02 20:01:29.789116 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:29.789090    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:29.806555 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:29.806501    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-t82dn" podStartSLOduration=0.902371195 podStartE2EDuration="2.806484555s" totalImagesPullingTime="1.90411336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:01:29.805688373 +0000 UTC m=+634.167835435" watchObservedRunningTime="2026-07-02 20:01:29.806484555 +0000 UTC m=+634.168631616"
Jul 02 20:01:29.825010 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:29.824959    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-dbzf2" podStartSLOduration=1.8607746729999999 podStartE2EDuration="3.82494391s" totalImagesPullingTime="1.964169237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:01:29.823296221 +0000 UTC m=+634.185443297" watchObservedRunningTime="2026-07-02 20:01:29.82494391 +0000 UTC m=+634.187090972"
Jul 02 20:01:29.845025 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:29.844971    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6fc994789-kclh4" podStartSLOduration=1.970730263 podStartE2EDuration="3.844954184s" totalImagesPullingTime="1.874223921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:01:29.843164776 +0000 UTC m=+634.205311839" watchObservedRunningTime="2026-07-02 20:01:29.844954184 +0000 UTC m=+634.207101245"
Jul 02 20:01:35.798877 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:35.798845    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6fc994789-kclh4"
Jul 02 20:01:37.394116 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:37.394077    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:01:37.479388 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:37.479352    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:01:39.005011 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:39.004978    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:01:39.095665 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:39.095629    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:01:40.795471 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:40.795441    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-dbzf2"
Jul 02 20:01:40.795939 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:40.795516    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-t82dn"
Jul 02 20:01:48.442902 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:01:48.442863    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:02:03.626710 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:03.626671    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:02:03.753153 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:03.753125    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:02:03.853549 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:03.853517    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:02:08.307852 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.307818    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"]
Jul 02 20:02:08.311060 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.311037    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.314010 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.313970    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 20:02:08.315049 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.315023    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 20:02:08.315175 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.315031    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 02 20:02:08.315175 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.315099    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zdt7w\""
Jul 02 20:02:08.326714 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.326689    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"]
Jul 02 20:02:08.353726 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.353692    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:02:08.421258 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.421221    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff60874d-9906-48a2-98ad-ff9c401795b0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.421258 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.421260    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff60874d-9906-48a2-98ad-ff9c401795b0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.421496 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.421361    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff60874d-9906-48a2-98ad-ff9c401795b0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.421496 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.421410    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff60874d-9906-48a2-98ad-ff9c401795b0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.421496 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.421436    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff60874d-9906-48a2-98ad-ff9c401795b0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.421496 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.421462    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k55xc\" (UniqueName: \"kubernetes.io/projected/ff60874d-9906-48a2-98ad-ff9c401795b0-kube-api-access-k55xc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.522205 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.522172    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff60874d-9906-48a2-98ad-ff9c401795b0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.522205 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.522207    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff60874d-9906-48a2-98ad-ff9c401795b0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.522497 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.522228    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff60874d-9906-48a2-98ad-ff9c401795b0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.522497 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.522366    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff60874d-9906-48a2-98ad-ff9c401795b0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.522619 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.522518    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff60874d-9906-48a2-98ad-ff9c401795b0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.522619 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.522557    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k55xc\" (UniqueName: \"kubernetes.io/projected/ff60874d-9906-48a2-98ad-ff9c401795b0-kube-api-access-k55xc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.522732 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.522665    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff60874d-9906-48a2-98ad-ff9c401795b0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.522732 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.522708    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff60874d-9906-48a2-98ad-ff9c401795b0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.522807 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.522765    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff60874d-9906-48a2-98ad-ff9c401795b0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.524487 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.524465    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff60874d-9906-48a2-98ad-ff9c401795b0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.524732 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.524713    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff60874d-9906-48a2-98ad-ff9c401795b0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.534187 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.534156    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k55xc\" (UniqueName: \"kubernetes.io/projected/ff60874d-9906-48a2-98ad-ff9c401795b0-kube-api-access-k55xc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-slxb9\" (UID: \"ff60874d-9906-48a2-98ad-ff9c401795b0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.621545 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.621442    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:08.763621 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.763591    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"]
Jul 02 20:02:08.765293 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:02:08.765249    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff60874d_9906_48a2_98ad_ff9c401795b0.slice/crio-bf240b89b25192475180aa8bef4b8c00f76972f4283c71f6b7c576a4b4f1e893 WatchSource:0}: Error finding container bf240b89b25192475180aa8bef4b8c00f76972f4283c71f6b7c576a4b4f1e893: Status 404 returned error can't find the container with id bf240b89b25192475180aa8bef4b8c00f76972f4283c71f6b7c576a4b4f1e893
Jul 02 20:02:08.766707 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.766690    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:02:08.974203 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:08.974171    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9" event={"ID":"ff60874d-9906-48a2-98ad-ff9c401795b0","Type":"ContainerStarted","Data":"bf240b89b25192475180aa8bef4b8c00f76972f4283c71f6b7c576a4b4f1e893"}
Jul 02 20:02:09.980661 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:09.980624    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9" event={"ID":"ff60874d-9906-48a2-98ad-ff9c401795b0","Type":"ContainerStarted","Data":"7e3d782689bdd4954b2c1da8cd1c159174607a326ef341158b718a100dc050c1"}
Jul 02 20:02:10.005116 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:10.005059    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9" podStartSLOduration=0.969626687 podStartE2EDuration="2.0050407s" totalImagesPullingTime="1.035414013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:10.003345647 +0000 UTC m=+674.365492710" watchObservedRunningTime="2026-07-02 20:02:10.0050407 +0000 UTC m=+674.367187778"
Jul 02 20:02:18.622329 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:18.622297    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:18.622769 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:18.622363    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:18.634826 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:18.634793    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:19.031314 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:19.031263    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-slxb9"
Jul 02 20:02:25.976592 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:25.976556    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:02:40.694710 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.694672    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"]
Jul 02 20:02:40.698060 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.698043    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.700661 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.700636    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 02 20:02:40.708162 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.708136    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"]
Jul 02 20:02:40.736768 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.736739    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:02:40.806522 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.806488    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.806522 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.806528    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.806727 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.806552    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s26f9\" (UniqueName: \"kubernetes.io/projected/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-kube-api-access-s26f9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.806727 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.806637    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.806727 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.806700    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.806727 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.806724    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.907166 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.907124    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.907166 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.907165    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.907501 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.907199    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.907501 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.907219    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.907501 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.907241    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s26f9\" (UniqueName: \"kubernetes.io/projected/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-kube-api-access-s26f9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.907501 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.907452    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.907715 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.907585    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.907715 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.907641    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.907850 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.907829    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.909535 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.909513    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.910301 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.910251    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:40.919260 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:40.919231    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s26f9\" (UniqueName: \"kubernetes.io/projected/bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74-kube-api-access-s26f9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-s6wkz\" (UID: \"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:41.011039 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:41.011004    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:41.169725 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:41.169689    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"]
Jul 02 20:02:41.181438 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:02:41.181408    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf55e8d8_d5d9_4d1a_9b06_5453e7b8ae74.slice/crio-235a40f414f9c3d05a4fe0a9200b594072931440a2f438e8600d37b042dad202 WatchSource:0}: Error finding container 235a40f414f9c3d05a4fe0a9200b594072931440a2f438e8600d37b042dad202: Status 404 returned error can't find the container with id 235a40f414f9c3d05a4fe0a9200b594072931440a2f438e8600d37b042dad202
Jul 02 20:02:42.124795 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:42.124758    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz" event={"ID":"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74","Type":"ContainerStarted","Data":"a5aea19cb03d582fb0d7ab8152eceb563e7051ac8d53c45fa95390fdf2ab40c5"}
Jul 02 20:02:42.125175 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:42.124818    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz" event={"ID":"bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74","Type":"ContainerStarted","Data":"235a40f414f9c3d05a4fe0a9200b594072931440a2f438e8600d37b042dad202"}
Jul 02 20:02:42.145420 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:42.145363    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz" podStartSLOduration=1.9473687339999999 podStartE2EDuration="2.145347465s" totalImagesPullingTime="197.978731ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:42.143771868 +0000 UTC m=+706.505918931" watchObservedRunningTime="2026-07-02 20:02:42.145347465 +0000 UTC m=+706.507494527"
Jul 02 20:02:45.705005 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:45.704971    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:02:51.011510 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:51.011424    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:51.011510 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:51.011501    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:51.024143 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:51.024113    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:02:51.180600 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:02:51.180564    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-s6wkz"
Jul 02 20:03:55.474402 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:03:55.474371    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:03:55.571865 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:03:55.571832    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:03:56.683791 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:03:56.683744    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:03:56.826910 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:03:56.826879    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:04:13.805658 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:04:13.805627    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:05:12.183613 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.183582    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:05:12.299770 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.299734    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f7795d85f-8fmwh"]
Jul 02 20:05:12.299968 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.299943    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7f7795d85f-8fmwh" podUID="c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7" containerName="manager" containerID="cri-o://b875752eb7a4fa8b6336d08e3ad3cfc03dbaed2e421237aa35caa277fa18b8b3" gracePeriod=30
Jul 02 20:05:12.551647 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.551622    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7795d85f-8fmwh"
Jul 02 20:05:12.568210 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.568182    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7-webhook-cert\") pod \"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7\" (UID: \"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7\") "
Jul 02 20:05:12.568394 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.568240    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmt2h\" (UniqueName: \"kubernetes.io/projected/c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7-kube-api-access-fmt2h\") pod \"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7\" (UID: \"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7\") "
Jul 02 20:05:12.570311 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.570263    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7" (UID: "c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:05:12.570405 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.570343    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7-kube-api-access-fmt2h" (OuterVolumeSpecName: "kube-api-access-fmt2h") pod "c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7" (UID: "c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7"). InnerVolumeSpecName "kube-api-access-fmt2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:05:12.669125 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.669089    2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7-webhook-cert\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:05:12.669125 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.669122    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmt2h\" (UniqueName: \"kubernetes.io/projected/c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7-kube-api-access-fmt2h\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:05:12.814060 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.814024    2556 generic.go:356] "Generic (PLEG): container finished" podID="c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7" containerID="b875752eb7a4fa8b6336d08e3ad3cfc03dbaed2e421237aa35caa277fa18b8b3" exitCode=0
Jul 02 20:05:12.814241 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.814064    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7795d85f-8fmwh"
Jul 02 20:05:12.814241 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.814106    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7795d85f-8fmwh" event={"ID":"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7","Type":"ContainerDied","Data":"b875752eb7a4fa8b6336d08e3ad3cfc03dbaed2e421237aa35caa277fa18b8b3"}
Jul 02 20:05:12.814241 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.814163    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7795d85f-8fmwh" event={"ID":"c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7","Type":"ContainerDied","Data":"2302cdaae9915dbab6b58e061074d40d6041dd956cf7fb75cd561abbbe0e1813"}
Jul 02 20:05:12.814241 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.814190    2556 scope.go:117] "RemoveContainer" containerID="b875752eb7a4fa8b6336d08e3ad3cfc03dbaed2e421237aa35caa277fa18b8b3"
Jul 02 20:05:12.830080 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.830054    2556 scope.go:117] "RemoveContainer" containerID="b875752eb7a4fa8b6336d08e3ad3cfc03dbaed2e421237aa35caa277fa18b8b3"
Jul 02 20:05:12.830680 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:05:12.830647    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b875752eb7a4fa8b6336d08e3ad3cfc03dbaed2e421237aa35caa277fa18b8b3\": container with ID starting with b875752eb7a4fa8b6336d08e3ad3cfc03dbaed2e421237aa35caa277fa18b8b3 not found: ID does not exist" containerID="b875752eb7a4fa8b6336d08e3ad3cfc03dbaed2e421237aa35caa277fa18b8b3"
Jul 02 20:05:12.830823 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.830690    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b875752eb7a4fa8b6336d08e3ad3cfc03dbaed2e421237aa35caa277fa18b8b3"} err="failed to get container status \"b875752eb7a4fa8b6336d08e3ad3cfc03dbaed2e421237aa35caa277fa18b8b3\": rpc error: code = NotFound desc = could not find container \"b875752eb7a4fa8b6336d08e3ad3cfc03dbaed2e421237aa35caa277fa18b8b3\": container with ID starting with b875752eb7a4fa8b6336d08e3ad3cfc03dbaed2e421237aa35caa277fa18b8b3 not found: ID does not exist"
Jul 02 20:05:12.852534 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.852504    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f7795d85f-8fmwh"]
Jul 02 20:05:12.853967 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:12.853946    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f7795d85f-8fmwh"]
Jul 02 20:05:13.568410 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.568354    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:05:13.669497 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.669463    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f7795d85f-czhz4"]
Jul 02 20:05:13.669824 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.669812    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7" containerName="manager"
Jul 02 20:05:13.669866 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.669825    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7" containerName="manager"
Jul 02 20:05:13.669899 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.669879    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7" containerName="manager"
Jul 02 20:05:13.674186 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.674167    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7795d85f-czhz4"
Jul 02 20:05:13.676746 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.676719    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-t5q97\""
Jul 02 20:05:13.676746 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.676733    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 20:05:13.676896 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.676772    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 20:05:13.682583 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.682557    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7795d85f-czhz4"]
Jul 02 20:05:13.779230 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.779197    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59dbccf9-29b8-49a7-b267-d12d6862f421-webhook-cert\") pod \"maas-controller-7f7795d85f-czhz4\" (UID: \"59dbccf9-29b8-49a7-b267-d12d6862f421\") " pod="opendatahub/maas-controller-7f7795d85f-czhz4"
Jul 02 20:05:13.779230 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.779233    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn6xf\" (UniqueName: \"kubernetes.io/projected/59dbccf9-29b8-49a7-b267-d12d6862f421-kube-api-access-nn6xf\") pod \"maas-controller-7f7795d85f-czhz4\" (UID: \"59dbccf9-29b8-49a7-b267-d12d6862f421\") " pod="opendatahub/maas-controller-7f7795d85f-czhz4"
Jul 02 20:05:13.880560 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.880448    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59dbccf9-29b8-49a7-b267-d12d6862f421-webhook-cert\") pod \"maas-controller-7f7795d85f-czhz4\" (UID: \"59dbccf9-29b8-49a7-b267-d12d6862f421\") " pod="opendatahub/maas-controller-7f7795d85f-czhz4"
Jul 02 20:05:13.880560 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.880502    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn6xf\" (UniqueName: \"kubernetes.io/projected/59dbccf9-29b8-49a7-b267-d12d6862f421-kube-api-access-nn6xf\") pod \"maas-controller-7f7795d85f-czhz4\" (UID: \"59dbccf9-29b8-49a7-b267-d12d6862f421\") " pod="opendatahub/maas-controller-7f7795d85f-czhz4"
Jul 02 20:05:13.883021 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.882996    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59dbccf9-29b8-49a7-b267-d12d6862f421-webhook-cert\") pod \"maas-controller-7f7795d85f-czhz4\" (UID: \"59dbccf9-29b8-49a7-b267-d12d6862f421\") " pod="opendatahub/maas-controller-7f7795d85f-czhz4"
Jul 02 20:05:13.891292 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.891251    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn6xf\" (UniqueName: \"kubernetes.io/projected/59dbccf9-29b8-49a7-b267-d12d6862f421-kube-api-access-nn6xf\") pod \"maas-controller-7f7795d85f-czhz4\" (UID: \"59dbccf9-29b8-49a7-b267-d12d6862f421\") " pod="opendatahub/maas-controller-7f7795d85f-czhz4"
Jul 02 20:05:13.985466 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:13.985418    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7795d85f-czhz4"
Jul 02 20:05:14.129487 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:14.129457    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7795d85f-czhz4"]
Jul 02 20:05:14.132855 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:05:14.132790    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59dbccf9_29b8_49a7_b267_d12d6862f421.slice/crio-fb2028441975e64952fe8b9566152be955b3a20a6854a7867b301926a336ae82 WatchSource:0}: Error finding container fb2028441975e64952fe8b9566152be955b3a20a6854a7867b301926a336ae82: Status 404 returned error can't find the container with id fb2028441975e64952fe8b9566152be955b3a20a6854a7867b301926a336ae82
Jul 02 20:05:14.196792 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:14.196763    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7" path="/var/lib/kubelet/pods/c3936ddc-aea5-4b2a-b2f3-0631ab09d5b7/volumes"
Jul 02 20:05:14.824800 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:14.824763    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7795d85f-czhz4" event={"ID":"59dbccf9-29b8-49a7-b267-d12d6862f421","Type":"ContainerStarted","Data":"fb2028441975e64952fe8b9566152be955b3a20a6854a7867b301926a336ae82"}
Jul 02 20:05:15.830765 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:15.830729    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7795d85f-czhz4" event={"ID":"59dbccf9-29b8-49a7-b267-d12d6862f421","Type":"ContainerStarted","Data":"395a3f1ef3e106ae574c3dc30f7ce69a4f034956e3ab62b427bc0c429a9e654d"}
Jul 02 20:05:15.831172 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:15.830830    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f7795d85f-czhz4"
Jul 02 20:05:15.850735 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:15.850687    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f7795d85f-czhz4" podStartSLOduration=2.003122741 podStartE2EDuration="2.850669368s" totalImagesPullingTime="847.546627ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:05:15.848920195 +0000 UTC m=+860.211067277" watchObservedRunningTime="2026-07-02 20:05:15.850669368 +0000 UTC m=+860.212816429"
Jul 02 20:05:26.840830 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:26.840792    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f7795d85f-czhz4"
Jul 02 20:05:46.947352 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:46.947303    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:05:50.318840 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:50.318760    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:05:50.417679 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:50.417644    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:05:50.519099 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:50.519062    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:05:56.904204 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:56.904171    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:05:56.969495 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:56.969462    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:05:57.124165 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:57.124110    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:05:57.225739 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:57.225704    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:05:57.325097 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:05:57.325050    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:06:02.985955 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:06:02.985916    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:06:03.049005 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:06:03.048949    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:06:13.494429 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:06:13.494394    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:07:10.285102 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:07:10.285051    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:07:11.678592 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:07:11.678559    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:09:46.549524 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:46.549491    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:09:46.636552 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:46.636519    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:09:54.981070 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:54.981033    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"]
Jul 02 20:09:54.981499 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:54.981233    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k" podUID="370c73a6-d7b8-442f-8f13-e51117d1e7cf" containerName="manager" containerID="cri-o://a7da058585561e689c0ce8eff5dd54f800a36c0fb8f66e99703199bdf6a7ee03" gracePeriod=10
Jul 02 20:09:57.936296 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:57.936248    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"
Jul 02 20:09:57.964943 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:57.964911    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgz92\" (UniqueName: \"kubernetes.io/projected/370c73a6-d7b8-442f-8f13-e51117d1e7cf-kube-api-access-qgz92\") pod \"370c73a6-d7b8-442f-8f13-e51117d1e7cf\" (UID: \"370c73a6-d7b8-442f-8f13-e51117d1e7cf\") "
Jul 02 20:09:57.965130 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:57.964967    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370c73a6-d7b8-442f-8f13-e51117d1e7cf-extensions-socket-volume\") pod \"370c73a6-d7b8-442f-8f13-e51117d1e7cf\" (UID: \"370c73a6-d7b8-442f-8f13-e51117d1e7cf\") "
Jul 02 20:09:57.965473 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:57.965445    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/370c73a6-d7b8-442f-8f13-e51117d1e7cf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "370c73a6-d7b8-442f-8f13-e51117d1e7cf" (UID: "370c73a6-d7b8-442f-8f13-e51117d1e7cf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:09:57.967011 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:57.966988    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/370c73a6-d7b8-442f-8f13-e51117d1e7cf-kube-api-access-qgz92" (OuterVolumeSpecName: "kube-api-access-qgz92") pod "370c73a6-d7b8-442f-8f13-e51117d1e7cf" (UID: "370c73a6-d7b8-442f-8f13-e51117d1e7cf"). InnerVolumeSpecName "kube-api-access-qgz92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:09:58.066697 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:58.066613    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/370c73a6-d7b8-442f-8f13-e51117d1e7cf-extensions-socket-volume\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:09:58.066697 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:58.066644    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgz92\" (UniqueName: \"kubernetes.io/projected/370c73a6-d7b8-442f-8f13-e51117d1e7cf-kube-api-access-qgz92\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:09:58.104212 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:58.104178    2556 generic.go:356] "Generic (PLEG): container finished" podID="370c73a6-d7b8-442f-8f13-e51117d1e7cf" containerID="a7da058585561e689c0ce8eff5dd54f800a36c0fb8f66e99703199bdf6a7ee03" exitCode=0
Jul 02 20:09:58.104533 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:58.104230    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"
Jul 02 20:09:58.104533 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:58.104235    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k" event={"ID":"370c73a6-d7b8-442f-8f13-e51117d1e7cf","Type":"ContainerDied","Data":"a7da058585561e689c0ce8eff5dd54f800a36c0fb8f66e99703199bdf6a7ee03"}
Jul 02 20:09:58.104533 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:58.104315    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k" event={"ID":"370c73a6-d7b8-442f-8f13-e51117d1e7cf","Type":"ContainerDied","Data":"287af2772fd8d1fa02e6cf3a62e6e79dbe4437b3f69017d7f96f154103b9457e"}
Jul 02 20:09:58.104533 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:58.104347    2556 scope.go:117] "RemoveContainer" containerID="a7da058585561e689c0ce8eff5dd54f800a36c0fb8f66e99703199bdf6a7ee03"
Jul 02 20:09:58.113908 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:58.113886    2556 scope.go:117] "RemoveContainer" containerID="a7da058585561e689c0ce8eff5dd54f800a36c0fb8f66e99703199bdf6a7ee03"
Jul 02 20:09:58.114180 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:09:58.114158    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7da058585561e689c0ce8eff5dd54f800a36c0fb8f66e99703199bdf6a7ee03\": container with ID starting with a7da058585561e689c0ce8eff5dd54f800a36c0fb8f66e99703199bdf6a7ee03 not found: ID does not exist" containerID="a7da058585561e689c0ce8eff5dd54f800a36c0fb8f66e99703199bdf6a7ee03"
Jul 02 20:09:58.114219 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:58.114191    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7da058585561e689c0ce8eff5dd54f800a36c0fb8f66e99703199bdf6a7ee03"} err="failed to get container status \"a7da058585561e689c0ce8eff5dd54f800a36c0fb8f66e99703199bdf6a7ee03\": rpc error: code = NotFound desc = could not find container \"a7da058585561e689c0ce8eff5dd54f800a36c0fb8f66e99703199bdf6a7ee03\": container with ID starting with a7da058585561e689c0ce8eff5dd54f800a36c0fb8f66e99703199bdf6a7ee03 not found: ID does not exist"
Jul 02 20:09:58.126186 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:58.126156    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"]
Jul 02 20:09:58.130013 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:58.129990    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gsr8k"]
Jul 02 20:09:58.195861 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:09:58.195830    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="370c73a6-d7b8-442f-8f13-e51117d1e7cf" path="/var/lib/kubelet/pods/370c73a6-d7b8-442f-8f13-e51117d1e7cf/volumes"
Jul 02 20:10:56.123247 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.123211    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4"]
Jul 02 20:10:56.123871 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.123731    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="370c73a6-d7b8-442f-8f13-e51117d1e7cf" containerName="manager"
Jul 02 20:10:56.123871 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.123749    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="370c73a6-d7b8-442f-8f13-e51117d1e7cf" containerName="manager"
Jul 02 20:10:56.123871 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.123831    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="370c73a6-d7b8-442f-8f13-e51117d1e7cf" containerName="manager"
Jul 02 20:10:56.127235 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.127214    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4"
Jul 02 20:10:56.130573 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.130542    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 20:10:56.130753 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.130734    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-249s6\""
Jul 02 20:10:56.131479 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.131459    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 20:10:56.139675 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.139654    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4"]
Jul 02 20:10:56.165800 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.165760    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lgmj\" (UniqueName: \"kubernetes.io/projected/2dffc891-b2bf-46e2-9fff-ccb575d0c14f-kube-api-access-6lgmj\") pod \"kuadrant-operator-controller-manager-86878c769f-vvbh4\" (UID: \"2dffc891-b2bf-46e2-9fff-ccb575d0c14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4"
Jul 02 20:10:56.165800 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.165805    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dffc891-b2bf-46e2-9fff-ccb575d0c14f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vvbh4\" (UID: \"2dffc891-b2bf-46e2-9fff-ccb575d0c14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4"
Jul 02 20:10:56.266822 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.266781    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lgmj\" (UniqueName: \"kubernetes.io/projected/2dffc891-b2bf-46e2-9fff-ccb575d0c14f-kube-api-access-6lgmj\") pod \"kuadrant-operator-controller-manager-86878c769f-vvbh4\" (UID: \"2dffc891-b2bf-46e2-9fff-ccb575d0c14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4"
Jul 02 20:10:56.266822 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.266826    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dffc891-b2bf-46e2-9fff-ccb575d0c14f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vvbh4\" (UID: \"2dffc891-b2bf-46e2-9fff-ccb575d0c14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4"
Jul 02 20:10:56.267168 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.267153    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dffc891-b2bf-46e2-9fff-ccb575d0c14f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vvbh4\" (UID: \"2dffc891-b2bf-46e2-9fff-ccb575d0c14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4"
Jul 02 20:10:56.278035 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.278003    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lgmj\" (UniqueName: \"kubernetes.io/projected/2dffc891-b2bf-46e2-9fff-ccb575d0c14f-kube-api-access-6lgmj\") pod \"kuadrant-operator-controller-manager-86878c769f-vvbh4\" (UID: \"2dffc891-b2bf-46e2-9fff-ccb575d0c14f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4"
Jul 02 20:10:56.439714 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.439635    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4"
Jul 02 20:10:56.585088 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:56.585051    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4"]
Jul 02 20:10:56.589459 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:10:56.589432    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dffc891_b2bf_46e2_9fff_ccb575d0c14f.slice/crio-d3d9b1b9d71954b53bf90b0afec89a9fe4c91446078bbf9f29caddaff51914e4 WatchSource:0}: Error finding container d3d9b1b9d71954b53bf90b0afec89a9fe4c91446078bbf9f29caddaff51914e4: Status 404 returned error can't find the container with id d3d9b1b9d71954b53bf90b0afec89a9fe4c91446078bbf9f29caddaff51914e4
Jul 02 20:10:57.369734 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:57.369686    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4" event={"ID":"2dffc891-b2bf-46e2-9fff-ccb575d0c14f","Type":"ContainerStarted","Data":"a99e20b653039461505409e2a336d7435c22080f5e84b4f8af6aee0940a18c22"}
Jul 02 20:10:57.370172 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:57.369754    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4" event={"ID":"2dffc891-b2bf-46e2-9fff-ccb575d0c14f","Type":"ContainerStarted","Data":"d3d9b1b9d71954b53bf90b0afec89a9fe4c91446078bbf9f29caddaff51914e4"}
Jul 02 20:10:57.370172 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:57.369798    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4"
Jul 02 20:10:57.390770 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:10:57.390714    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4" podStartSLOduration=1.390697213 podStartE2EDuration="1.390697213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:10:57.387745401 +0000 UTC m=+1201.749892463" watchObservedRunningTime="2026-07-02 20:10:57.390697213 +0000 UTC m=+1201.752844322"
Jul 02 20:11:08.375552 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:11:08.375509    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vvbh4"
Jul 02 20:15:41.441169 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:15:41.441133    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:16:38.106565 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:16:38.106531    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:16:45.553148 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:16:45.553106    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:16:53.815754 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:16:53.815719    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:16:54.702402 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:16:54.702366    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:16:58.898185 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:16:58.898145    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:01.701319 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:01.701257    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:01.801057 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:01.801024    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:02.157816 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:02.157788    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:07.880308 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:07.880182    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:07.980977 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:07.980943    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:08.102966 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:08.102920    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:08.178460 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:08.178381    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:09.300050 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.300017    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:09.360775 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.360744    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"]
Jul 02 20:17:09.364034 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.364010    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:09.368109 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.368090    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-f2f1ff11-serving-cert\""
Jul 02 20:17:09.383067 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.383028    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"]
Jul 02 20:17:09.433739 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.433704    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:09.447285 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.447249    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnttk\" (UniqueName: \"kubernetes.io/projected/240ec286-7d53-4756-ba28-1a51d2a434b1-kube-api-access-dnttk\") pod \"maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5\" (UID: \"240ec286-7d53-4756-ba28-1a51d2a434b1\") " pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:09.447465 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.447371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240ec286-7d53-4756-ba28-1a51d2a434b1-openshift-service-ca\") pod \"maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5\" (UID: \"240ec286-7d53-4756-ba28-1a51d2a434b1\") " pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:09.447465 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.447427    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240ec286-7d53-4756-ba28-1a51d2a434b1-maas-api-tls\") pod \"maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5\" (UID: \"240ec286-7d53-4756-ba28-1a51d2a434b1\") " pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:09.525465 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.525428    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:09.548327 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.548262    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240ec286-7d53-4756-ba28-1a51d2a434b1-maas-api-tls\") pod \"maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5\" (UID: \"240ec286-7d53-4756-ba28-1a51d2a434b1\") " pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:09.548496 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.548357    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnttk\" (UniqueName: \"kubernetes.io/projected/240ec286-7d53-4756-ba28-1a51d2a434b1-kube-api-access-dnttk\") pod \"maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5\" (UID: \"240ec286-7d53-4756-ba28-1a51d2a434b1\") " pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:09.548496 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.548424    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240ec286-7d53-4756-ba28-1a51d2a434b1-openshift-service-ca\") pod \"maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5\" (UID: \"240ec286-7d53-4756-ba28-1a51d2a434b1\") " pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:09.549044 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.549024    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240ec286-7d53-4756-ba28-1a51d2a434b1-openshift-service-ca\") pod \"maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5\" (UID: \"240ec286-7d53-4756-ba28-1a51d2a434b1\") " pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:09.550771 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.550727    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240ec286-7d53-4756-ba28-1a51d2a434b1-maas-api-tls\") pod \"maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5\" (UID: \"240ec286-7d53-4756-ba28-1a51d2a434b1\") " pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:09.559007 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.558981    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnttk\" (UniqueName: \"kubernetes.io/projected/240ec286-7d53-4756-ba28-1a51d2a434b1-kube-api-access-dnttk\") pod \"maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5\" (UID: \"240ec286-7d53-4756-ba28-1a51d2a434b1\") " pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:09.674180 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.674144    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:09.811949 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.811840    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"]
Jul 02 20:17:09.814988 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:17:09.814960    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240ec286_7d53_4756_ba28_1a51d2a434b1.slice/crio-d7d0f94f8e3949eca5000baed27112e30ff2f3fb41c151565d8ab9ef6e9960f2 WatchSource:0}: Error finding container d7d0f94f8e3949eca5000baed27112e30ff2f3fb41c151565d8ab9ef6e9960f2: Status 404 returned error can't find the container with id d7d0f94f8e3949eca5000baed27112e30ff2f3fb41c151565d8ab9ef6e9960f2
Jul 02 20:17:09.816655 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.816638    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:17:09.942647 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:09.942611    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:10.043560 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:10.043524    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:10.069708 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:10.069627    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5" event={"ID":"240ec286-7d53-4756-ba28-1a51d2a434b1","Type":"ContainerStarted","Data":"d7d0f94f8e3949eca5000baed27112e30ff2f3fb41c151565d8ab9ef6e9960f2"}
Jul 02 20:17:11.075822 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:11.075786    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5" event={"ID":"240ec286-7d53-4756-ba28-1a51d2a434b1","Type":"ContainerStarted","Data":"24a6edc642de83839727bd012bce537ef5f5c01544a9542be602bc1fc03ac2a8"}
Jul 02 20:17:11.076259 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:11.075920    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:11.093648 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:11.093595    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5" podStartSLOduration=1.515255542 podStartE2EDuration="2.093577161s" totalImagesPullingTime="578.321619ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:17:11.092042202 +0000 UTC m=+1575.454189264" watchObservedRunningTime="2026-07-02 20:17:11.093577161 +0000 UTC m=+1575.455724223"
Jul 02 20:17:11.858672 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:11.858642    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:14.401809 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:14.401776    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:14.578494 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:14.578462    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:14.710031 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:14.709941    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:14.766647 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:14.766606    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"]
Jul 02 20:17:14.766857 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:14.766831    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5" podUID="240ec286-7d53-4756-ba28-1a51d2a434b1" containerName="maas-api" containerID="cri-o://24a6edc642de83839727bd012bce537ef5f5c01544a9542be602bc1fc03ac2a8" gracePeriod=30
Jul 02 20:17:14.851656 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:14.851621    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:15.014629 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.014603    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:15.093217 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.093189    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240ec286-7d53-4756-ba28-1a51d2a434b1-maas-api-tls\") pod \"240ec286-7d53-4756-ba28-1a51d2a434b1\" (UID: \"240ec286-7d53-4756-ba28-1a51d2a434b1\") "
Jul 02 20:17:15.093410 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.093262    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnttk\" (UniqueName: \"kubernetes.io/projected/240ec286-7d53-4756-ba28-1a51d2a434b1-kube-api-access-dnttk\") pod \"240ec286-7d53-4756-ba28-1a51d2a434b1\" (UID: \"240ec286-7d53-4756-ba28-1a51d2a434b1\") "
Jul 02 20:17:15.093410 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.093381    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240ec286-7d53-4756-ba28-1a51d2a434b1-openshift-service-ca\") pod \"240ec286-7d53-4756-ba28-1a51d2a434b1\" (UID: \"240ec286-7d53-4756-ba28-1a51d2a434b1\") "
Jul 02 20:17:15.093748 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.093724    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/240ec286-7d53-4756-ba28-1a51d2a434b1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "240ec286-7d53-4756-ba28-1a51d2a434b1" (UID: "240ec286-7d53-4756-ba28-1a51d2a434b1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:17:15.095559 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.095528    2556 generic.go:356] "Generic (PLEG): container finished" podID="240ec286-7d53-4756-ba28-1a51d2a434b1" containerID="24a6edc642de83839727bd012bce537ef5f5c01544a9542be602bc1fc03ac2a8" exitCode=0
Jul 02 20:17:15.095707 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.095569    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240ec286-7d53-4756-ba28-1a51d2a434b1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "240ec286-7d53-4756-ba28-1a51d2a434b1" (UID: "240ec286-7d53-4756-ba28-1a51d2a434b1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:17:15.095707 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.095578    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5" event={"ID":"240ec286-7d53-4756-ba28-1a51d2a434b1","Type":"ContainerDied","Data":"24a6edc642de83839727bd012bce537ef5f5c01544a9542be602bc1fc03ac2a8"}
Jul 02 20:17:15.095707 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.095592    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"
Jul 02 20:17:15.095707 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.095664    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/240ec286-7d53-4756-ba28-1a51d2a434b1-kube-api-access-dnttk" (OuterVolumeSpecName: "kube-api-access-dnttk") pod "240ec286-7d53-4756-ba28-1a51d2a434b1" (UID: "240ec286-7d53-4756-ba28-1a51d2a434b1"). InnerVolumeSpecName "kube-api-access-dnttk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:17:15.095707 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.095678    2556 scope.go:117] "RemoveContainer" containerID="24a6edc642de83839727bd012bce537ef5f5c01544a9542be602bc1fc03ac2a8"
Jul 02 20:17:15.095933 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.095643    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5" event={"ID":"240ec286-7d53-4756-ba28-1a51d2a434b1","Type":"ContainerDied","Data":"d7d0f94f8e3949eca5000baed27112e30ff2f3fb41c151565d8ab9ef6e9960f2"}
Jul 02 20:17:15.111995 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.111977    2556 scope.go:117] "RemoveContainer" containerID="24a6edc642de83839727bd012bce537ef5f5c01544a9542be602bc1fc03ac2a8"
Jul 02 20:17:15.112328 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:17:15.112307    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24a6edc642de83839727bd012bce537ef5f5c01544a9542be602bc1fc03ac2a8\": container with ID starting with 24a6edc642de83839727bd012bce537ef5f5c01544a9542be602bc1fc03ac2a8 not found: ID does not exist" containerID="24a6edc642de83839727bd012bce537ef5f5c01544a9542be602bc1fc03ac2a8"
Jul 02 20:17:15.112399 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.112341    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a6edc642de83839727bd012bce537ef5f5c01544a9542be602bc1fc03ac2a8"} err="failed to get container status \"24a6edc642de83839727bd012bce537ef5f5c01544a9542be602bc1fc03ac2a8\": rpc error: code = NotFound desc = could not find container \"24a6edc642de83839727bd012bce537ef5f5c01544a9542be602bc1fc03ac2a8\": container with ID starting with 24a6edc642de83839727bd012bce537ef5f5c01544a9542be602bc1fc03ac2a8 not found: ID does not exist"
Jul 02 20:17:15.123670 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.123641    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"]
Jul 02 20:17:15.126967 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.126943    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-f2f1ff11-5c87f9b55c-bxsd5"]
Jul 02 20:17:15.194079 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.194045    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/240ec286-7d53-4756-ba28-1a51d2a434b1-openshift-service-ca\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:17:15.194079 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.194072    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/240ec286-7d53-4756-ba28-1a51d2a434b1-maas-api-tls\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:17:15.194079 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:15.194082    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnttk\" (UniqueName: \"kubernetes.io/projected/240ec286-7d53-4756-ba28-1a51d2a434b1-kube-api-access-dnttk\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:17:16.202013 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:16.201977    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="240ec286-7d53-4756-ba28-1a51d2a434b1" path="/var/lib/kubelet/pods/240ec286-7d53-4756-ba28-1a51d2a434b1/volumes"
Jul 02 20:17:16.377894 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:16.377861    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:20.069341 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:20.069302    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:20.179644 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:20.179597    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:20.600610 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:20.600572    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:20.701664 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:20.701637    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:20.795017 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:20.794974    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:20.855333 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:20.855238    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:21.991448 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:21.991407    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:22.054060 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.054028    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"]
Jul 02 20:17:22.054464 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.054448    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240ec286-7d53-4756-ba28-1a51d2a434b1" containerName="maas-api"
Jul 02 20:17:22.054560 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.054468    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="240ec286-7d53-4756-ba28-1a51d2a434b1" containerName="maas-api"
Jul 02 20:17:22.054617 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.054601    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="240ec286-7d53-4756-ba28-1a51d2a434b1" containerName="maas-api"
Jul 02 20:17:22.058885 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.058860    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:22.061564 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.061538    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-c837d017-serving-cert\""
Jul 02 20:17:22.068421 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.068376    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"]
Jul 02 20:17:22.083992 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.083958    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:22.155629 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.155593    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951f33fd-15db-46eb-8c84-0467b6794b94-maas-api-tls\") pod \"maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z\" (UID: \"951f33fd-15db-46eb-8c84-0467b6794b94\") " pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:22.155816 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.155638    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x7zt\" (UniqueName: \"kubernetes.io/projected/951f33fd-15db-46eb-8c84-0467b6794b94-kube-api-access-5x7zt\") pod \"maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z\" (UID: \"951f33fd-15db-46eb-8c84-0467b6794b94\") " pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:22.155816 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.155689    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951f33fd-15db-46eb-8c84-0467b6794b94-openshift-service-ca\") pod \"maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z\" (UID: \"951f33fd-15db-46eb-8c84-0467b6794b94\") " pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:22.159076 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.159051    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:22.256518 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.256423    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951f33fd-15db-46eb-8c84-0467b6794b94-maas-api-tls\") pod \"maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z\" (UID: \"951f33fd-15db-46eb-8c84-0467b6794b94\") " pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:22.256518 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.256476    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x7zt\" (UniqueName: \"kubernetes.io/projected/951f33fd-15db-46eb-8c84-0467b6794b94-kube-api-access-5x7zt\") pod \"maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z\" (UID: \"951f33fd-15db-46eb-8c84-0467b6794b94\") " pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:22.256518 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.256523    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951f33fd-15db-46eb-8c84-0467b6794b94-openshift-service-ca\") pod \"maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z\" (UID: \"951f33fd-15db-46eb-8c84-0467b6794b94\") " pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:22.256757 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:17:22.256597    2556 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-c837d017-serving-cert: secret "maas-api-e2e-ait-c837d017-serving-cert" not found
Jul 02 20:17:22.256757 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:17:22.256676    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/951f33fd-15db-46eb-8c84-0467b6794b94-maas-api-tls podName:951f33fd-15db-46eb-8c84-0467b6794b94 nodeName:}" failed. No retries permitted until 2026-07-02 20:17:22.756658808 +0000 UTC m=+1587.118805852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/951f33fd-15db-46eb-8c84-0467b6794b94-maas-api-tls") pod "maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z" (UID: "951f33fd-15db-46eb-8c84-0467b6794b94") : secret "maas-api-e2e-ait-c837d017-serving-cert" not found
Jul 02 20:17:22.257219 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.257198    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951f33fd-15db-46eb-8c84-0467b6794b94-openshift-service-ca\") pod \"maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z\" (UID: \"951f33fd-15db-46eb-8c84-0467b6794b94\") " pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:22.265777 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.265752    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x7zt\" (UniqueName: \"kubernetes.io/projected/951f33fd-15db-46eb-8c84-0467b6794b94-kube-api-access-5x7zt\") pod \"maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z\" (UID: \"951f33fd-15db-46eb-8c84-0467b6794b94\") " pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:22.418443 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.418393    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:22.656657 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.656524    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:22.759331 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.759255    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:22.761047 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.761025    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951f33fd-15db-46eb-8c84-0467b6794b94-maas-api-tls\") pod \"maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z\" (UID: \"951f33fd-15db-46eb-8c84-0467b6794b94\") " pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:22.763600 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.763580    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951f33fd-15db-46eb-8c84-0467b6794b94-maas-api-tls\") pod \"maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z\" (UID: \"951f33fd-15db-46eb-8c84-0467b6794b94\") " pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:22.971890 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:22.971857    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:23.113360 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:23.113329    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"]
Jul 02 20:17:23.115967 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:17:23.115932    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod951f33fd_15db_46eb_8c84_0467b6794b94.slice/crio-250e48f361ae88c191da3ad50d310933feaa55d1c7d6d77d41a6fcf80ee81286 WatchSource:0}: Error finding container 250e48f361ae88c191da3ad50d310933feaa55d1c7d6d77d41a6fcf80ee81286: Status 404 returned error can't find the container with id 250e48f361ae88c191da3ad50d310933feaa55d1c7d6d77d41a6fcf80ee81286
Jul 02 20:17:23.136244 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:23.136210    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z" event={"ID":"951f33fd-15db-46eb-8c84-0467b6794b94","Type":"ContainerStarted","Data":"250e48f361ae88c191da3ad50d310933feaa55d1c7d6d77d41a6fcf80ee81286"}
Jul 02 20:17:24.142826 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:24.142792    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z" event={"ID":"951f33fd-15db-46eb-8c84-0467b6794b94","Type":"ContainerStarted","Data":"a17af96d71b91a4586f2414a1ae2595b9f530c1f39e662fa30d391c80d5dda81"}
Jul 02 20:17:24.143212 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:24.142854    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:24.161049 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:24.160991    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z" podStartSLOduration=1.645752469 podStartE2EDuration="2.160974697s" totalImagesPullingTime="515.222228ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:17:24.160253602 +0000 UTC m=+1588.522400664" watchObservedRunningTime="2026-07-02 20:17:24.160974697 +0000 UTC m=+1588.523121758"
Jul 02 20:17:24.433251 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:24.433197    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:27.089655 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.089611    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:27.380204 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.380112    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"]
Jul 02 20:17:27.380389 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.380365    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z" podUID="951f33fd-15db-46eb-8c84-0467b6794b94" containerName="maas-api" containerID="cri-o://a17af96d71b91a4586f2414a1ae2595b9f530c1f39e662fa30d391c80d5dda81" gracePeriod=30
Jul 02 20:17:27.401217 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.401189    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:27.628561 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.628533    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:27.707419 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.707328    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x7zt\" (UniqueName: \"kubernetes.io/projected/951f33fd-15db-46eb-8c84-0467b6794b94-kube-api-access-5x7zt\") pod \"951f33fd-15db-46eb-8c84-0467b6794b94\" (UID: \"951f33fd-15db-46eb-8c84-0467b6794b94\") "
Jul 02 20:17:27.707419 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.707385    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951f33fd-15db-46eb-8c84-0467b6794b94-maas-api-tls\") pod \"951f33fd-15db-46eb-8c84-0467b6794b94\" (UID: \"951f33fd-15db-46eb-8c84-0467b6794b94\") "
Jul 02 20:17:27.707592 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.707451    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951f33fd-15db-46eb-8c84-0467b6794b94-openshift-service-ca\") pod \"951f33fd-15db-46eb-8c84-0467b6794b94\" (UID: \"951f33fd-15db-46eb-8c84-0467b6794b94\") "
Jul 02 20:17:27.707807 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.707785    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/951f33fd-15db-46eb-8c84-0467b6794b94-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "951f33fd-15db-46eb-8c84-0467b6794b94" (UID: "951f33fd-15db-46eb-8c84-0467b6794b94"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:17:27.709441 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.709413    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951f33fd-15db-46eb-8c84-0467b6794b94-kube-api-access-5x7zt" (OuterVolumeSpecName: "kube-api-access-5x7zt") pod "951f33fd-15db-46eb-8c84-0467b6794b94" (UID: "951f33fd-15db-46eb-8c84-0467b6794b94"). InnerVolumeSpecName "kube-api-access-5x7zt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:17:27.709536 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.709479    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951f33fd-15db-46eb-8c84-0467b6794b94-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "951f33fd-15db-46eb-8c84-0467b6794b94" (UID: "951f33fd-15db-46eb-8c84-0467b6794b94"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:17:27.808760 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.808709    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951f33fd-15db-46eb-8c84-0467b6794b94-maas-api-tls\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:17:27.808760 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.808755    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951f33fd-15db-46eb-8c84-0467b6794b94-openshift-service-ca\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:17:27.808760 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:27.808766    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5x7zt\" (UniqueName: \"kubernetes.io/projected/951f33fd-15db-46eb-8c84-0467b6794b94-kube-api-access-5x7zt\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:17:28.170127 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:28.170083    2556 generic.go:356] "Generic (PLEG): container finished" podID="951f33fd-15db-46eb-8c84-0467b6794b94" containerID="a17af96d71b91a4586f2414a1ae2595b9f530c1f39e662fa30d391c80d5dda81" exitCode=0
Jul 02 20:17:28.170623 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:28.170157    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"
Jul 02 20:17:28.170623 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:28.170160    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z" event={"ID":"951f33fd-15db-46eb-8c84-0467b6794b94","Type":"ContainerDied","Data":"a17af96d71b91a4586f2414a1ae2595b9f530c1f39e662fa30d391c80d5dda81"}
Jul 02 20:17:28.170623 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:28.170327    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z" event={"ID":"951f33fd-15db-46eb-8c84-0467b6794b94","Type":"ContainerDied","Data":"250e48f361ae88c191da3ad50d310933feaa55d1c7d6d77d41a6fcf80ee81286"}
Jul 02 20:17:28.170623 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:28.170351    2556 scope.go:117] "RemoveContainer" containerID="a17af96d71b91a4586f2414a1ae2595b9f530c1f39e662fa30d391c80d5dda81"
Jul 02 20:17:28.179129 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:28.179111    2556 scope.go:117] "RemoveContainer" containerID="a17af96d71b91a4586f2414a1ae2595b9f530c1f39e662fa30d391c80d5dda81"
Jul 02 20:17:28.179437 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:17:28.179418    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a17af96d71b91a4586f2414a1ae2595b9f530c1f39e662fa30d391c80d5dda81\": container with ID starting with a17af96d71b91a4586f2414a1ae2595b9f530c1f39e662fa30d391c80d5dda81 not found: ID does not exist" containerID="a17af96d71b91a4586f2414a1ae2595b9f530c1f39e662fa30d391c80d5dda81"
Jul 02 20:17:28.179527 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:28.179447    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a17af96d71b91a4586f2414a1ae2595b9f530c1f39e662fa30d391c80d5dda81"} err="failed to get container status \"a17af96d71b91a4586f2414a1ae2595b9f530c1f39e662fa30d391c80d5dda81\": rpc error: code = NotFound desc = could not find container \"a17af96d71b91a4586f2414a1ae2595b9f530c1f39e662fa30d391c80d5dda81\": container with ID starting with a17af96d71b91a4586f2414a1ae2595b9f530c1f39e662fa30d391c80d5dda81 not found: ID does not exist"
Jul 02 20:17:28.196093 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:28.196067    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"]
Jul 02 20:17:28.196093 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:28.196099    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-c837d017-7cfc7677ff-lz48z"]
Jul 02 20:17:30.195860 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:30.195826    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="951f33fd-15db-46eb-8c84-0467b6794b94" path="/var/lib/kubelet/pods/951f33fd-15db-46eb-8c84-0467b6794b94/volumes"
Jul 02 20:17:33.458416 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:33.458376    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:33.559588 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:33.559553    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:35.542462 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:35.542425    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:39.439384 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:39.439345    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:39.539576 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:39.539540    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:39.678986 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:39.678957    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:39.742573 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:39.742527    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:40.867647 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:40.867608    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:40.924385 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:40.924351    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"]
Jul 02 20:17:40.924906 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:40.924887    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951f33fd-15db-46eb-8c84-0467b6794b94" containerName="maas-api"
Jul 02 20:17:40.924960 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:40.924911    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="951f33fd-15db-46eb-8c84-0467b6794b94" containerName="maas-api"
Jul 02 20:17:40.925037 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:40.925024    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="951f33fd-15db-46eb-8c84-0467b6794b94" containerName="maas-api"
Jul 02 20:17:40.929673 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:40.929650    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:40.932233 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:40.932209    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-1535425b-serving-cert\""
Jul 02 20:17:40.938573 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:40.938547    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"]
Jul 02 20:17:40.972445 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:40.972410    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:41.022750 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.022713    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a2a696-0323-43a9-ae00-c999a35616d9-maas-api-tls\") pod \"maas-api-e2e-derive-1535425b-679d59fd78-sh87p\" (UID: \"44a2a696-0323-43a9-ae00-c999a35616d9\") " pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:41.022933 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.022776    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44a2a696-0323-43a9-ae00-c999a35616d9-openshift-service-ca\") pod \"maas-api-e2e-derive-1535425b-679d59fd78-sh87p\" (UID: \"44a2a696-0323-43a9-ae00-c999a35616d9\") " pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:41.022933 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.022805    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8gsj\" (UniqueName: \"kubernetes.io/projected/44a2a696-0323-43a9-ae00-c999a35616d9-kube-api-access-s8gsj\") pod \"maas-api-e2e-derive-1535425b-679d59fd78-sh87p\" (UID: \"44a2a696-0323-43a9-ae00-c999a35616d9\") " pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:41.072665 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.072632    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:41.123585 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.123493    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a2a696-0323-43a9-ae00-c999a35616d9-maas-api-tls\") pod \"maas-api-e2e-derive-1535425b-679d59fd78-sh87p\" (UID: \"44a2a696-0323-43a9-ae00-c999a35616d9\") " pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:41.123585 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.123539    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44a2a696-0323-43a9-ae00-c999a35616d9-openshift-service-ca\") pod \"maas-api-e2e-derive-1535425b-679d59fd78-sh87p\" (UID: \"44a2a696-0323-43a9-ae00-c999a35616d9\") " pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:41.123585 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.123561    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8gsj\" (UniqueName: \"kubernetes.io/projected/44a2a696-0323-43a9-ae00-c999a35616d9-kube-api-access-s8gsj\") pod \"maas-api-e2e-derive-1535425b-679d59fd78-sh87p\" (UID: \"44a2a696-0323-43a9-ae00-c999a35616d9\") " pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:41.123873 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:17:41.123665    2556 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-1535425b-serving-cert: secret "maas-api-e2e-derive-1535425b-serving-cert" not found
Jul 02 20:17:41.123873 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:17:41.123758    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a2a696-0323-43a9-ae00-c999a35616d9-maas-api-tls podName:44a2a696-0323-43a9-ae00-c999a35616d9 nodeName:}" failed. No retries permitted until 2026-07-02 20:17:41.623733574 +0000 UTC m=+1605.985880614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/44a2a696-0323-43a9-ae00-c999a35616d9-maas-api-tls") pod "maas-api-e2e-derive-1535425b-679d59fd78-sh87p" (UID: "44a2a696-0323-43a9-ae00-c999a35616d9") : secret "maas-api-e2e-derive-1535425b-serving-cert" not found
Jul 02 20:17:41.124319 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.124301    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44a2a696-0323-43a9-ae00-c999a35616d9-openshift-service-ca\") pod \"maas-api-e2e-derive-1535425b-679d59fd78-sh87p\" (UID: \"44a2a696-0323-43a9-ae00-c999a35616d9\") " pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:41.132952 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.132927    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8gsj\" (UniqueName: \"kubernetes.io/projected/44a2a696-0323-43a9-ae00-c999a35616d9-kube-api-access-s8gsj\") pod \"maas-api-e2e-derive-1535425b-679d59fd78-sh87p\" (UID: \"44a2a696-0323-43a9-ae00-c999a35616d9\") " pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:41.336980 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.336952    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:41.606329 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.606298    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:41.627636 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.627599    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a2a696-0323-43a9-ae00-c999a35616d9-maas-api-tls\") pod \"maas-api-e2e-derive-1535425b-679d59fd78-sh87p\" (UID: \"44a2a696-0323-43a9-ae00-c999a35616d9\") " pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:41.630090 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.630070    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a2a696-0323-43a9-ae00-c999a35616d9-maas-api-tls\") pod \"maas-api-e2e-derive-1535425b-679d59fd78-sh87p\" (UID: \"44a2a696-0323-43a9-ae00-c999a35616d9\") " pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:41.707319 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.707248    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:41.842789 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.842749    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:41.995152 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:41.995126    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"]
Jul 02 20:17:41.997961 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:17:41.997933    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a2a696_0323_43a9_ae00_c999a35616d9.slice/crio-453fed9e8d6243cccfed78bc151cc86f9aea445f725c6276e2de5f3582cf871e WatchSource:0}: Error finding container 453fed9e8d6243cccfed78bc151cc86f9aea445f725c6276e2de5f3582cf871e: Status 404 returned error can't find the container with id 453fed9e8d6243cccfed78bc151cc86f9aea445f725c6276e2de5f3582cf871e
Jul 02 20:17:42.233807 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:42.233772    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p" event={"ID":"44a2a696-0323-43a9-ae00-c999a35616d9","Type":"ContainerStarted","Data":"453fed9e8d6243cccfed78bc151cc86f9aea445f725c6276e2de5f3582cf871e"}
Jul 02 20:17:42.892971 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:42.892941    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:43.239816 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:43.239783    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p" event={"ID":"44a2a696-0323-43a9-ae00-c999a35616d9","Type":"ContainerStarted","Data":"4bc5de322e3b2c8a4516c3618359ac53bb81ed870555d8a4a7bd5f567f6c56d8"}
Jul 02 20:17:43.240268 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:43.239853    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:43.257941 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:43.257875    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p" podStartSLOduration=2.832459715 podStartE2EDuration="3.257852244s" totalImagesPullingTime="425.392529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:17:43.256143653 +0000 UTC m=+1607.618290716" watchObservedRunningTime="2026-07-02 20:17:43.257852244 +0000 UTC m=+1607.619999307"
Jul 02 20:17:45.349007 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:45.348971    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:45.508665 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:45.508637    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:45.614498 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:45.614419    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:45.658258 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:45.658215    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"]
Jul 02 20:17:45.658551 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:45.658466    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p" podUID="44a2a696-0323-43a9-ae00-c999a35616d9" containerName="maas-api" containerID="cri-o://4bc5de322e3b2c8a4516c3618359ac53bb81ed870555d8a4a7bd5f567f6c56d8" gracePeriod=30
Jul 02 20:17:45.695792 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:45.695764    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:45.916035 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:45.916011    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:45.963514 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:45.963482    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44a2a696-0323-43a9-ae00-c999a35616d9-openshift-service-ca\") pod \"44a2a696-0323-43a9-ae00-c999a35616d9\" (UID: \"44a2a696-0323-43a9-ae00-c999a35616d9\") "
Jul 02 20:17:45.963680 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:45.963587    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a2a696-0323-43a9-ae00-c999a35616d9-maas-api-tls\") pod \"44a2a696-0323-43a9-ae00-c999a35616d9\" (UID: \"44a2a696-0323-43a9-ae00-c999a35616d9\") "
Jul 02 20:17:45.963680 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:45.963640    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8gsj\" (UniqueName: \"kubernetes.io/projected/44a2a696-0323-43a9-ae00-c999a35616d9-kube-api-access-s8gsj\") pod \"44a2a696-0323-43a9-ae00-c999a35616d9\" (UID: \"44a2a696-0323-43a9-ae00-c999a35616d9\") "
Jul 02 20:17:45.963854 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:45.963830    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44a2a696-0323-43a9-ae00-c999a35616d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "44a2a696-0323-43a9-ae00-c999a35616d9" (UID: "44a2a696-0323-43a9-ae00-c999a35616d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:17:45.965701 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:45.965677    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44a2a696-0323-43a9-ae00-c999a35616d9-kube-api-access-s8gsj" (OuterVolumeSpecName: "kube-api-access-s8gsj") pod "44a2a696-0323-43a9-ae00-c999a35616d9" (UID: "44a2a696-0323-43a9-ae00-c999a35616d9"). InnerVolumeSpecName "kube-api-access-s8gsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:17:45.965774 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:45.965709    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44a2a696-0323-43a9-ae00-c999a35616d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "44a2a696-0323-43a9-ae00-c999a35616d9" (UID: "44a2a696-0323-43a9-ae00-c999a35616d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:17:46.064925 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:46.064881    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a2a696-0323-43a9-ae00-c999a35616d9-maas-api-tls\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:17:46.064925 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:46.064916    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8gsj\" (UniqueName: \"kubernetes.io/projected/44a2a696-0323-43a9-ae00-c999a35616d9-kube-api-access-s8gsj\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:17:46.064925 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:46.064927    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44a2a696-0323-43a9-ae00-c999a35616d9-openshift-service-ca\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:17:46.255480 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:46.255442    2556 generic.go:356] "Generic (PLEG): container finished" podID="44a2a696-0323-43a9-ae00-c999a35616d9" containerID="4bc5de322e3b2c8a4516c3618359ac53bb81ed870555d8a4a7bd5f567f6c56d8" exitCode=0
Jul 02 20:17:46.255688 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:46.255487    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"
Jul 02 20:17:46.255688 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:46.255537    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p" event={"ID":"44a2a696-0323-43a9-ae00-c999a35616d9","Type":"ContainerDied","Data":"4bc5de322e3b2c8a4516c3618359ac53bb81ed870555d8a4a7bd5f567f6c56d8"}
Jul 02 20:17:46.255688 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:46.255593    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p" event={"ID":"44a2a696-0323-43a9-ae00-c999a35616d9","Type":"ContainerDied","Data":"453fed9e8d6243cccfed78bc151cc86f9aea445f725c6276e2de5f3582cf871e"}
Jul 02 20:17:46.255688 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:46.255618    2556 scope.go:117] "RemoveContainer" containerID="4bc5de322e3b2c8a4516c3618359ac53bb81ed870555d8a4a7bd5f567f6c56d8"
Jul 02 20:17:46.264949 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:46.264929    2556 scope.go:117] "RemoveContainer" containerID="4bc5de322e3b2c8a4516c3618359ac53bb81ed870555d8a4a7bd5f567f6c56d8"
Jul 02 20:17:46.265292 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:17:46.265240    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc5de322e3b2c8a4516c3618359ac53bb81ed870555d8a4a7bd5f567f6c56d8\": container with ID starting with 4bc5de322e3b2c8a4516c3618359ac53bb81ed870555d8a4a7bd5f567f6c56d8 not found: ID does not exist" containerID="4bc5de322e3b2c8a4516c3618359ac53bb81ed870555d8a4a7bd5f567f6c56d8"
Jul 02 20:17:46.265438 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:46.265300    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc5de322e3b2c8a4516c3618359ac53bb81ed870555d8a4a7bd5f567f6c56d8"} err="failed to get container status \"4bc5de322e3b2c8a4516c3618359ac53bb81ed870555d8a4a7bd5f567f6c56d8\": rpc error: code = NotFound desc = could not find container \"4bc5de322e3b2c8a4516c3618359ac53bb81ed870555d8a4a7bd5f567f6c56d8\": container with ID starting with 4bc5de322e3b2c8a4516c3618359ac53bb81ed870555d8a4a7bd5f567f6c56d8 not found: ID does not exist"
Jul 02 20:17:46.272368 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:46.272334    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"]
Jul 02 20:17:46.276630 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:46.276598    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-1535425b-679d59fd78-sh87p"]
Jul 02 20:17:46.933924 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:46.933890    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:48.202358 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:48.202263    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44a2a696-0323-43a9-ae00-c999a35616d9" path="/var/lib/kubelet/pods/44a2a696-0323-43a9-ae00-c999a35616d9/volumes"
Jul 02 20:17:51.196365 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:51.196316    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:51.301151 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:51.301119    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:51.690636 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:51.690603    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:51.777614 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:51.777578    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:51.877140 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:51.877103    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:53.253703 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:53.253671    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:59.248182 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:59.248150    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:59.320368 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:59.320328    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:59.413841 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:59.413810    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:59.511583 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:59.511500    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:59.611206 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:59.611168    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:17:59.969898 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:17:59.969810    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:18:25.926498 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:18:25.926463    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:18:32.135889 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:18:32.135852    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:18:32.278018 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:18:32.277984    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:18:32.378946 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:18:32.378918    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:18:48.217897 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:18:48.217862    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:18:54.037302 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:18:54.037239    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:18:54.148361 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:18:54.148328    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:18:54.237261 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:18:54.237223    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:04.783826 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:04.783782    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:05.585285 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:05.585248    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:11.306671 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:11.306631    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:11.367293 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:11.367243    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:11.453472 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:11.453435    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:11.553153 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:11.553117    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:11.655324 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:11.655208    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:12.420768 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:12.420738    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:12.523851 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:12.523822    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:12.619799 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:12.619769    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:14.206161 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:14.206128    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:20.158476 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:20.158444    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:20.226744 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:20.226709    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:20.831574 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:20.831536    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:26.883881 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:26.883847    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:27.020045 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:27.020010    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:27.110479 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:27.110450    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:27.421146 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:27.421118    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:27.569502 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:27.569473    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:30.192959 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.192916    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:30.256055 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.256023    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"]
Jul 02 20:19:30.256450 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.256437    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44a2a696-0323-43a9-ae00-c999a35616d9" containerName="maas-api"
Jul 02 20:19:30.256450 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.256451    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="44a2a696-0323-43a9-ae00-c999a35616d9" containerName="maas-api"
Jul 02 20:19:30.256571 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.256507    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="44a2a696-0323-43a9-ae00-c999a35616d9" containerName="maas-api"
Jul 02 20:19:30.259507 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.259485    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:30.262234 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.262211    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-29f89d80-serving-cert\""
Jul 02 20:19:30.270860 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.270837    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"]
Jul 02 20:19:30.280150 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.280121    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:30.347406 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.347371    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:30.363461 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.363426    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s44s5\" (UniqueName: \"kubernetes.io/projected/df30fd8f-5636-4986-b518-f7bd303cad0b-kube-api-access-s44s5\") pod \"maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc\" (UID: \"df30fd8f-5636-4986-b518-f7bd303cad0b\") " pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:30.363615 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.363468    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df30fd8f-5636-4986-b518-f7bd303cad0b-maas-api-tls\") pod \"maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc\" (UID: \"df30fd8f-5636-4986-b518-f7bd303cad0b\") " pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:30.363615 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.363572    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df30fd8f-5636-4986-b518-f7bd303cad0b-openshift-service-ca\") pod \"maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc\" (UID: \"df30fd8f-5636-4986-b518-f7bd303cad0b\") " pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:30.465079 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.464976    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s44s5\" (UniqueName: \"kubernetes.io/projected/df30fd8f-5636-4986-b518-f7bd303cad0b-kube-api-access-s44s5\") pod \"maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc\" (UID: \"df30fd8f-5636-4986-b518-f7bd303cad0b\") " pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:30.465079 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.465033    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df30fd8f-5636-4986-b518-f7bd303cad0b-maas-api-tls\") pod \"maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc\" (UID: \"df30fd8f-5636-4986-b518-f7bd303cad0b\") " pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:30.465371 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:19:30.465149    2556 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-29f89d80-serving-cert: secret "maas-api-e2e-mt-29f89d80-serving-cert" not found
Jul 02 20:19:30.465371 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.465190    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df30fd8f-5636-4986-b518-f7bd303cad0b-openshift-service-ca\") pod \"maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc\" (UID: \"df30fd8f-5636-4986-b518-f7bd303cad0b\") " pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:30.465371 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:19:30.465213    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df30fd8f-5636-4986-b518-f7bd303cad0b-maas-api-tls podName:df30fd8f-5636-4986-b518-f7bd303cad0b nodeName:}" failed. No retries permitted until 2026-07-02 20:19:30.965191586 +0000 UTC m=+1715.327338626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df30fd8f-5636-4986-b518-f7bd303cad0b-maas-api-tls") pod "maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc" (UID: "df30fd8f-5636-4986-b518-f7bd303cad0b") : secret "maas-api-e2e-mt-29f89d80-serving-cert" not found
Jul 02 20:19:30.465857 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.465837    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df30fd8f-5636-4986-b518-f7bd303cad0b-openshift-service-ca\") pod \"maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc\" (UID: \"df30fd8f-5636-4986-b518-f7bd303cad0b\") " pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:30.475247 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.475216    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s44s5\" (UniqueName: \"kubernetes.io/projected/df30fd8f-5636-4986-b518-f7bd303cad0b-kube-api-access-s44s5\") pod \"maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc\" (UID: \"df30fd8f-5636-4986-b518-f7bd303cad0b\") " pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:30.627490 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.627457    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:30.943050 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.943013    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:30.970350 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.970308    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df30fd8f-5636-4986-b518-f7bd303cad0b-maas-api-tls\") pod \"maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc\" (UID: \"df30fd8f-5636-4986-b518-f7bd303cad0b\") " pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:30.972693 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:30.972671    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df30fd8f-5636-4986-b518-f7bd303cad0b-maas-api-tls\") pod \"maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc\" (UID: \"df30fd8f-5636-4986-b518-f7bd303cad0b\") " pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:31.073121 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:31.073090    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:31.170250 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:31.170213    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:31.310485 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:31.310455    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"]
Jul 02 20:19:31.313771 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:19:31.313737    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf30fd8f_5636_4986_b518_f7bd303cad0b.slice/crio-dd16d5f8b3907421310559af9037a9cdb6d96dd8070aa6f23ca36938b86ce7eb WatchSource:0}: Error finding container dd16d5f8b3907421310559af9037a9cdb6d96dd8070aa6f23ca36938b86ce7eb: Status 404 returned error can't find the container with id dd16d5f8b3907421310559af9037a9cdb6d96dd8070aa6f23ca36938b86ce7eb
Jul 02 20:19:31.725363 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:31.725326    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc" event={"ID":"df30fd8f-5636-4986-b518-f7bd303cad0b","Type":"ContainerStarted","Data":"dd16d5f8b3907421310559af9037a9cdb6d96dd8070aa6f23ca36938b86ce7eb"}
Jul 02 20:19:32.731444 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:32.731405    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc" event={"ID":"df30fd8f-5636-4986-b518-f7bd303cad0b","Type":"ContainerStarted","Data":"50b42063ff1c4eba8aa71b08994c98d561b35c6779ac14d92a266f9253f9cf87"}
Jul 02 20:19:32.731977 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:32.731490    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:32.748177 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:32.748122    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc" podStartSLOduration=2.116927558 podStartE2EDuration="2.748104434s" totalImagesPullingTime="631.176876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:19:32.746099269 +0000 UTC m=+1717.108246344" watchObservedRunningTime="2026-07-02 20:19:32.748104434 +0000 UTC m=+1717.110251495"
Jul 02 20:19:34.906483 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:34.906447    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:35.937367 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:35.937333    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:36.037379 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:36.037345    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:36.497933 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:36.497892    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:38.742653 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:38.742625    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:42.336405 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:42.336376    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:42.398721 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:42.398691    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:42.814744 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:42.814706    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:43.081784 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.081692    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"]
Jul 02 20:19:43.082004 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.081900    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc" podUID="df30fd8f-5636-4986-b518-f7bd303cad0b" containerName="maas-api" containerID="cri-o://50b42063ff1c4eba8aa71b08994c98d561b35c6779ac14d92a266f9253f9cf87" gracePeriod=30
Jul 02 20:19:43.114618 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.114584    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:43.177503 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.177470    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:43.341649 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.341573    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:43.384147 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.384107    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df30fd8f-5636-4986-b518-f7bd303cad0b-maas-api-tls\") pod \"df30fd8f-5636-4986-b518-f7bd303cad0b\" (UID: \"df30fd8f-5636-4986-b518-f7bd303cad0b\") "
Jul 02 20:19:43.384407 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.384178    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df30fd8f-5636-4986-b518-f7bd303cad0b-openshift-service-ca\") pod \"df30fd8f-5636-4986-b518-f7bd303cad0b\" (UID: \"df30fd8f-5636-4986-b518-f7bd303cad0b\") "
Jul 02 20:19:43.384407 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.384239    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s44s5\" (UniqueName: \"kubernetes.io/projected/df30fd8f-5636-4986-b518-f7bd303cad0b-kube-api-access-s44s5\") pod \"df30fd8f-5636-4986-b518-f7bd303cad0b\" (UID: \"df30fd8f-5636-4986-b518-f7bd303cad0b\") "
Jul 02 20:19:43.384694 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.384660    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df30fd8f-5636-4986-b518-f7bd303cad0b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df30fd8f-5636-4986-b518-f7bd303cad0b" (UID: "df30fd8f-5636-4986-b518-f7bd303cad0b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:19:43.386304 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.386282    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df30fd8f-5636-4986-b518-f7bd303cad0b-kube-api-access-s44s5" (OuterVolumeSpecName: "kube-api-access-s44s5") pod "df30fd8f-5636-4986-b518-f7bd303cad0b" (UID: "df30fd8f-5636-4986-b518-f7bd303cad0b"). InnerVolumeSpecName "kube-api-access-s44s5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:19:43.386449 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.386429    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df30fd8f-5636-4986-b518-f7bd303cad0b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df30fd8f-5636-4986-b518-f7bd303cad0b" (UID: "df30fd8f-5636-4986-b518-f7bd303cad0b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:19:43.485064 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.485021    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df30fd8f-5636-4986-b518-f7bd303cad0b-maas-api-tls\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:19:43.485064 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.485053    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df30fd8f-5636-4986-b518-f7bd303cad0b-openshift-service-ca\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:19:43.485064 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.485064    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s44s5\" (UniqueName: \"kubernetes.io/projected/df30fd8f-5636-4986-b518-f7bd303cad0b-kube-api-access-s44s5\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:19:43.783878 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.783841    2556 generic.go:356] "Generic (PLEG): container finished" podID="df30fd8f-5636-4986-b518-f7bd303cad0b" containerID="50b42063ff1c4eba8aa71b08994c98d561b35c6779ac14d92a266f9253f9cf87" exitCode=0
Jul 02 20:19:43.783878 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.783882    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"
Jul 02 20:19:43.784109 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.783913    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc" event={"ID":"df30fd8f-5636-4986-b518-f7bd303cad0b","Type":"ContainerDied","Data":"50b42063ff1c4eba8aa71b08994c98d561b35c6779ac14d92a266f9253f9cf87"}
Jul 02 20:19:43.784109 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.783964    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc" event={"ID":"df30fd8f-5636-4986-b518-f7bd303cad0b","Type":"ContainerDied","Data":"dd16d5f8b3907421310559af9037a9cdb6d96dd8070aa6f23ca36938b86ce7eb"}
Jul 02 20:19:43.784109 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.783985    2556 scope.go:117] "RemoveContainer" containerID="50b42063ff1c4eba8aa71b08994c98d561b35c6779ac14d92a266f9253f9cf87"
Jul 02 20:19:43.793689 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.793670    2556 scope.go:117] "RemoveContainer" containerID="50b42063ff1c4eba8aa71b08994c98d561b35c6779ac14d92a266f9253f9cf87"
Jul 02 20:19:43.793980 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:19:43.793951    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50b42063ff1c4eba8aa71b08994c98d561b35c6779ac14d92a266f9253f9cf87\": container with ID starting with 50b42063ff1c4eba8aa71b08994c98d561b35c6779ac14d92a266f9253f9cf87 not found: ID does not exist" containerID="50b42063ff1c4eba8aa71b08994c98d561b35c6779ac14d92a266f9253f9cf87"
Jul 02 20:19:43.794088 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.793992    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b42063ff1c4eba8aa71b08994c98d561b35c6779ac14d92a266f9253f9cf87"} err="failed to get container status \"50b42063ff1c4eba8aa71b08994c98d561b35c6779ac14d92a266f9253f9cf87\": rpc error: code = NotFound desc = could not find container \"50b42063ff1c4eba8aa71b08994c98d561b35c6779ac14d92a266f9253f9cf87\": container with ID starting with 50b42063ff1c4eba8aa71b08994c98d561b35c6779ac14d92a266f9253f9cf87 not found: ID does not exist"
Jul 02 20:19:43.806165 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.806139    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"]
Jul 02 20:19:43.808508 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:43.808478    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-29f89d80-dfcd49bc-qrlrc"]
Jul 02 20:19:44.204316 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:44.204201    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df30fd8f-5636-4986-b518-f7bd303cad0b" path="/var/lib/kubelet/pods/df30fd8f-5636-4986-b518-f7bd303cad0b/volumes"
Jul 02 20:19:49.177156 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:49.177123    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:49.279056 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:49.279018    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:49.425707 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:49.425677    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:49.645584 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:49.645550    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:49.768658 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:49.768630    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:49.867060 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:49.867031    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:49.981555 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:49.981524    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:56.065956 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:56.065915    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:56.130693 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:56.130661    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:56.213493 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:56.213429    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:56.317556 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:56.317481    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:19:56.412130 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:19:56.412097    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:02.461569 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:02.461532    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:02.518029 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:02.517984    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:08.682059 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:08.682021    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:08.990158 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:08.990129    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:09.163490 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:09.163457    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:12.336348 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.336307    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:12.395340 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.395303    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"]
Jul 02 20:20:12.395712 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.395695    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df30fd8f-5636-4986-b518-f7bd303cad0b" containerName="maas-api"
Jul 02 20:20:12.395712 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.395713    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="df30fd8f-5636-4986-b518-f7bd303cad0b" containerName="maas-api"
Jul 02 20:20:12.395862 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.395783    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="df30fd8f-5636-4986-b518-f7bd303cad0b" containerName="maas-api"
Jul 02 20:20:12.398957 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.398936    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:12.401492 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.401471    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-b80982bb-serving-cert\""
Jul 02 20:20:12.410209 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.410184    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"]
Jul 02 20:20:12.413677 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.413651    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:12.523985 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.523953    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:12.549072 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.549036    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9fe3782-c523-47c3-b5de-1477e214c60f-openshift-service-ca\") pod \"maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh\" (UID: \"a9fe3782-c523-47c3-b5de-1477e214c60f\") " pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:12.549229 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.549117    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h765h\" (UniqueName: \"kubernetes.io/projected/a9fe3782-c523-47c3-b5de-1477e214c60f-kube-api-access-h765h\") pod \"maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh\" (UID: \"a9fe3782-c523-47c3-b5de-1477e214c60f\") " pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:12.549229 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.549139    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9fe3782-c523-47c3-b5de-1477e214c60f-maas-api-tls\") pod \"maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh\" (UID: \"a9fe3782-c523-47c3-b5de-1477e214c60f\") " pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:12.650325 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.650172    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9fe3782-c523-47c3-b5de-1477e214c60f-openshift-service-ca\") pod \"maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh\" (UID: \"a9fe3782-c523-47c3-b5de-1477e214c60f\") " pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:12.650325 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.650268    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h765h\" (UniqueName: \"kubernetes.io/projected/a9fe3782-c523-47c3-b5de-1477e214c60f-kube-api-access-h765h\") pod \"maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh\" (UID: \"a9fe3782-c523-47c3-b5de-1477e214c60f\") " pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:12.650568 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.650331    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9fe3782-c523-47c3-b5de-1477e214c60f-maas-api-tls\") pod \"maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh\" (UID: \"a9fe3782-c523-47c3-b5de-1477e214c60f\") " pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:12.650568 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:20:12.650458    2556 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-b80982bb-serving-cert: secret "maas-api-e2e-mt-b80982bb-serving-cert" not found
Jul 02 20:20:12.650568 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:20:12.650557    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9fe3782-c523-47c3-b5de-1477e214c60f-maas-api-tls podName:a9fe3782-c523-47c3-b5de-1477e214c60f nodeName:}" failed. No retries permitted until 2026-07-02 20:20:13.150535568 +0000 UTC m=+1757.512682628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a9fe3782-c523-47c3-b5de-1477e214c60f-maas-api-tls") pod "maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh" (UID: "a9fe3782-c523-47c3-b5de-1477e214c60f") : secret "maas-api-e2e-mt-b80982bb-serving-cert" not found
Jul 02 20:20:12.650986 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.650963    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9fe3782-c523-47c3-b5de-1477e214c60f-openshift-service-ca\") pod \"maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh\" (UID: \"a9fe3782-c523-47c3-b5de-1477e214c60f\") " pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:12.660930 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.660901    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h765h\" (UniqueName: \"kubernetes.io/projected/a9fe3782-c523-47c3-b5de-1477e214c60f-kube-api-access-h765h\") pod \"maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh\" (UID: \"a9fe3782-c523-47c3-b5de-1477e214c60f\") " pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:12.888818 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:12.888785    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:13.005980 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:13.005947    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:13.107265 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:13.107221    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:13.155225 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:13.155187    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9fe3782-c523-47c3-b5de-1477e214c60f-maas-api-tls\") pod \"maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh\" (UID: \"a9fe3782-c523-47c3-b5de-1477e214c60f\") " pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:13.157798 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:13.157769    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9fe3782-c523-47c3-b5de-1477e214c60f-maas-api-tls\") pod \"maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh\" (UID: \"a9fe3782-c523-47c3-b5de-1477e214c60f\") " pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:13.310694 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:13.310603    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:13.452111 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:13.452074    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"]
Jul 02 20:20:13.455182 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:20:13.455146    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9fe3782_c523_47c3_b5de_1477e214c60f.slice/crio-3991c8a29579bf0a7f4b255f1c949996c4896b7a24f155b9c262f2cf24c70967 WatchSource:0}: Error finding container 3991c8a29579bf0a7f4b255f1c949996c4896b7a24f155b9c262f2cf24c70967: Status 404 returned error can't find the container with id 3991c8a29579bf0a7f4b255f1c949996c4896b7a24f155b9c262f2cf24c70967
Jul 02 20:20:13.925525 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:13.925496    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh" event={"ID":"a9fe3782-c523-47c3-b5de-1477e214c60f","Type":"ContainerStarted","Data":"3991c8a29579bf0a7f4b255f1c949996c4896b7a24f155b9c262f2cf24c70967"}
Jul 02 20:20:14.932186 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:14.932148    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh" event={"ID":"a9fe3782-c523-47c3-b5de-1477e214c60f","Type":"ContainerStarted","Data":"78113ebb8a98753db793cfaed05bafe3209646fc54e9fb389e6e7ecf16d32104"}
Jul 02 20:20:14.932621 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:14.932333    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:14.950640 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:14.950589    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh" podStartSLOduration=2.506007701 podStartE2EDuration="2.950569843s" totalImagesPullingTime="444.562142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:20:14.950023969 +0000 UTC m=+1759.312171031" watchObservedRunningTime="2026-07-02 20:20:14.950569843 +0000 UTC m=+1759.312716925"
Jul 02 20:20:16.844148 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:16.844112    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:20.943267 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:20.943238    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:27.941357 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:27.941325    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:34.868057 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:34.868005    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:34.972183 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:34.972147    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:35.608811 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:35.608780    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:35.710469 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:35.710424    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:54.644364 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:54.644254    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:54.979289 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:54.979239    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"]
Jul 02 20:20:54.979522 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:54.979476    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh" podUID="a9fe3782-c523-47c3-b5de-1477e214c60f" containerName="maas-api" containerID="cri-o://78113ebb8a98753db793cfaed05bafe3209646fc54e9fb389e6e7ecf16d32104" gracePeriod=30
Jul 02 20:20:55.113805 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:55.113765    2556 generic.go:356] "Generic (PLEG): container finished" podID="a9fe3782-c523-47c3-b5de-1477e214c60f" containerID="78113ebb8a98753db793cfaed05bafe3209646fc54e9fb389e6e7ecf16d32104" exitCode=0
Jul 02 20:20:55.113957 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:55.113823    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh" event={"ID":"a9fe3782-c523-47c3-b5de-1477e214c60f","Type":"ContainerDied","Data":"78113ebb8a98753db793cfaed05bafe3209646fc54e9fb389e6e7ecf16d32104"}
Jul 02 20:20:55.238385 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:55.238319    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:55.318630 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:55.318591    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9fe3782-c523-47c3-b5de-1477e214c60f-maas-api-tls\") pod \"a9fe3782-c523-47c3-b5de-1477e214c60f\" (UID: \"a9fe3782-c523-47c3-b5de-1477e214c60f\") "
Jul 02 20:20:55.318828 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:55.318701    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9fe3782-c523-47c3-b5de-1477e214c60f-openshift-service-ca\") pod \"a9fe3782-c523-47c3-b5de-1477e214c60f\" (UID: \"a9fe3782-c523-47c3-b5de-1477e214c60f\") "
Jul 02 20:20:55.318828 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:55.318728    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h765h\" (UniqueName: \"kubernetes.io/projected/a9fe3782-c523-47c3-b5de-1477e214c60f-kube-api-access-h765h\") pod \"a9fe3782-c523-47c3-b5de-1477e214c60f\" (UID: \"a9fe3782-c523-47c3-b5de-1477e214c60f\") "
Jul 02 20:20:55.319086 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:55.319050    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9fe3782-c523-47c3-b5de-1477e214c60f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a9fe3782-c523-47c3-b5de-1477e214c60f" (UID: "a9fe3782-c523-47c3-b5de-1477e214c60f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:20:55.320812 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:55.320784    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9fe3782-c523-47c3-b5de-1477e214c60f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a9fe3782-c523-47c3-b5de-1477e214c60f" (UID: "a9fe3782-c523-47c3-b5de-1477e214c60f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:20:55.320918 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:55.320816    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9fe3782-c523-47c3-b5de-1477e214c60f-kube-api-access-h765h" (OuterVolumeSpecName: "kube-api-access-h765h") pod "a9fe3782-c523-47c3-b5de-1477e214c60f" (UID: "a9fe3782-c523-47c3-b5de-1477e214c60f"). InnerVolumeSpecName "kube-api-access-h765h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:20:55.420156 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:55.420122    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9fe3782-c523-47c3-b5de-1477e214c60f-openshift-service-ca\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:20:55.420156 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:55.420151    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h765h\" (UniqueName: \"kubernetes.io/projected/a9fe3782-c523-47c3-b5de-1477e214c60f-kube-api-access-h765h\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:20:55.420156 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:55.420163    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9fe3782-c523-47c3-b5de-1477e214c60f-maas-api-tls\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:20:56.059227 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:56.059193    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:20:56.119400 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:56.119368    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"
Jul 02 20:20:56.119563 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:56.119401    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh" event={"ID":"a9fe3782-c523-47c3-b5de-1477e214c60f","Type":"ContainerDied","Data":"3991c8a29579bf0a7f4b255f1c949996c4896b7a24f155b9c262f2cf24c70967"}
Jul 02 20:20:56.119563 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:56.119463    2556 scope.go:117] "RemoveContainer" containerID="78113ebb8a98753db793cfaed05bafe3209646fc54e9fb389e6e7ecf16d32104"
Jul 02 20:20:56.143037 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:56.143002    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"]
Jul 02 20:20:56.147322 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:56.147298    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-b80982bb-7cd667d84-c2ssh"]
Jul 02 20:20:56.196255 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:20:56.196224    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9fe3782-c523-47c3-b5de-1477e214c60f" path="/var/lib/kubelet/pods/a9fe3782-c523-47c3-b5de-1477e214c60f/volumes"
Jul 02 20:21:00.719478 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:00.719440    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:05.792013 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:05.791976    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:42.053718 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:42.053673    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:42.688929 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:42.688894    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:48.291142 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:48.291084    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:48.433085 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:48.433053    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:48.572377 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:48.572288    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:48.861699 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:48.861620    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:49.891288 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:49.891235    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:50.000346 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:50.000309    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:50.100494 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:50.100465    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:50.819619 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:50.819584    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:50.920110 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:50.920076    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:51.020185 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:51.020149    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:52.455892 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:52.455860    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:58.256712 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:58.256678    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:58.357507 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:58.357471    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:21:58.928048 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:21:58.928015    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:04.902604 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:04.902566    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:04.966902 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:04.966867    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:05.051212 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:05.051179    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:05.151374 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:05.151340    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:15.583605 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:15.583567    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:15.925203 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:15.925110    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:36.887839 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:36.887799    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:42.704420 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:42.704383    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:42.804394 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:42.804357    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:43.042456 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:43.042419    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:43.349511 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:43.349426    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:43.679168 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:43.679066    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:46.288478 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.288443    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:46.436300 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.433398    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"]
Jul 02 20:22:46.436300 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.434264    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fe3782-c523-47c3-b5de-1477e214c60f" containerName="maas-api"
Jul 02 20:22:46.436300 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.434302    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fe3782-c523-47c3-b5de-1477e214c60f" containerName="maas-api"
Jul 02 20:22:46.436300 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.434513    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9fe3782-c523-47c3-b5de-1477e214c60f" containerName="maas-api"
Jul 02 20:22:46.438379 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.438351    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:22:46.442151 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.442116    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-ba0616-serving-cert\""
Jul 02 20:22:46.465141 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.465110    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"]
Jul 02 20:22:46.519185 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.519146    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:46.569531 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.569435    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw2hx\" (UniqueName: \"kubernetes.io/projected/befd07a2-9c17-4a16-aa9b-1f906bc020d3-kube-api-access-vw2hx\") pod \"maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps\" (UID: \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\") " pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:22:46.569531 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.569481    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/befd07a2-9c17-4a16-aa9b-1f906bc020d3-maas-api-tls\") pod \"maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps\" (UID: \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\") " pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:22:46.569738 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.569589    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/befd07a2-9c17-4a16-aa9b-1f906bc020d3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps\" (UID: \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\") " pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:22:46.670152 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.670115    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/befd07a2-9c17-4a16-aa9b-1f906bc020d3-maas-api-tls\") pod \"maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps\" (UID: \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\") " pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:22:46.670391 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.670186    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/befd07a2-9c17-4a16-aa9b-1f906bc020d3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps\" (UID: \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\") " pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:22:46.670391 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.670231    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw2hx\" (UniqueName: \"kubernetes.io/projected/befd07a2-9c17-4a16-aa9b-1f906bc020d3-kube-api-access-vw2hx\") pod \"maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps\" (UID: \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\") " pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:22:46.670969 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.670949    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/befd07a2-9c17-4a16-aa9b-1f906bc020d3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps\" (UID: \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\") " pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:22:46.672590 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.672567    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/befd07a2-9c17-4a16-aa9b-1f906bc020d3-maas-api-tls\") pod \"maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps\" (UID: \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\") " pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:22:46.684495 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.684469    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw2hx\" (UniqueName: \"kubernetes.io/projected/befd07a2-9c17-4a16-aa9b-1f906bc020d3-kube-api-access-vw2hx\") pod \"maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps\" (UID: \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\") " pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:22:46.687038 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.687016    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:46.749602 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.749564    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:22:46.786948 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.786918    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:46.892201 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.892119    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"]
Jul 02 20:22:46.895849 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:22:46.895806    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbefd07a2_9c17_4a16_aa9b_1f906bc020d3.slice/crio-b923a4ea254e8e9a237f9616741649eea3d1ec2194c741de88caf00ad85fe03c WatchSource:0}: Error finding container b923a4ea254e8e9a237f9616741649eea3d1ec2194c741de88caf00ad85fe03c: Status 404 returned error can't find the container with id b923a4ea254e8e9a237f9616741649eea3d1ec2194c741de88caf00ad85fe03c
Jul 02 20:22:46.897293 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.897257    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:22:46.976814 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:46.976786    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:47.089124 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:47.089035    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:47.624101 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:47.623997    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps" event={"ID":"befd07a2-9c17-4a16-aa9b-1f906bc020d3","Type":"ContainerStarted","Data":"8e2c669681c863a2ee8d99234a7428dcabd032005cf3204c09c9af32ccca81a5"}
Jul 02 20:22:47.624101 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:47.624054    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps" event={"ID":"befd07a2-9c17-4a16-aa9b-1f906bc020d3","Type":"ContainerStarted","Data":"b923a4ea254e8e9a237f9616741649eea3d1ec2194c741de88caf00ad85fe03c"}
Jul 02 20:22:47.624101 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:47.624091    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:22:47.647770 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:47.647709    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps" podStartSLOduration=1.201386495 podStartE2EDuration="1.647689538s" totalImagesPullingTime="446.303043ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:22:47.645253587 +0000 UTC m=+1912.007400653" watchObservedRunningTime="2026-07-02 20:22:47.647689538 +0000 UTC m=+1912.009836600"
Jul 02 20:22:50.740614 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:50.740580    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:51.070917 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:51.070830    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:51.384645 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:51.384559    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:51.633930 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:51.633896    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:53.635758 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:53.635723    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:22:54.294064 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.294029    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:54.353293 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.353244    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"]
Jul 02 20:22:54.357490 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.357462    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:22:54.360001 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.359969    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-a3a257-serving-cert\""
Jul 02 20:22:54.367342 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.367316    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"]
Jul 02 20:22:54.382691 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.382662    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:54.439541 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.439498    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjckj\" (UniqueName: \"kubernetes.io/projected/5625fbf2-2f93-47f3-af78-7c1acaac6701-kube-api-access-sjckj\") pod \"maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7\" (UID: \"5625fbf2-2f93-47f3-af78-7c1acaac6701\") " pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:22:54.439541 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.439543    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5625fbf2-2f93-47f3-af78-7c1acaac6701-maas-api-tls\") pod \"maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7\" (UID: \"5625fbf2-2f93-47f3-af78-7c1acaac6701\") " pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:22:54.439768 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.439619    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5625fbf2-2f93-47f3-af78-7c1acaac6701-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7\" (UID: \"5625fbf2-2f93-47f3-af78-7c1acaac6701\") " pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:22:54.447646 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.447620    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:54.541228 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.541190    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5625fbf2-2f93-47f3-af78-7c1acaac6701-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7\" (UID: \"5625fbf2-2f93-47f3-af78-7c1acaac6701\") " pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:22:54.541454 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.541312    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjckj\" (UniqueName: \"kubernetes.io/projected/5625fbf2-2f93-47f3-af78-7c1acaac6701-kube-api-access-sjckj\") pod \"maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7\" (UID: \"5625fbf2-2f93-47f3-af78-7c1acaac6701\") " pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:22:54.541454 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.541336    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5625fbf2-2f93-47f3-af78-7c1acaac6701-maas-api-tls\") pod \"maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7\" (UID: \"5625fbf2-2f93-47f3-af78-7c1acaac6701\") " pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:22:54.541454 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:22:54.541440    2556 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-a3a257-serving-cert: secret "maas-api-e2e-inf-b-a3a257-serving-cert" not found
Jul 02 20:22:54.541875 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:22:54.541499    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5625fbf2-2f93-47f3-af78-7c1acaac6701-maas-api-tls podName:5625fbf2-2f93-47f3-af78-7c1acaac6701 nodeName:}" failed. No retries permitted until 2026-07-02 20:22:55.041480277 +0000 UTC m=+1919.403627322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5625fbf2-2f93-47f3-af78-7c1acaac6701-maas-api-tls") pod "maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7" (UID: "5625fbf2-2f93-47f3-af78-7c1acaac6701") : secret "maas-api-e2e-inf-b-a3a257-serving-cert" not found
Jul 02 20:22:54.541940 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.541878    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5625fbf2-2f93-47f3-af78-7c1acaac6701-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7\" (UID: \"5625fbf2-2f93-47f3-af78-7c1acaac6701\") " pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:22:54.549936 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.549867    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjckj\" (UniqueName: \"kubernetes.io/projected/5625fbf2-2f93-47f3-af78-7c1acaac6701-kube-api-access-sjckj\") pod \"maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7\" (UID: \"5625fbf2-2f93-47f3-af78-7c1acaac6701\") " pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:22:54.736495 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.736461    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:54.879511 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.879429    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:54.982219 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:54.982189    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:22:55.045946 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:55.045903    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5625fbf2-2f93-47f3-af78-7c1acaac6701-maas-api-tls\") pod \"maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7\" (UID: \"5625fbf2-2f93-47f3-af78-7c1acaac6701\") " pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:22:55.048363 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:55.048340    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5625fbf2-2f93-47f3-af78-7c1acaac6701-maas-api-tls\") pod \"maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7\" (UID: \"5625fbf2-2f93-47f3-af78-7c1acaac6701\") " pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:22:55.270002 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:55.269958    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:22:55.411926 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:55.411897    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"]
Jul 02 20:22:55.415322 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:22:55.415292    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5625fbf2_2f93_47f3_af78_7c1acaac6701.slice/crio-a962f3eb5dd953279e89615efe93702c1eb74b7d0250ce4f0ed88a682a801458 WatchSource:0}: Error finding container a962f3eb5dd953279e89615efe93702c1eb74b7d0250ce4f0ed88a682a801458: Status 404 returned error can't find the container with id a962f3eb5dd953279e89615efe93702c1eb74b7d0250ce4f0ed88a682a801458
Jul 02 20:22:55.663191 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:55.663102    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7" event={"ID":"5625fbf2-2f93-47f3-af78-7c1acaac6701","Type":"ContainerStarted","Data":"a962f3eb5dd953279e89615efe93702c1eb74b7d0250ce4f0ed88a682a801458"}
Jul 02 20:22:56.668914 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:56.668875    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7" event={"ID":"5625fbf2-2f93-47f3-af78-7c1acaac6701","Type":"ContainerStarted","Data":"2412ef765db74e6cf6e58b2af2760f0af5f54ff0ae8d7eef2de2c41d1a5e3356"}
Jul 02 20:22:56.669360 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:56.669023    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:22:56.686577 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:56.686527    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7" podStartSLOduration=2.373722039 podStartE2EDuration="2.686508501s" totalImagesPullingTime="312.786462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:22:56.684709489 +0000 UTC m=+1921.046856553" watchObservedRunningTime="2026-07-02 20:22:56.686508501 +0000 UTC m=+1921.048655562"
Jul 02 20:22:58.821678 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:22:58.821639    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:23:02.679147 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:23:02.679121    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:23:07.790691 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:23:07.790660    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:23:07.887644 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:23:07.887607    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:23:15.582567 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:23:15.582529    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:23:15.683354 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:23:15.683297    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:23:19.542552 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:23:19.542513    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:23:41.923317 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:23:41.923258    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:12.634865 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:12.634746    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:13.583515 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:13.583481    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:13.746219 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:13.746179    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:14.155485 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.155447    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:14.256618 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.256582    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:14.384685 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.384654    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"]
Jul 02 20:24:14.384886 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.384862    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps" podUID="befd07a2-9c17-4a16-aa9b-1f906bc020d3" containerName="maas-api" containerID="cri-o://8e2c669681c863a2ee8d99234a7428dcabd032005cf3204c09c9af32ccca81a5" gracePeriod=30
Jul 02 20:24:14.414224 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.414113    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:14.831598 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.831561    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:24:14.838330 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.838301    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/befd07a2-9c17-4a16-aa9b-1f906bc020d3-openshift-service-ca\") pod \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\" (UID: \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\") "
Jul 02 20:24:14.838451 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.838372    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw2hx\" (UniqueName: \"kubernetes.io/projected/befd07a2-9c17-4a16-aa9b-1f906bc020d3-kube-api-access-vw2hx\") pod \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\" (UID: \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\") "
Jul 02 20:24:14.838451 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.838404    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/befd07a2-9c17-4a16-aa9b-1f906bc020d3-maas-api-tls\") pod \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\" (UID: \"befd07a2-9c17-4a16-aa9b-1f906bc020d3\") "
Jul 02 20:24:14.838550 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.838529    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/befd07a2-9c17-4a16-aa9b-1f906bc020d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "befd07a2-9c17-4a16-aa9b-1f906bc020d3" (UID: "befd07a2-9c17-4a16-aa9b-1f906bc020d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:24:14.838670 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.838658    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/befd07a2-9c17-4a16-aa9b-1f906bc020d3-openshift-service-ca\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:24:14.840419 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.840392    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/befd07a2-9c17-4a16-aa9b-1f906bc020d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "befd07a2-9c17-4a16-aa9b-1f906bc020d3" (UID: "befd07a2-9c17-4a16-aa9b-1f906bc020d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:24:14.840691 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.840673    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/befd07a2-9c17-4a16-aa9b-1f906bc020d3-kube-api-access-vw2hx" (OuterVolumeSpecName: "kube-api-access-vw2hx") pod "befd07a2-9c17-4a16-aa9b-1f906bc020d3" (UID: "befd07a2-9c17-4a16-aa9b-1f906bc020d3"). InnerVolumeSpecName "kube-api-access-vw2hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:24:14.939986 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.939897    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw2hx\" (UniqueName: \"kubernetes.io/projected/befd07a2-9c17-4a16-aa9b-1f906bc020d3-kube-api-access-vw2hx\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:24:14.939986 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:14.939932    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/befd07a2-9c17-4a16-aa9b-1f906bc020d3-maas-api-tls\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:24:15.042090 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:15.042055    2556 generic.go:356] "Generic (PLEG): container finished" podID="befd07a2-9c17-4a16-aa9b-1f906bc020d3" containerID="8e2c669681c863a2ee8d99234a7428dcabd032005cf3204c09c9af32ccca81a5" exitCode=0
Jul 02 20:24:15.042090 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:15.042093    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"
Jul 02 20:24:15.042332 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:15.042133    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps" event={"ID":"befd07a2-9c17-4a16-aa9b-1f906bc020d3","Type":"ContainerDied","Data":"8e2c669681c863a2ee8d99234a7428dcabd032005cf3204c09c9af32ccca81a5"}
Jul 02 20:24:15.042332 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:15.042186    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps" event={"ID":"befd07a2-9c17-4a16-aa9b-1f906bc020d3","Type":"ContainerDied","Data":"b923a4ea254e8e9a237f9616741649eea3d1ec2194c741de88caf00ad85fe03c"}
Jul 02 20:24:15.042332 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:15.042208    2556 scope.go:117] "RemoveContainer" containerID="8e2c669681c863a2ee8d99234a7428dcabd032005cf3204c09c9af32ccca81a5"
Jul 02 20:24:15.051889 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:15.051864    2556 scope.go:117] "RemoveContainer" containerID="8e2c669681c863a2ee8d99234a7428dcabd032005cf3204c09c9af32ccca81a5"
Jul 02 20:24:15.052176 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:24:15.052158    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e2c669681c863a2ee8d99234a7428dcabd032005cf3204c09c9af32ccca81a5\": container with ID starting with 8e2c669681c863a2ee8d99234a7428dcabd032005cf3204c09c9af32ccca81a5 not found: ID does not exist" containerID="8e2c669681c863a2ee8d99234a7428dcabd032005cf3204c09c9af32ccca81a5"
Jul 02 20:24:15.052235 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:15.052185    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e2c669681c863a2ee8d99234a7428dcabd032005cf3204c09c9af32ccca81a5"} err="failed to get container status \"8e2c669681c863a2ee8d99234a7428dcabd032005cf3204c09c9af32ccca81a5\": rpc error: code = NotFound desc = could not find container \"8e2c669681c863a2ee8d99234a7428dcabd032005cf3204c09c9af32ccca81a5\": container with ID starting with 8e2c669681c863a2ee8d99234a7428dcabd032005cf3204c09c9af32ccca81a5 not found: ID does not exist"
Jul 02 20:24:15.063517 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:15.063488    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"]
Jul 02 20:24:15.067939 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:15.067903    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-ba0616-656898ccd7-pbpps"]
Jul 02 20:24:16.196521 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:16.196486    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="befd07a2-9c17-4a16-aa9b-1f906bc020d3" path="/var/lib/kubelet/pods/befd07a2-9c17-4a16-aa9b-1f906bc020d3/volumes"
Jul 02 20:24:19.334400 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:19.334318    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:40.229391 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:40.229352    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:56.133940 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:56.133905    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:56.413954 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:56.413876    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:56.654396 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:56.654364    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:56.835185 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:56.835143    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:57.252847 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.252819    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:57.353140 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.353105    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:57.454288 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.454252    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:57.573929 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.573834    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"]
Jul 02 20:24:57.574154 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.574125    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7" podUID="5625fbf2-2f93-47f3-af78-7c1acaac6701" containerName="maas-api" containerID="cri-o://2412ef765db74e6cf6e58b2af2760f0af5f54ff0ae8d7eef2de2c41d1a5e3356" gracePeriod=30
Jul 02 20:24:57.602738 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.602708    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:24:57.674062 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.673994    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7" podUID="5625fbf2-2f93-47f3-af78-7c1acaac6701" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.43:8443/health\": dial tcp 10.134.0.43:8443: connect: connection refused"
Jul 02 20:24:57.824258 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.824193    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:24:57.920780 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.920739    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5625fbf2-2f93-47f3-af78-7c1acaac6701-openshift-service-ca\") pod \"5625fbf2-2f93-47f3-af78-7c1acaac6701\" (UID: \"5625fbf2-2f93-47f3-af78-7c1acaac6701\") "
Jul 02 20:24:57.920963 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.920799    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjckj\" (UniqueName: \"kubernetes.io/projected/5625fbf2-2f93-47f3-af78-7c1acaac6701-kube-api-access-sjckj\") pod \"5625fbf2-2f93-47f3-af78-7c1acaac6701\" (UID: \"5625fbf2-2f93-47f3-af78-7c1acaac6701\") "
Jul 02 20:24:57.920963 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.920833    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5625fbf2-2f93-47f3-af78-7c1acaac6701-maas-api-tls\") pod \"5625fbf2-2f93-47f3-af78-7c1acaac6701\" (UID: \"5625fbf2-2f93-47f3-af78-7c1acaac6701\") "
Jul 02 20:24:57.921204 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.921175    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5625fbf2-2f93-47f3-af78-7c1acaac6701-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5625fbf2-2f93-47f3-af78-7c1acaac6701" (UID: "5625fbf2-2f93-47f3-af78-7c1acaac6701"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:24:57.923054 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.923026    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5625fbf2-2f93-47f3-af78-7c1acaac6701-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5625fbf2-2f93-47f3-af78-7c1acaac6701" (UID: "5625fbf2-2f93-47f3-af78-7c1acaac6701"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:24:57.923163 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:57.923062    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5625fbf2-2f93-47f3-af78-7c1acaac6701-kube-api-access-sjckj" (OuterVolumeSpecName: "kube-api-access-sjckj") pod "5625fbf2-2f93-47f3-af78-7c1acaac6701" (UID: "5625fbf2-2f93-47f3-af78-7c1acaac6701"). InnerVolumeSpecName "kube-api-access-sjckj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:24:58.021520 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:58.021469    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjckj\" (UniqueName: \"kubernetes.io/projected/5625fbf2-2f93-47f3-af78-7c1acaac6701-kube-api-access-sjckj\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:24:58.021520 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:58.021516    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5625fbf2-2f93-47f3-af78-7c1acaac6701-maas-api-tls\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:24:58.021520 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:58.021525    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5625fbf2-2f93-47f3-af78-7c1acaac6701-openshift-service-ca\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:24:58.240228 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:58.240196    2556 generic.go:356] "Generic (PLEG): container finished" podID="5625fbf2-2f93-47f3-af78-7c1acaac6701" containerID="2412ef765db74e6cf6e58b2af2760f0af5f54ff0ae8d7eef2de2c41d1a5e3356" exitCode=0
Jul 02 20:24:58.240434 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:58.240240    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"
Jul 02 20:24:58.240434 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:58.240305    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7" event={"ID":"5625fbf2-2f93-47f3-af78-7c1acaac6701","Type":"ContainerDied","Data":"2412ef765db74e6cf6e58b2af2760f0af5f54ff0ae8d7eef2de2c41d1a5e3356"}
Jul 02 20:24:58.240434 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:58.240362    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7" event={"ID":"5625fbf2-2f93-47f3-af78-7c1acaac6701","Type":"ContainerDied","Data":"a962f3eb5dd953279e89615efe93702c1eb74b7d0250ce4f0ed88a682a801458"}
Jul 02 20:24:58.240434 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:58.240389    2556 scope.go:117] "RemoveContainer" containerID="2412ef765db74e6cf6e58b2af2760f0af5f54ff0ae8d7eef2de2c41d1a5e3356"
Jul 02 20:24:58.250382 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:58.250360    2556 scope.go:117] "RemoveContainer" containerID="2412ef765db74e6cf6e58b2af2760f0af5f54ff0ae8d7eef2de2c41d1a5e3356"
Jul 02 20:24:58.250666 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:24:58.250638    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2412ef765db74e6cf6e58b2af2760f0af5f54ff0ae8d7eef2de2c41d1a5e3356\": container with ID starting with 2412ef765db74e6cf6e58b2af2760f0af5f54ff0ae8d7eef2de2c41d1a5e3356 not found: ID does not exist" containerID="2412ef765db74e6cf6e58b2af2760f0af5f54ff0ae8d7eef2de2c41d1a5e3356"
Jul 02 20:24:58.250714 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:58.250667    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2412ef765db74e6cf6e58b2af2760f0af5f54ff0ae8d7eef2de2c41d1a5e3356"} err="failed to get container status \"2412ef765db74e6cf6e58b2af2760f0af5f54ff0ae8d7eef2de2c41d1a5e3356\": rpc error: code = NotFound desc = could not find container \"2412ef765db74e6cf6e58b2af2760f0af5f54ff0ae8d7eef2de2c41d1a5e3356\": container with ID starting with 2412ef765db74e6cf6e58b2af2760f0af5f54ff0ae8d7eef2de2c41d1a5e3356 not found: ID does not exist"
Jul 02 20:24:58.255957 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:58.255931    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"]
Jul 02 20:24:58.260045 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:58.260023    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-a3a257-7b5c6d4459-xzbg7"]
Jul 02 20:24:59.155239 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:24:59.155209    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:00.195929 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:00.195895    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5625fbf2-2f93-47f3-af78-7c1acaac6701" path="/var/lib/kubelet/pods/5625fbf2-2f93-47f3-af78-7c1acaac6701/volumes"
Jul 02 20:25:02.999793 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:02.999755    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:03.102492 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:03.102458    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:03.287950 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:03.287866    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:03.596463 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:03.596373    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:03.946112 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:03.946015    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:04.280420 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:04.280385    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:04.761514 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:04.761476    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:07.196483 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.196442    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:07.257380 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.257350    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"]
Jul 02 20:25:07.257748 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.257736    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="befd07a2-9c17-4a16-aa9b-1f906bc020d3" containerName="maas-api"
Jul 02 20:25:07.257748 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.257750    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="befd07a2-9c17-4a16-aa9b-1f906bc020d3" containerName="maas-api"
Jul 02 20:25:07.257849 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.257765    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5625fbf2-2f93-47f3-af78-7c1acaac6701" containerName="maas-api"
Jul 02 20:25:07.257849 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.257770    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5625fbf2-2f93-47f3-af78-7c1acaac6701" containerName="maas-api"
Jul 02 20:25:07.257849 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.257821    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5625fbf2-2f93-47f3-af78-7c1acaac6701" containerName="maas-api"
Jul 02 20:25:07.257849 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.257832    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="befd07a2-9c17-4a16-aa9b-1f906bc020d3" containerName="maas-api"
Jul 02 20:25:07.261245 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.261218    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:07.263636 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.263616    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-91e0dd-serving-cert\""
Jul 02 20:25:07.272723 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.272693    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"]
Jul 02 20:25:07.274846 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.274812    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:07.295339 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.295306    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb49c310-2b71-477b-a122-7c6ea23f30e1-openshift-service-ca\") pod \"maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr\" (UID: \"cb49c310-2b71-477b-a122-7c6ea23f30e1\") " pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:07.295502 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.295384    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb49c310-2b71-477b-a122-7c6ea23f30e1-maas-api-tls\") pod \"maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr\" (UID: \"cb49c310-2b71-477b-a122-7c6ea23f30e1\") " pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:07.295502 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.295421    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqd82\" (UniqueName: \"kubernetes.io/projected/cb49c310-2b71-477b-a122-7c6ea23f30e1-kube-api-access-kqd82\") pod \"maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr\" (UID: \"cb49c310-2b71-477b-a122-7c6ea23f30e1\") " pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:07.347468 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.347428    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:07.396246 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.396205    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb49c310-2b71-477b-a122-7c6ea23f30e1-maas-api-tls\") pod \"maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr\" (UID: \"cb49c310-2b71-477b-a122-7c6ea23f30e1\") " pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:07.396246 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.396251    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqd82\" (UniqueName: \"kubernetes.io/projected/cb49c310-2b71-477b-a122-7c6ea23f30e1-kube-api-access-kqd82\") pod \"maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr\" (UID: \"cb49c310-2b71-477b-a122-7c6ea23f30e1\") " pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:07.396541 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:25:07.396384    2556 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-91e0dd-serving-cert: secret "maas-api-e2e-api-a-91e0dd-serving-cert" not found
Jul 02 20:25:07.396541 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.396450    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb49c310-2b71-477b-a122-7c6ea23f30e1-openshift-service-ca\") pod \"maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr\" (UID: \"cb49c310-2b71-477b-a122-7c6ea23f30e1\") " pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:07.396541 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:25:07.396472    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb49c310-2b71-477b-a122-7c6ea23f30e1-maas-api-tls podName:cb49c310-2b71-477b-a122-7c6ea23f30e1 nodeName:}" failed. No retries permitted until 2026-07-02 20:25:07.896448705 +0000 UTC m=+2052.258595768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cb49c310-2b71-477b-a122-7c6ea23f30e1-maas-api-tls") pod "maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr" (UID: "cb49c310-2b71-477b-a122-7c6ea23f30e1") : secret "maas-api-e2e-api-a-91e0dd-serving-cert" not found
Jul 02 20:25:07.397063 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.397042    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb49c310-2b71-477b-a122-7c6ea23f30e1-openshift-service-ca\") pod \"maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr\" (UID: \"cb49c310-2b71-477b-a122-7c6ea23f30e1\") " pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:07.407748 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.407723    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqd82\" (UniqueName: \"kubernetes.io/projected/cb49c310-2b71-477b-a122-7c6ea23f30e1-kube-api-access-kqd82\") pod \"maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr\" (UID: \"cb49c310-2b71-477b-a122-7c6ea23f30e1\") " pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:07.544765 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.544730    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:07.861806 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.861726    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:07.902210 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.902180    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb49c310-2b71-477b-a122-7c6ea23f30e1-maas-api-tls\") pod \"maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr\" (UID: \"cb49c310-2b71-477b-a122-7c6ea23f30e1\") " pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:07.904754 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.904728    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb49c310-2b71-477b-a122-7c6ea23f30e1-maas-api-tls\") pod \"maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr\" (UID: \"cb49c310-2b71-477b-a122-7c6ea23f30e1\") " pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:07.962098 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:07.962057    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:08.172466 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:08.172377    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:08.314519 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:08.314450    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"]
Jul 02 20:25:08.317333 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:25:08.317298    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb49c310_2b71_477b_a122_7c6ea23f30e1.slice/crio-3550ee6bf1f930ba9ee68f111208889a91d35609d1625aaa5e9f29ef127612a4 WatchSource:0}: Error finding container 3550ee6bf1f930ba9ee68f111208889a91d35609d1625aaa5e9f29ef127612a4: Status 404 returned error can't find the container with id 3550ee6bf1f930ba9ee68f111208889a91d35609d1625aaa5e9f29ef127612a4
Jul 02 20:25:09.297839 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:09.297732    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr" event={"ID":"cb49c310-2b71-477b-a122-7c6ea23f30e1","Type":"ContainerStarted","Data":"ed8ff4036ce16a1d30911c8f9f2b1103a5e4892255cf981e28b8a9cdd0fd5d1f"}
Jul 02 20:25:09.297839 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:09.297795    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr" event={"ID":"cb49c310-2b71-477b-a122-7c6ea23f30e1","Type":"ContainerStarted","Data":"3550ee6bf1f930ba9ee68f111208889a91d35609d1625aaa5e9f29ef127612a4"}
Jul 02 20:25:09.297839 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:09.297836    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:09.318722 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:09.318670    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr" podStartSLOduration=1.664638471 podStartE2EDuration="2.31865279s" totalImagesPullingTime="654.014319ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:25:09.31752826 +0000 UTC m=+2053.679675322" watchObservedRunningTime="2026-07-02 20:25:09.31865279 +0000 UTC m=+2053.680799851"
Jul 02 20:25:11.729883 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:11.729850    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:12.219795 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:12.219716    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:12.549848 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:12.549814    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:12.676517 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:12.676488    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:15.307222 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:15.307195    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:16.164554 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.164514    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:16.270394 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.270353    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:16.328152 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.328122    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"]
Jul 02 20:25:16.331814 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.331786    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:16.337198 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.337174    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-58953a-serving-cert\""
Jul 02 20:25:16.348879 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.348848    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"]
Jul 02 20:25:16.375726 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.375696    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:16.378854 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.378833    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-maas-api-tls\") pod \"maas-api-e2e-api-b-58953a-7f8fb464f6-q7542\" (UID: \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\") " pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:16.378932 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.378893    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-openshift-service-ca\") pod \"maas-api-e2e-api-b-58953a-7f8fb464f6-q7542\" (UID: \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\") " pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:16.378932 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.378928    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-575rr\" (UniqueName: \"kubernetes.io/projected/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-kube-api-access-575rr\") pod \"maas-api-e2e-api-b-58953a-7f8fb464f6-q7542\" (UID: \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\") " pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:16.479447 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.479409    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-maas-api-tls\") pod \"maas-api-e2e-api-b-58953a-7f8fb464f6-q7542\" (UID: \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\") " pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:16.479632 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.479470    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-openshift-service-ca\") pod \"maas-api-e2e-api-b-58953a-7f8fb464f6-q7542\" (UID: \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\") " pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:16.479632 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.479500    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-575rr\" (UniqueName: \"kubernetes.io/projected/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-kube-api-access-575rr\") pod \"maas-api-e2e-api-b-58953a-7f8fb464f6-q7542\" (UID: \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\") " pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:16.480194 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.480171    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-openshift-service-ca\") pod \"maas-api-e2e-api-b-58953a-7f8fb464f6-q7542\" (UID: \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\") " pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:16.481953 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.481921    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-maas-api-tls\") pod \"maas-api-e2e-api-b-58953a-7f8fb464f6-q7542\" (UID: \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\") " pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:16.488726 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.488699    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-575rr\" (UniqueName: \"kubernetes.io/projected/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-kube-api-access-575rr\") pod \"maas-api-e2e-api-b-58953a-7f8fb464f6-q7542\" (UID: \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\") " pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:16.572126 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.572097    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:16.642695 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.642660    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:16.805381 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:16.805148    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"]
Jul 02 20:25:16.808112 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:25:16.808080    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2795aeeb_4e53_4ed8_9ef1_fad3cdc59145.slice/crio-9d497159ea812747c50866541e7dc15ffe57613165c48d7be187f5b5c4428c8c WatchSource:0}: Error finding container 9d497159ea812747c50866541e7dc15ffe57613165c48d7be187f5b5c4428c8c: Status 404 returned error can't find the container with id 9d497159ea812747c50866541e7dc15ffe57613165c48d7be187f5b5c4428c8c
Jul 02 20:25:17.049405 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:17.049318    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:17.151398 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:17.151316    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:17.254778 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:17.254751    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:17.337422 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:17.337385    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542" event={"ID":"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145","Type":"ContainerStarted","Data":"11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71"}
Jul 02 20:25:17.337916 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:17.337446    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542" event={"ID":"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145","Type":"ContainerStarted","Data":"9d497159ea812747c50866541e7dc15ffe57613165c48d7be187f5b5c4428c8c"}
Jul 02 20:25:17.337916 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:17.337512    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:17.374888 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:17.374839    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542" podStartSLOduration=0.936739255 podStartE2EDuration="1.374819952s" totalImagesPullingTime="438.080697ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:25:17.37319363 +0000 UTC m=+2061.735340692" watchObservedRunningTime="2026-07-02 20:25:17.374819952 +0000 UTC m=+2061.736967013"
Jul 02 20:25:17.377610 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:17.377579    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:20.704535 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:20.704501    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:23.347986 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:23.347957    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:28.575137 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:28.575101    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:28.678410 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:28.678377    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:29.136745 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.136713    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:29.299450 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.299379    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"]
Jul 02 20:25:29.299633 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.299606    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr" podUID="cb49c310-2b71-477b-a122-7c6ea23f30e1" containerName="maas-api" containerID="cri-o://ed8ff4036ce16a1d30911c8f9f2b1103a5e4892255cf981e28b8a9cdd0fd5d1f" gracePeriod=30
Jul 02 20:25:29.326945 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.326917    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:29.552966 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.552942    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:29.585440 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.585409    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:29.701055 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.700913    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb49c310-2b71-477b-a122-7c6ea23f30e1-maas-api-tls\") pod \"cb49c310-2b71-477b-a122-7c6ea23f30e1\" (UID: \"cb49c310-2b71-477b-a122-7c6ea23f30e1\") "
Jul 02 20:25:29.701217 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.701062    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb49c310-2b71-477b-a122-7c6ea23f30e1-openshift-service-ca\") pod \"cb49c310-2b71-477b-a122-7c6ea23f30e1\" (UID: \"cb49c310-2b71-477b-a122-7c6ea23f30e1\") "
Jul 02 20:25:29.701217 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.701130    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqd82\" (UniqueName: \"kubernetes.io/projected/cb49c310-2b71-477b-a122-7c6ea23f30e1-kube-api-access-kqd82\") pod \"cb49c310-2b71-477b-a122-7c6ea23f30e1\" (UID: \"cb49c310-2b71-477b-a122-7c6ea23f30e1\") "
Jul 02 20:25:29.701605 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.701576    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb49c310-2b71-477b-a122-7c6ea23f30e1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cb49c310-2b71-477b-a122-7c6ea23f30e1" (UID: "cb49c310-2b71-477b-a122-7c6ea23f30e1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:25:29.703061 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.703039    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb49c310-2b71-477b-a122-7c6ea23f30e1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cb49c310-2b71-477b-a122-7c6ea23f30e1" (UID: "cb49c310-2b71-477b-a122-7c6ea23f30e1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:25:29.703146 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.703100    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb49c310-2b71-477b-a122-7c6ea23f30e1-kube-api-access-kqd82" (OuterVolumeSpecName: "kube-api-access-kqd82") pod "cb49c310-2b71-477b-a122-7c6ea23f30e1" (UID: "cb49c310-2b71-477b-a122-7c6ea23f30e1"). InnerVolumeSpecName "kube-api-access-kqd82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:25:29.802691 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.802647    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb49c310-2b71-477b-a122-7c6ea23f30e1-maas-api-tls\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:25:29.802691 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.802682    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb49c310-2b71-477b-a122-7c6ea23f30e1-openshift-service-ca\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:25:29.802691 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:29.802695    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqd82\" (UniqueName: \"kubernetes.io/projected/cb49c310-2b71-477b-a122-7c6ea23f30e1-kube-api-access-kqd82\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:25:30.399518 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:30.399483    2556 generic.go:356] "Generic (PLEG): container finished" podID="cb49c310-2b71-477b-a122-7c6ea23f30e1" containerID="ed8ff4036ce16a1d30911c8f9f2b1103a5e4892255cf981e28b8a9cdd0fd5d1f" exitCode=0
Jul 02 20:25:30.399699 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:30.399543    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"
Jul 02 20:25:30.399699 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:30.399567    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr" event={"ID":"cb49c310-2b71-477b-a122-7c6ea23f30e1","Type":"ContainerDied","Data":"ed8ff4036ce16a1d30911c8f9f2b1103a5e4892255cf981e28b8a9cdd0fd5d1f"}
Jul 02 20:25:30.399699 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:30.399637    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr" event={"ID":"cb49c310-2b71-477b-a122-7c6ea23f30e1","Type":"ContainerDied","Data":"3550ee6bf1f930ba9ee68f111208889a91d35609d1625aaa5e9f29ef127612a4"}
Jul 02 20:25:30.399699 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:30.399660    2556 scope.go:117] "RemoveContainer" containerID="ed8ff4036ce16a1d30911c8f9f2b1103a5e4892255cf981e28b8a9cdd0fd5d1f"
Jul 02 20:25:30.408506 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:30.408487    2556 scope.go:117] "RemoveContainer" containerID="ed8ff4036ce16a1d30911c8f9f2b1103a5e4892255cf981e28b8a9cdd0fd5d1f"
Jul 02 20:25:30.408794 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:25:30.408777    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed8ff4036ce16a1d30911c8f9f2b1103a5e4892255cf981e28b8a9cdd0fd5d1f\": container with ID starting with ed8ff4036ce16a1d30911c8f9f2b1103a5e4892255cf981e28b8a9cdd0fd5d1f not found: ID does not exist" containerID="ed8ff4036ce16a1d30911c8f9f2b1103a5e4892255cf981e28b8a9cdd0fd5d1f"
Jul 02 20:25:30.408845 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:30.408804    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed8ff4036ce16a1d30911c8f9f2b1103a5e4892255cf981e28b8a9cdd0fd5d1f"} err="failed to get container status \"ed8ff4036ce16a1d30911c8f9f2b1103a5e4892255cf981e28b8a9cdd0fd5d1f\": rpc error: code = NotFound desc = could not find container \"ed8ff4036ce16a1d30911c8f9f2b1103a5e4892255cf981e28b8a9cdd0fd5d1f\": container with ID starting with ed8ff4036ce16a1d30911c8f9f2b1103a5e4892255cf981e28b8a9cdd0fd5d1f not found: ID does not exist"
Jul 02 20:25:30.417211 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:30.417181    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"]
Jul 02 20:25:30.423702 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:30.423678    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-91e0dd-8474f95869-vr2hr"]
Jul 02 20:25:32.197144 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:32.197110    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb49c310-2b71-477b-a122-7c6ea23f30e1" path="/var/lib/kubelet/pods/cb49c310-2b71-477b-a122-7c6ea23f30e1/volumes"
Jul 02 20:25:35.240956 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:35.240921    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:35.340724 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:35.340692    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:35.523474 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:35.523387    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:35.755756 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:35.755720    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:35.856902 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:35.856822    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:35.954521 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:35.954488    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"]
Jul 02 20:25:35.954985 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:35.954937    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542" podUID="2795aeeb-4e53-4ed8-9ef1-fad3cdc59145" containerName="maas-api" containerID="cri-o://11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71" gracePeriod=30
Jul 02 20:25:35.960970 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:35.960855    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:35.983731 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:25:35.983686    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2795aeeb_4e53_4ed8_9ef1_fad3cdc59145.slice/crio-11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71.scope\": RecentStats: unable to find data in memory cache]"
Jul 02 20:25:36.016828 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.016797    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:36.226446 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.226421    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:36.354779 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.354745    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:36.362901 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.362874    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-maas-api-tls\") pod \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\" (UID: \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\") "
Jul 02 20:25:36.363028 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.362908    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-575rr\" (UniqueName: \"kubernetes.io/projected/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-kube-api-access-575rr\") pod \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\" (UID: \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\") "
Jul 02 20:25:36.363028 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.362939    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-openshift-service-ca\") pod \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\" (UID: \"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145\") "
Jul 02 20:25:36.363375 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.363350    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2795aeeb-4e53-4ed8-9ef1-fad3cdc59145" (UID: "2795aeeb-4e53-4ed8-9ef1-fad3cdc59145"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:25:36.364984 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.364963    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2795aeeb-4e53-4ed8-9ef1-fad3cdc59145" (UID: "2795aeeb-4e53-4ed8-9ef1-fad3cdc59145"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:25:36.365077 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.365007    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-kube-api-access-575rr" (OuterVolumeSpecName: "kube-api-access-575rr") pod "2795aeeb-4e53-4ed8-9ef1-fad3cdc59145" (UID: "2795aeeb-4e53-4ed8-9ef1-fad3cdc59145"). InnerVolumeSpecName "kube-api-access-575rr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:25:36.429845 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.429751    2556 generic.go:356] "Generic (PLEG): container finished" podID="2795aeeb-4e53-4ed8-9ef1-fad3cdc59145" containerID="11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71" exitCode=0
Jul 02 20:25:36.429845 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.429796    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"
Jul 02 20:25:36.429845 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.429836    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542" event={"ID":"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145","Type":"ContainerDied","Data":"11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71"}
Jul 02 20:25:36.430083 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.429888    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542" event={"ID":"2795aeeb-4e53-4ed8-9ef1-fad3cdc59145","Type":"ContainerDied","Data":"9d497159ea812747c50866541e7dc15ffe57613165c48d7be187f5b5c4428c8c"}
Jul 02 20:25:36.430083 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.429909    2556 scope.go:117] "RemoveContainer" containerID="11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71"
Jul 02 20:25:36.444966 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.444907    2556 scope.go:117] "RemoveContainer" containerID="11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71"
Jul 02 20:25:36.445345 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:25:36.445315    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71\": container with ID starting with 11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71 not found: ID does not exist" containerID="11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71"
Jul 02 20:25:36.445445 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.445353    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71"} err="failed to get container status \"11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71\": rpc error: code = NotFound desc = could not find container \"11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71\": container with ID starting with 11291d90c8afdc8d33cd6ab61f0a44cc3e16e1bc1655e67f8d61fc135d825f71 not found: ID does not exist"
Jul 02 20:25:36.454762 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.454733    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"]
Jul 02 20:25:36.459301 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.459257    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-58953a-7f8fb464f6-q7542"]
Jul 02 20:25:36.463773 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.463752    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-maas-api-tls\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:25:36.463773 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.463772    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-575rr\" (UniqueName: \"kubernetes.io/projected/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-kube-api-access-575rr\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:25:36.463916 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:36.463783    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145-openshift-service-ca\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:25:38.196821 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:38.196781    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2795aeeb-4e53-4ed8-9ef1-fad3cdc59145" path="/var/lib/kubelet/pods/2795aeeb-4e53-4ed8-9ef1-fad3cdc59145/volumes"
Jul 02 20:25:42.177387 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:42.177351    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:42.246730 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:42.246695    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:42.455081 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:42.454983    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:42.715386 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:42.715307    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:43.142417 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:43.142387    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:43.402155 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:43.402075    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:44.052216 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:44.052179    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:46.469244 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.469209    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:46.517417 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.517383    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"]
Jul 02 20:25:46.517792 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.517777    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2795aeeb-4e53-4ed8-9ef1-fad3cdc59145" containerName="maas-api"
Jul 02 20:25:46.517843 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.517794    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2795aeeb-4e53-4ed8-9ef1-fad3cdc59145" containerName="maas-api"
Jul 02 20:25:46.517843 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.517817    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb49c310-2b71-477b-a122-7c6ea23f30e1" containerName="maas-api"
Jul 02 20:25:46.517843 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.517822    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb49c310-2b71-477b-a122-7c6ea23f30e1" containerName="maas-api"
Jul 02 20:25:46.517952 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.517875    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb49c310-2b71-477b-a122-7c6ea23f30e1" containerName="maas-api"
Jul 02 20:25:46.517952 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.517882    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2795aeeb-4e53-4ed8-9ef1-fad3cdc59145" containerName="maas-api"
Jul 02 20:25:46.520848 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.520824    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:46.523203 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.523182    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-3136f3-serving-cert\""
Jul 02 20:25:46.530632 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.530605    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"]
Jul 02 20:25:46.564176 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.564144    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:46.657250 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.657216    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz65k\" (UniqueName: \"kubernetes.io/projected/a8a1fef4-6ea4-443f-8577-d389726c020c-kube-api-access-wz65k\") pod \"maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg\" (UID: \"a8a1fef4-6ea4-443f-8577-d389726c020c\") " pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:46.657486 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.657301    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8a1fef4-6ea4-443f-8577-d389726c020c-maas-api-tls\") pod \"maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg\" (UID: \"a8a1fef4-6ea4-443f-8577-d389726c020c\") " pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:46.657486 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.657325    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8a1fef4-6ea4-443f-8577-d389726c020c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg\" (UID: \"a8a1fef4-6ea4-443f-8577-d389726c020c\") " pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:46.663936 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.663908    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:46.757985 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.757947    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8a1fef4-6ea4-443f-8577-d389726c020c-maas-api-tls\") pod \"maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg\" (UID: \"a8a1fef4-6ea4-443f-8577-d389726c020c\") " pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:46.758183 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.757989    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8a1fef4-6ea4-443f-8577-d389726c020c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg\" (UID: \"a8a1fef4-6ea4-443f-8577-d389726c020c\") " pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:46.758183 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.758044    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz65k\" (UniqueName: \"kubernetes.io/projected/a8a1fef4-6ea4-443f-8577-d389726c020c-kube-api-access-wz65k\") pod \"maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg\" (UID: \"a8a1fef4-6ea4-443f-8577-d389726c020c\") " pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:46.758183 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:25:46.758122    2556 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-3136f3-serving-cert: secret "maas-api-e2e-shared-a-3136f3-serving-cert" not found
Jul 02 20:25:46.758350 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:25:46.758230    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a1fef4-6ea4-443f-8577-d389726c020c-maas-api-tls podName:a8a1fef4-6ea4-443f-8577-d389726c020c nodeName:}" failed. No retries permitted until 2026-07-02 20:25:47.258207738 +0000 UTC m=+2091.620354787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a8a1fef4-6ea4-443f-8577-d389726c020c-maas-api-tls") pod "maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg" (UID: "a8a1fef4-6ea4-443f-8577-d389726c020c") : secret "maas-api-e2e-shared-a-3136f3-serving-cert" not found
Jul 02 20:25:46.758751 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.758731    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8a1fef4-6ea4-443f-8577-d389726c020c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg\" (UID: \"a8a1fef4-6ea4-443f-8577-d389726c020c\") " pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:46.767093 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.767069    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz65k\" (UniqueName: \"kubernetes.io/projected/a8a1fef4-6ea4-443f-8577-d389726c020c-kube-api-access-wz65k\") pod \"maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg\" (UID: \"a8a1fef4-6ea4-443f-8577-d389726c020c\") " pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:46.936955 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:46.936923    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:47.041007 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:47.040926    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:47.140751 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:47.140716    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:47.263246 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:47.263192    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8a1fef4-6ea4-443f-8577-d389726c020c-maas-api-tls\") pod \"maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg\" (UID: \"a8a1fef4-6ea4-443f-8577-d389726c020c\") " pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:47.265714 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:47.265679    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8a1fef4-6ea4-443f-8577-d389726c020c-maas-api-tls\") pod \"maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg\" (UID: \"a8a1fef4-6ea4-443f-8577-d389726c020c\") " pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:47.433113 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:47.433019    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:47.574853 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:47.574673    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"]
Jul 02 20:25:47.577958 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:25:47.577932    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a1fef4_6ea4_443f_8577_d389726c020c.slice/crio-36f10ba426430d16a79bcf663d32b73548b8bb032863733317dcf1b235bfd868 WatchSource:0}: Error finding container 36f10ba426430d16a79bcf663d32b73548b8bb032863733317dcf1b235bfd868: Status 404 returned error can't find the container with id 36f10ba426430d16a79bcf663d32b73548b8bb032863733317dcf1b235bfd868
Jul 02 20:25:48.489233 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:48.489186    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg" event={"ID":"a8a1fef4-6ea4-443f-8577-d389726c020c","Type":"ContainerStarted","Data":"07b8b6ebebe26402b431ab55998e303ae3e9f8609f379fbc6193f57de01f4348"}
Jul 02 20:25:48.489540 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:48.489320    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg" event={"ID":"a8a1fef4-6ea4-443f-8577-d389726c020c","Type":"ContainerStarted","Data":"36f10ba426430d16a79bcf663d32b73548b8bb032863733317dcf1b235bfd868"}
Jul 02 20:25:48.489540 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:48.489353    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:48.506414 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:48.506363    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg" podStartSLOduration=2.154856854 podStartE2EDuration="2.506345353s" totalImagesPullingTime="351.488499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:25:48.505248972 +0000 UTC m=+2092.867396062" watchObservedRunningTime="2026-07-02 20:25:48.506345353 +0000 UTC m=+2092.868492416"
Jul 02 20:25:50.924301 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:50.924249    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:51.297565 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:51.297527    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:51.618213 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:51.618104    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:51.749843 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:51.749810    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:54.456760 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.456730    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:54.500075 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.500049    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:25:54.514640 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.514612    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"]
Jul 02 20:25:54.518583 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.518561    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:25:54.521079 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.521054    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-c7f980-serving-cert\""
Jul 02 20:25:54.530818 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.530788    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"]
Jul 02 20:25:54.541053 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.541015    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:54.615893 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.615856    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:54.629906 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.629883    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn\" (UID: \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\") " pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:25:54.630459 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.629989    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6p5l\" (UniqueName: \"kubernetes.io/projected/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-kube-api-access-n6p5l\") pod \"maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn\" (UID: \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\") " pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:25:54.630746 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.630715    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-maas-api-tls\") pod \"maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn\" (UID: \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\") " pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:25:54.741906 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.741868    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-maas-api-tls\") pod \"maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn\" (UID: \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\") " pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:25:54.742073 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.741947    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn\" (UID: \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\") " pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:25:54.742073 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.741972    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6p5l\" (UniqueName: \"kubernetes.io/projected/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-kube-api-access-n6p5l\") pod \"maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn\" (UID: \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\") " pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:25:54.742073 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:25:54.742046    2556 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-c7f980-serving-cert: secret "maas-api-e2e-shared-b-c7f980-serving-cert" not found
Jul 02 20:25:54.742181 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:25:54.742141    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-maas-api-tls podName:5c6fd6b8-acb1-46e4-af3b-1582ac3a496c nodeName:}" failed. No retries permitted until 2026-07-02 20:25:55.242118668 +0000 UTC m=+2099.604265727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-maas-api-tls") pod "maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn" (UID: "5c6fd6b8-acb1-46e4-af3b-1582ac3a496c") : secret "maas-api-e2e-shared-b-c7f980-serving-cert" not found
Jul 02 20:25:54.742676 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.742656    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn\" (UID: \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\") " pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:25:54.750563 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:54.750531    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6p5l\" (UniqueName: \"kubernetes.io/projected/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-kube-api-access-n6p5l\") pod \"maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn\" (UID: \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\") " pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:25:55.024901 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:55.024811    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:55.122759 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:55.122718    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:55.245065 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:55.245022    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-maas-api-tls\") pod \"maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn\" (UID: \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\") " pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:25:55.247497 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:55.247471    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-maas-api-tls\") pod \"maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn\" (UID: \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\") " pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:25:55.285252 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:55.285163    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:55.430965 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:55.430926    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:25:55.574804 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:55.574773    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"]
Jul 02 20:25:55.577518 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:25:55.577488    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6fd6b8_acb1_46e4_af3b_1582ac3a496c.slice/crio-8255d8deefd5056873c95c94f01a68c65c941ef63f2d6d43d16eff3957c9a181 WatchSource:0}: Error finding container 8255d8deefd5056873c95c94f01a68c65c941ef63f2d6d43d16eff3957c9a181: Status 404 returned error can't find the container with id 8255d8deefd5056873c95c94f01a68c65c941ef63f2d6d43d16eff3957c9a181
Jul 02 20:25:56.530443 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:56.530400    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn" event={"ID":"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c","Type":"ContainerStarted","Data":"0bbce7be96ffa905ed38452c7995f1a95f37aa8a3bdd116f34523d3647402c6c"}
Jul 02 20:25:56.530627 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:56.530463    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn" event={"ID":"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c","Type":"ContainerStarted","Data":"8255d8deefd5056873c95c94f01a68c65c941ef63f2d6d43d16eff3957c9a181"}
Jul 02 20:25:56.530627 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:56.530493    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:25:56.547550 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:56.547486    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn" podStartSLOduration=1.995586667 podStartE2EDuration="2.547469602s" totalImagesPullingTime="551.882935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:25:56.545803882 +0000 UTC m=+2100.907950942" watchObservedRunningTime="2026-07-02 20:25:56.547469602 +0000 UTC m=+2100.909616672"
Jul 02 20:25:58.236506 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:58.236458    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:25:59.627517 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:25:59.627442    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:26:02.542865 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:26:02.542832    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:26:07.752823 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:26:07.752783    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:26:07.853727 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:26:07.853694    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:26:14.515055 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:26:14.515019    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:26:15.960883 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:26:15.960840    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:26:16.061404 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:26:16.061340    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:26:38.618757 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:26:38.618723    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:28:29.715863 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:29.715829    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:28:30.698681 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:30.698639    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:28:37.201466 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.201431    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"]
Jul 02 20:28:37.204648 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.204629    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.208152 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.208120    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3136f3\"/\"default-dockercfg-ntp2s\""
Jul 02 20:28:37.208318 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.208160    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3136f3\"/\"sub-test-model-3136f3-kserve-self-signed-certs\""
Jul 02 20:28:37.208318 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.208203    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3136f3\"/\"kube-root-ca.crt\""
Jul 02 20:28:37.208318 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.208245    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3136f3\"/\"openshift-service-ca.crt\""
Jul 02 20:28:37.214604 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.214576    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"]
Jul 02 20:28:37.287164 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.287133    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:28:37.301385 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.301347    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-dshm\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.301550 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.301434    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-home\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.301550 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.301462    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f23fdb8-6b2f-4449-b595-315f88eb3270-tls-certs\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.301550 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.301522    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-tmp-dir\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.301662 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.301600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-model-cache\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.301662 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.301643    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhbjg\" (UniqueName: \"kubernetes.io/projected/0f23fdb8-6b2f-4449-b595-315f88eb3270-kube-api-access-qhbjg\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.402074 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.402035    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-model-cache\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.402309 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.402089    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhbjg\" (UniqueName: \"kubernetes.io/projected/0f23fdb8-6b2f-4449-b595-315f88eb3270-kube-api-access-qhbjg\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.402309 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.402127    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-dshm\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.402309 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.402179    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-home\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.402309 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.402212    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f23fdb8-6b2f-4449-b595-315f88eb3270-tls-certs\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.402309 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.402253    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-tmp-dir\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.402536 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.402500    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-model-cache\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.402697 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.402673    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-tmp-dir\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.402742 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.402685    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-home\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.404448 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.404423    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-dshm\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.404939 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.404915    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f23fdb8-6b2f-4449-b595-315f88eb3270-tls-certs\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.412207 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.412179    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhbjg\" (UniqueName: \"kubernetes.io/projected/0f23fdb8-6b2f-4449-b595-315f88eb3270-kube-api-access-qhbjg\") pod \"sub-test-model-3136f3-kserve-c7888b96c-27zkq\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") " pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.514261 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.514222    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:37.659828 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:37.659802    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"]
Jul 02 20:28:37.664051 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:28:37.664017    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f23fdb8_6b2f_4449_b595_315f88eb3270.slice/crio-27cad936af0e6dd1fd119c496225bce8bd4d68d64d22979a48aabd17d87efbb6 WatchSource:0}: Error finding container 27cad936af0e6dd1fd119c496225bce8bd4d68d64d22979a48aabd17d87efbb6: Status 404 returned error can't find the container with id 27cad936af0e6dd1fd119c496225bce8bd4d68d64d22979a48aabd17d87efbb6
Jul 02 20:28:38.299886 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:38.299847    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq" event={"ID":"0f23fdb8-6b2f-4449-b595-315f88eb3270","Type":"ContainerStarted","Data":"44dbea9176bf7e47b2a5b912049ff3f11a5e8b1347a89ae8174df1d3e9747d57"}
Jul 02 20:28:38.300378 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:38.299897    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq" event={"ID":"0f23fdb8-6b2f-4449-b595-315f88eb3270","Type":"ContainerStarted","Data":"27cad936af0e6dd1fd119c496225bce8bd4d68d64d22979a48aabd17d87efbb6"}
Jul 02 20:28:38.320951 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:38.320898    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq" podStartSLOduration=1.320882885 podStartE2EDuration="1.320882885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:28:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:28:38.318546376 +0000 UTC m=+2262.680693438" watchObservedRunningTime="2026-07-02 20:28:38.320882885 +0000 UTC m=+2262.683029997"
Jul 02 20:28:47.514537 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:47.514500    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:47.514970 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:47.514774    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:47.527259 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:47.527223    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:28:48.360629 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:28:48.360597    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:29:05.680704 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:29:05.680664    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:29:16.403126 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:29:16.403095    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:29:56.106895 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:29:56.106808    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"]
Jul 02 20:29:56.128880 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:29:56.128851    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:29:57.017657 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:29:57.017624    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:30:01.132936 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:01.132893    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:30:11.127516 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.127471    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq" podUID="0f23fdb8-6b2f-4449-b595-315f88eb3270" containerName="main" containerID="cri-o://44dbea9176bf7e47b2a5b912049ff3f11a5e8b1347a89ae8174df1d3e9747d57" gracePeriod=45
Jul 02 20:30:11.377172 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.377144    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:30:11.437961 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.437859    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-home\") pod \"0f23fdb8-6b2f-4449-b595-315f88eb3270\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") "
Jul 02 20:30:11.437961 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.437941    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-dshm\") pod \"0f23fdb8-6b2f-4449-b595-315f88eb3270\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") "
Jul 02 20:30:11.438198 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.437986    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhbjg\" (UniqueName: \"kubernetes.io/projected/0f23fdb8-6b2f-4449-b595-315f88eb3270-kube-api-access-qhbjg\") pod \"0f23fdb8-6b2f-4449-b595-315f88eb3270\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") "
Jul 02 20:30:11.438198 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.438040    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-tmp-dir\") pod \"0f23fdb8-6b2f-4449-b595-315f88eb3270\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") "
Jul 02 20:30:11.438198 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.438063    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-model-cache\") pod \"0f23fdb8-6b2f-4449-b595-315f88eb3270\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") "
Jul 02 20:30:11.438198 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.438107    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f23fdb8-6b2f-4449-b595-315f88eb3270-tls-certs\") pod \"0f23fdb8-6b2f-4449-b595-315f88eb3270\" (UID: \"0f23fdb8-6b2f-4449-b595-315f88eb3270\") "
Jul 02 20:30:11.438198 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.438142    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-home" (OuterVolumeSpecName: "home") pod "0f23fdb8-6b2f-4449-b595-315f88eb3270" (UID: "0f23fdb8-6b2f-4449-b595-315f88eb3270"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:30:11.438501 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.438398    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0f23fdb8-6b2f-4449-b595-315f88eb3270" (UID: "0f23fdb8-6b2f-4449-b595-315f88eb3270"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:30:11.438501 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.438420    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-home\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:30:11.438501 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.438486    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-model-cache" (OuterVolumeSpecName: "model-cache") pod "0f23fdb8-6b2f-4449-b595-315f88eb3270" (UID: "0f23fdb8-6b2f-4449-b595-315f88eb3270"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:30:11.440267 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.440243    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-dshm" (OuterVolumeSpecName: "dshm") pod "0f23fdb8-6b2f-4449-b595-315f88eb3270" (UID: "0f23fdb8-6b2f-4449-b595-315f88eb3270"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:30:11.440583 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.440563    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f23fdb8-6b2f-4449-b595-315f88eb3270-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0f23fdb8-6b2f-4449-b595-315f88eb3270" (UID: "0f23fdb8-6b2f-4449-b595-315f88eb3270"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:30:11.440583 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.440570    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f23fdb8-6b2f-4449-b595-315f88eb3270-kube-api-access-qhbjg" (OuterVolumeSpecName: "kube-api-access-qhbjg") pod "0f23fdb8-6b2f-4449-b595-315f88eb3270" (UID: "0f23fdb8-6b2f-4449-b595-315f88eb3270"). InnerVolumeSpecName "kube-api-access-qhbjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:30:11.539444 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.539404    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-tmp-dir\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:30:11.539444 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.539436    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-model-cache\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:30:11.539444 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.539447    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f23fdb8-6b2f-4449-b595-315f88eb3270-tls-certs\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:30:11.539444 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.539454    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f23fdb8-6b2f-4449-b595-315f88eb3270-dshm\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:30:11.539717 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.539464    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhbjg\" (UniqueName: \"kubernetes.io/projected/0f23fdb8-6b2f-4449-b595-315f88eb3270-kube-api-access-qhbjg\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:30:11.741348 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.741256    2556 generic.go:356] "Generic (PLEG): container finished" podID="0f23fdb8-6b2f-4449-b595-315f88eb3270" containerID="44dbea9176bf7e47b2a5b912049ff3f11a5e8b1347a89ae8174df1d3e9747d57" exitCode=0
Jul 02 20:30:11.741528 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.741355    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"
Jul 02 20:30:11.741528 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.741352    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq" event={"ID":"0f23fdb8-6b2f-4449-b595-315f88eb3270","Type":"ContainerDied","Data":"44dbea9176bf7e47b2a5b912049ff3f11a5e8b1347a89ae8174df1d3e9747d57"}
Jul 02 20:30:11.741528 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.741499    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq" event={"ID":"0f23fdb8-6b2f-4449-b595-315f88eb3270","Type":"ContainerDied","Data":"27cad936af0e6dd1fd119c496225bce8bd4d68d64d22979a48aabd17d87efbb6"}
Jul 02 20:30:11.741638 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.741529    2556 scope.go:117] "RemoveContainer" containerID="44dbea9176bf7e47b2a5b912049ff3f11a5e8b1347a89ae8174df1d3e9747d57"
Jul 02 20:30:11.750289 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.750246    2556 scope.go:117] "RemoveContainer" containerID="44dbea9176bf7e47b2a5b912049ff3f11a5e8b1347a89ae8174df1d3e9747d57"
Jul 02 20:30:11.750604 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:30:11.750574    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44dbea9176bf7e47b2a5b912049ff3f11a5e8b1347a89ae8174df1d3e9747d57\": container with ID starting with 44dbea9176bf7e47b2a5b912049ff3f11a5e8b1347a89ae8174df1d3e9747d57 not found: ID does not exist" containerID="44dbea9176bf7e47b2a5b912049ff3f11a5e8b1347a89ae8174df1d3e9747d57"
Jul 02 20:30:11.750706 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.750617    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44dbea9176bf7e47b2a5b912049ff3f11a5e8b1347a89ae8174df1d3e9747d57"} err="failed to get container status \"44dbea9176bf7e47b2a5b912049ff3f11a5e8b1347a89ae8174df1d3e9747d57\": rpc error: code = NotFound desc = could not find container \"44dbea9176bf7e47b2a5b912049ff3f11a5e8b1347a89ae8174df1d3e9747d57\": container with ID starting with 44dbea9176bf7e47b2a5b912049ff3f11a5e8b1347a89ae8174df1d3e9747d57 not found: ID does not exist"
Jul 02 20:30:11.766698 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.766666    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"]
Jul 02 20:30:11.773248 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:11.773220    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/sub-test-model-3136f3-kserve-c7888b96c-27zkq"]
Jul 02 20:30:12.197597 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:12.197512    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f23fdb8-6b2f-4449-b595-315f88eb3270" path="/var/lib/kubelet/pods/0f23fdb8-6b2f-4449-b595-315f88eb3270/volumes"
Jul 02 20:30:36.700037 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:36.700000    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:30:36.799348 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:36.799314    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:30:54.023225 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:30:54.023180    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:01.366116 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:01.366079    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:02.683381 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:02.683340    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:08.470694 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:08.470655    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:08.572158 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:08.572129    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:16.662484 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:16.662440    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:16.763592 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:16.763558    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:30.058932 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:30.058896    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:33.952377 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:33.952329    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:34.907258 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:34.907196    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:36.043121 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:36.043083    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:36.558206 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:36.558167    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:36.719235 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:36.719201    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:36.820011 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:36.819912    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:36.932912 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:36.932879    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"]
Jul 02 20:31:36.933201 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:36.933164    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg" podUID="a8a1fef4-6ea4-443f-8577-d389726c020c" containerName="maas-api" containerID="cri-o://07b8b6ebebe26402b431ab55998e303ae3e9f8609f379fbc6193f57de01f4348" gracePeriod=30
Jul 02 20:31:36.958422 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:36.958388    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:31:37.386286 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:37.386256    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:31:37.497631 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:37.497592    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz65k\" (UniqueName: \"kubernetes.io/projected/a8a1fef4-6ea4-443f-8577-d389726c020c-kube-api-access-wz65k\") pod \"a8a1fef4-6ea4-443f-8577-d389726c020c\" (UID: \"a8a1fef4-6ea4-443f-8577-d389726c020c\") "
Jul 02 20:31:37.497631 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:37.497632    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8a1fef4-6ea4-443f-8577-d389726c020c-openshift-service-ca\") pod \"a8a1fef4-6ea4-443f-8577-d389726c020c\" (UID: \"a8a1fef4-6ea4-443f-8577-d389726c020c\") "
Jul 02 20:31:37.497896 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:37.497739    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8a1fef4-6ea4-443f-8577-d389726c020c-maas-api-tls\") pod \"a8a1fef4-6ea4-443f-8577-d389726c020c\" (UID: \"a8a1fef4-6ea4-443f-8577-d389726c020c\") "
Jul 02 20:31:37.498103 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:37.498076    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8a1fef4-6ea4-443f-8577-d389726c020c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a8a1fef4-6ea4-443f-8577-d389726c020c" (UID: "a8a1fef4-6ea4-443f-8577-d389726c020c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:31:37.499861 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:37.499835    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a1fef4-6ea4-443f-8577-d389726c020c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a8a1fef4-6ea4-443f-8577-d389726c020c" (UID: "a8a1fef4-6ea4-443f-8577-d389726c020c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:31:37.499947 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:37.499882    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8a1fef4-6ea4-443f-8577-d389726c020c-kube-api-access-wz65k" (OuterVolumeSpecName: "kube-api-access-wz65k") pod "a8a1fef4-6ea4-443f-8577-d389726c020c" (UID: "a8a1fef4-6ea4-443f-8577-d389726c020c"). InnerVolumeSpecName "kube-api-access-wz65k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:31:37.599341 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:37.599259    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8a1fef4-6ea4-443f-8577-d389726c020c-maas-api-tls\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:31:37.599341 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:37.599333    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz65k\" (UniqueName: \"kubernetes.io/projected/a8a1fef4-6ea4-443f-8577-d389726c020c-kube-api-access-wz65k\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:31:37.599341 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:37.599344    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8a1fef4-6ea4-443f-8577-d389726c020c-openshift-service-ca\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:31:38.146620 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:38.146579    2556 generic.go:356] "Generic (PLEG): container finished" podID="a8a1fef4-6ea4-443f-8577-d389726c020c" containerID="07b8b6ebebe26402b431ab55998e303ae3e9f8609f379fbc6193f57de01f4348" exitCode=0
Jul 02 20:31:38.146841 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:38.146629    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"
Jul 02 20:31:38.146841 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:38.146662    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg" event={"ID":"a8a1fef4-6ea4-443f-8577-d389726c020c","Type":"ContainerDied","Data":"07b8b6ebebe26402b431ab55998e303ae3e9f8609f379fbc6193f57de01f4348"}
Jul 02 20:31:38.146841 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:38.146722    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg" event={"ID":"a8a1fef4-6ea4-443f-8577-d389726c020c","Type":"ContainerDied","Data":"36f10ba426430d16a79bcf663d32b73548b8bb032863733317dcf1b235bfd868"}
Jul 02 20:31:38.146841 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:38.146745    2556 scope.go:117] "RemoveContainer" containerID="07b8b6ebebe26402b431ab55998e303ae3e9f8609f379fbc6193f57de01f4348"
Jul 02 20:31:38.159800 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:38.159781    2556 scope.go:117] "RemoveContainer" containerID="07b8b6ebebe26402b431ab55998e303ae3e9f8609f379fbc6193f57de01f4348"
Jul 02 20:31:38.160087 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:31:38.160066    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07b8b6ebebe26402b431ab55998e303ae3e9f8609f379fbc6193f57de01f4348\": container with ID starting with 07b8b6ebebe26402b431ab55998e303ae3e9f8609f379fbc6193f57de01f4348 not found: ID does not exist" containerID="07b8b6ebebe26402b431ab55998e303ae3e9f8609f379fbc6193f57de01f4348"
Jul 02 20:31:38.160154 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:38.160100    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07b8b6ebebe26402b431ab55998e303ae3e9f8609f379fbc6193f57de01f4348"} err="failed to get container status \"07b8b6ebebe26402b431ab55998e303ae3e9f8609f379fbc6193f57de01f4348\": rpc error: code = NotFound desc = could not find container \"07b8b6ebebe26402b431ab55998e303ae3e9f8609f379fbc6193f57de01f4348\": container with ID starting with 07b8b6ebebe26402b431ab55998e303ae3e9f8609f379fbc6193f57de01f4348 not found: ID does not exist"
Jul 02 20:31:38.168780 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:38.168751    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"]
Jul 02 20:31:38.172639 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:38.172615    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-3136f3-75fb9fc6fc-q8mzg"]
Jul 02 20:31:38.196742 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:38.196708    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8a1fef4-6ea4-443f-8577-d389726c020c" path="/var/lib/kubelet/pods/a8a1fef4-6ea4-443f-8577-d389726c020c/volumes"
Jul 02 20:31:41.565202 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:31:41.565169    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:07.833153 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:07.833117    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:08.104720 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:08.104635    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:08.360036 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:08.359949    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:08.607245 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:08.607210    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:09.039544 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:09.039505    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:09.250334 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:09.250297    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:09.349462 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:09.349373    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:09.468476 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:09.468440    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"]
Jul 02 20:32:09.468719 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:09.468692    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn" podUID="5c6fd6b8-acb1-46e4-af3b-1582ac3a496c" containerName="maas-api" containerID="cri-o://0bbce7be96ffa905ed38452c7995f1a95f37aa8a3bdd116f34523d3647402c6c" gracePeriod=30
Jul 02 20:32:09.508419 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:09.508391    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:09.921381 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:09.921358    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:32:09.989037 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:09.989003    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-maas-api-tls\") pod \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\" (UID: \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\") "
Jul 02 20:32:09.989226 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:09.989064    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-openshift-service-ca\") pod \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\" (UID: \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\") "
Jul 02 20:32:09.989226 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:09.989092    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6p5l\" (UniqueName: \"kubernetes.io/projected/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-kube-api-access-n6p5l\") pod \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\" (UID: \"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c\") "
Jul 02 20:32:09.989517 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:09.989491    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5c6fd6b8-acb1-46e4-af3b-1582ac3a496c" (UID: "5c6fd6b8-acb1-46e4-af3b-1582ac3a496c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:32:09.991211 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:09.991180    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5c6fd6b8-acb1-46e4-af3b-1582ac3a496c" (UID: "5c6fd6b8-acb1-46e4-af3b-1582ac3a496c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:32:09.991211 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:09.991184    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-kube-api-access-n6p5l" (OuterVolumeSpecName: "kube-api-access-n6p5l") pod "5c6fd6b8-acb1-46e4-af3b-1582ac3a496c" (UID: "5c6fd6b8-acb1-46e4-af3b-1582ac3a496c"). InnerVolumeSpecName "kube-api-access-n6p5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:32:10.090559 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:10.090517    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-maas-api-tls\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:32:10.090559 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:10.090554    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-openshift-service-ca\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:32:10.090559 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:10.090567    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6p5l\" (UniqueName: \"kubernetes.io/projected/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c-kube-api-access-n6p5l\") on node \"ip-10-0-130-14.ec2.internal\" DevicePath \"\""
Jul 02 20:32:10.298253 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:10.298162    2556 generic.go:356] "Generic (PLEG): container finished" podID="5c6fd6b8-acb1-46e4-af3b-1582ac3a496c" containerID="0bbce7be96ffa905ed38452c7995f1a95f37aa8a3bdd116f34523d3647402c6c" exitCode=0
Jul 02 20:32:10.298253 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:10.298204    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn" event={"ID":"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c","Type":"ContainerDied","Data":"0bbce7be96ffa905ed38452c7995f1a95f37aa8a3bdd116f34523d3647402c6c"}
Jul 02 20:32:10.298253 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:10.298246    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn" event={"ID":"5c6fd6b8-acb1-46e4-af3b-1582ac3a496c","Type":"ContainerDied","Data":"8255d8deefd5056873c95c94f01a68c65c941ef63f2d6d43d16eff3957c9a181"}
Jul 02 20:32:10.298486 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:10.298205    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"
Jul 02 20:32:10.298486 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:10.298268    2556 scope.go:117] "RemoveContainer" containerID="0bbce7be96ffa905ed38452c7995f1a95f37aa8a3bdd116f34523d3647402c6c"
Jul 02 20:32:10.309126 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:10.309098    2556 scope.go:117] "RemoveContainer" containerID="0bbce7be96ffa905ed38452c7995f1a95f37aa8a3bdd116f34523d3647402c6c"
Jul 02 20:32:10.309479 ip-10-0-130-14 kubenswrapper[2556]: E0702 20:32:10.309459    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bbce7be96ffa905ed38452c7995f1a95f37aa8a3bdd116f34523d3647402c6c\": container with ID starting with 0bbce7be96ffa905ed38452c7995f1a95f37aa8a3bdd116f34523d3647402c6c not found: ID does not exist" containerID="0bbce7be96ffa905ed38452c7995f1a95f37aa8a3bdd116f34523d3647402c6c"
Jul 02 20:32:10.309560 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:10.309487    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bbce7be96ffa905ed38452c7995f1a95f37aa8a3bdd116f34523d3647402c6c"} err="failed to get container status \"0bbce7be96ffa905ed38452c7995f1a95f37aa8a3bdd116f34523d3647402c6c\": rpc error: code = NotFound desc = could not find container \"0bbce7be96ffa905ed38452c7995f1a95f37aa8a3bdd116f34523d3647402c6c\": container with ID starting with 0bbce7be96ffa905ed38452c7995f1a95f37aa8a3bdd116f34523d3647402c6c not found: ID does not exist"
Jul 02 20:32:10.316171 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:10.316145    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"]
Jul 02 20:32:10.320139 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:10.320116    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-c7f980-74b45cbdc5-2lxmn"]
Jul 02 20:32:12.196602 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:12.196559    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c6fd6b8-acb1-46e4-af3b-1582ac3a496c" path="/var/lib/kubelet/pods/5c6fd6b8-acb1-46e4-af3b-1582ac3a496c/volumes"
Jul 02 20:32:14.909729 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:14.909694    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:14.977154 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:14.977124    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:15.253148 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:15.253111    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:15.417956 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:15.417915    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:18.070693 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:18.070643    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:20.573972 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:20.573945    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-djdxw_358b6db0-b1e1-4e66-83d8-ad6cf6eeed50/manager/0.log"
Jul 02 20:32:20.702031 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:20.702001    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cxpqp_1fd53444-4cea-4048-9565-5ed36cdab02b/manager/0.log"
Jul 02 20:32:20.822960 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:20.822929    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6fc994789-kclh4_6ea84ede-2d2d-45cb-91b4-3796a9f25d71/maas-api/0.log"
Jul 02 20:32:21.166584 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:21.166556    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f7795d85f-czhz4_59dbccf9-29b8-49a7-b267-d12d6862f421/manager/0.log"
Jul 02 20:32:21.283125 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:21.283096    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-prrxv_28e93e23-cdc6-4aa2-b12f-ed63d35290bb/server/0.log"
Jul 02 20:32:21.403331 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:21.403302    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bd6vw_2e5d1976-c12b-447b-8f88-3fa010aa72fc/manager/0.log"
Jul 02 20:32:21.650531 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:21.650504    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7_f783ce27-7d7f-4dfe-9c57-5c78419d2ec3/copy-manifests/0.log"
Jul 02 20:32:21.657436 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:21.657413    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7_f783ce27-7d7f-4dfe-9c57-5c78419d2ec3/manager/0.log"
Jul 02 20:32:21.896510 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:21.896479    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ws9cq_e467aafe-df10-4f34-ad3c-43ebc8cb9363/postgres/0.log"
Jul 02 20:32:23.771012 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:23.770978    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vvbh4_2dffc891-b2bf-46e2-9fff-ccb575d0c14f/manager/0.log"
Jul 02 20:32:24.484857 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:24.484823    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5pkpm_7887f30d-53e6-49cf-bc76-03ece410dc3d/discovery/0.log"
Jul 02 20:32:24.598794 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:24.598766    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79ff5d7d55-9sdcp_a982badb-8c88-4845-b7cc-3c3f02b57462/kube-auth-proxy/0.log"
Jul 02 20:32:24.964029 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:24.963948    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-t82dn_1a78d0de-750c-4ff4-b784-036b9c2ff5bf/payload-pre-processing/0.log"
Jul 02 20:32:25.080873 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:25.080846    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dbzf2_c9ac2435-354e-446a-93a0-9a44767318e4/payload-processing/0.log"
Jul 02 20:32:25.787666 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:25.787633    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-slxb9_ff60874d-9906-48a2-98ad-ff9c401795b0/main/0.log"
Jul 02 20:32:26.025778 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:26.025746    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-s6wkz_bf55e8d8-d5d9-4d1a-9b06-5453e7b8ae74/main/0.log"
Jul 02 20:32:30.752390 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:30.752351    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:30.817597 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:30.817553    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log" limit=1024
Jul 02 20:32:33.969575 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:33.969545    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ktd42_5f320b8c-773b-46d2-b6ae-4057cf92f04b/global-pull-secret-syncer/0.log"
Jul 02 20:32:34.025097 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:34.025068    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7gkfk_e8773705-33e6-4a9b-bbaf-49a63596e417/konnectivity-agent/0.log"
Jul 02 20:32:34.107039 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:34.107009    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-14.ec2.internal_d76ef9ff7b6cadafe54bfd3a40fd4b7d/haproxy/0.log"
Jul 02 20:32:39.360460 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:39.360423    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vvbh4_2dffc891-b2bf-46e2-9fff-ccb575d0c14f/manager/0.log"
Jul 02 20:32:41.449653 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:41.449622    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdq5h_994ad059-8b9b-4abc-9e2f-e7b25aeaf843/node-exporter/0.log"
Jul 02 20:32:41.469142 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:41.469110    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdq5h_994ad059-8b9b-4abc-9e2f-e7b25aeaf843/kube-rbac-proxy/0.log"
Jul 02 20:32:41.491181 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:41.491154    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fdq5h_994ad059-8b9b-4abc-9e2f-e7b25aeaf843/init-textfile/0.log"
Jul 02 20:32:42.106595 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:42.106563    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6879868db8-tqmrc_9981b0a4-8efd-47e8-89b9-df6159fab993/thanos-query/0.log"
Jul 02 20:32:42.129162 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:42.129132    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6879868db8-tqmrc_9981b0a4-8efd-47e8-89b9-df6159fab993/kube-rbac-proxy-web/0.log"
Jul 02 20:32:42.153977 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:42.153942    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6879868db8-tqmrc_9981b0a4-8efd-47e8-89b9-df6159fab993/kube-rbac-proxy/0.log"
Jul 02 20:32:42.175541 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:42.175513    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6879868db8-tqmrc_9981b0a4-8efd-47e8-89b9-df6159fab993/prom-label-proxy/0.log"
Jul 02 20:32:42.197164 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:42.197135    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6879868db8-tqmrc_9981b0a4-8efd-47e8-89b9-df6159fab993/kube-rbac-proxy-rules/0.log"
Jul 02 20:32:42.217481 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:42.217449    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6879868db8-tqmrc_9981b0a4-8efd-47e8-89b9-df6159fab993/kube-rbac-proxy-metrics/0.log"
Jul 02 20:32:44.554539 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.554500    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"]
Jul 02 20:32:44.554946 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.554890    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6fd6b8-acb1-46e4-af3b-1582ac3a496c" containerName="maas-api"
Jul 02 20:32:44.554946 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.554902    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6fd6b8-acb1-46e4-af3b-1582ac3a496c" containerName="maas-api"
Jul 02 20:32:44.554946 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.554917    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a1fef4-6ea4-443f-8577-d389726c020c" containerName="maas-api"
Jul 02 20:32:44.554946 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.554922    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a1fef4-6ea4-443f-8577-d389726c020c" containerName="maas-api"
Jul 02 20:32:44.554946 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.554929    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f23fdb8-6b2f-4449-b595-315f88eb3270" containerName="main"
Jul 02 20:32:44.554946 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.554935    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f23fdb8-6b2f-4449-b595-315f88eb3270" containerName="main"
Jul 02 20:32:44.555164 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.554988    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c6fd6b8-acb1-46e4-af3b-1582ac3a496c" containerName="maas-api"
Jul 02 20:32:44.555164 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.554999    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8a1fef4-6ea4-443f-8577-d389726c020c" containerName="maas-api"
Jul 02 20:32:44.555164 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.555004    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f23fdb8-6b2f-4449-b595-315f88eb3270" containerName="main"
Jul 02 20:32:44.557942 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.557922    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.560590 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.560568    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t2l5b\"/\"kube-root-ca.crt\""
Jul 02 20:32:44.560590 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.560583    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t2l5b\"/\"default-dockercfg-gf6wg\""
Jul 02 20:32:44.561553 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.561538    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t2l5b\"/\"openshift-service-ca.crt\""
Jul 02 20:32:44.566945 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.566920    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"]
Jul 02 20:32:44.568578 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.568556    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-sys\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.568712 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.568692    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-podres\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.568764 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.568734    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vnhr\" (UniqueName: \"kubernetes.io/projected/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-kube-api-access-9vnhr\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.568764 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.568760    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-lib-modules\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.568848 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.568775    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-proc\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.669571 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.669531    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-podres\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.669571 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.669578    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vnhr\" (UniqueName: \"kubernetes.io/projected/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-kube-api-access-9vnhr\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.669805 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.669604    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-lib-modules\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.669805 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.669622    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-proc\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.669805 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.669641    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-sys\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.669805 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.669719    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-podres\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.669805 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.669753    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-proc\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.669805 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.669758    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-lib-modules\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.669805 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.669774    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-sys\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.677708 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.677675    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vnhr\" (UniqueName: \"kubernetes.io/projected/3e4ce67f-99aa-4293-bb40-8daf05fea3ce-kube-api-access-9vnhr\") pod \"perf-node-gather-daemonset-pgmmt\" (UID: \"3e4ce67f-99aa-4293-bb40-8daf05fea3ce\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:44.869168 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:44.869072    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:45.003760 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:45.003736    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"]
Jul 02 20:32:45.006729 ip-10-0-130-14 kubenswrapper[2556]: W0702 20:32:45.006705    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3e4ce67f_99aa_4293_bb40_8daf05fea3ce.slice/crio-6b50e4320e9bab29671c5c578fec9f7f13ad30430c66dd72a3e8dc3a49df2643 WatchSource:0}: Error finding container 6b50e4320e9bab29671c5c578fec9f7f13ad30430c66dd72a3e8dc3a49df2643: Status 404 returned error can't find the container with id 6b50e4320e9bab29671c5c578fec9f7f13ad30430c66dd72a3e8dc3a49df2643
Jul 02 20:32:45.463838 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:45.463744    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt" event={"ID":"3e4ce67f-99aa-4293-bb40-8daf05fea3ce","Type":"ContainerStarted","Data":"613b2f1bad046b1610c3de2b2b469e3b77b18a1ba865e72b2da2d3c7dd082831"}
Jul 02 20:32:45.463838 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:45.463795    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt" event={"ID":"3e4ce67f-99aa-4293-bb40-8daf05fea3ce","Type":"ContainerStarted","Data":"6b50e4320e9bab29671c5c578fec9f7f13ad30430c66dd72a3e8dc3a49df2643"}
Jul 02 20:32:45.464029 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:45.463835    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:45.482186 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:45.482132    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt" podStartSLOduration=1.4821160230000001 podStartE2EDuration="1.482116023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:45.480326746 +0000 UTC m=+2509.842473805" watchObservedRunningTime="2026-07-02 20:32:45.482116023 +0000 UTC m=+2509.844263086"
Jul 02 20:32:46.403069 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:46.403033    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6wcxs_0d404999-9d77-4025-bc72-a748f54296dc/dns/0.log"
Jul 02 20:32:46.423795 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:46.423771    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6wcxs_0d404999-9d77-4025-bc72-a748f54296dc/kube-rbac-proxy/0.log"
Jul 02 20:32:46.617032 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:46.616998    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rcpst_829fd4e9-6a1f-4b4d-8cd3-42b944b487b2/dns-node-resolver/0.log"
Jul 02 20:32:47.169551 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:47.169523    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cdzpb_6c722c47-d54a-4fa2-98f5-07009751d2e3/node-ca/0.log"
Jul 02 20:32:48.231731 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:48.231643    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5pkpm_7887f30d-53e6-49cf-bc76-03ece410dc3d/discovery/0.log"
Jul 02 20:32:48.252640 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:48.252610    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79ff5d7d55-9sdcp_a982badb-8c88-4845-b7cc-3c3f02b57462/kube-auth-proxy/0.log"
Jul 02 20:32:48.378991 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:48.378964    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-t82dn_1a78d0de-750c-4ff4-b784-036b9c2ff5bf/payload-pre-processing/0.log"
Jul 02 20:32:48.422985 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:48.422953    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dbzf2_c9ac2435-354e-446a-93a0-9a44767318e4/payload-processing/0.log"
Jul 02 20:32:49.114439 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:49.114412    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9t45c_346f0394-8012-4390-bc10-f96ac365960e/serve-healthcheck-canary/0.log"
Jul 02 20:32:49.787620 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:49.787590    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lc269_98842346-982e-4a6e-9136-3efbd770ac86/kube-rbac-proxy/0.log"
Jul 02 20:32:49.806464 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:49.806437    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lc269_98842346-982e-4a6e-9136-3efbd770ac86/exporter/0.log"
Jul 02 20:32:49.827411 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:49.827382    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lc269_98842346-982e-4a6e-9136-3efbd770ac86/extractor/0.log"
Jul 02 20:32:51.478517 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:51.478487    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-pgmmt"
Jul 02 20:32:51.918506 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:51.918425    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-djdxw_358b6db0-b1e1-4e66-83d8-ad6cf6eeed50/manager/0.log"
Jul 02 20:32:52.039465 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:52.039434    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cxpqp_1fd53444-4cea-4048-9565-5ed36cdab02b/manager/0.log"
Jul 02 20:32:52.073988 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:52.073958    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6fc994789-kclh4_6ea84ede-2d2d-45cb-91b4-3796a9f25d71/maas-api/0.log"
Jul 02 20:32:52.208438 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:52.208364    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f7795d85f-czhz4_59dbccf9-29b8-49a7-b267-d12d6862f421/manager/0.log"
Jul 02 20:32:52.227735 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:52.227706    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-prrxv_28e93e23-cdc6-4aa2-b12f-ed63d35290bb/server/0.log"
Jul 02 20:32:52.294209 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:52.294172    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bd6vw_2e5d1976-c12b-447b-8f88-3fa010aa72fc/manager/0.log"
Jul 02 20:32:52.361288 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:52.361251    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7_f783ce27-7d7f-4dfe-9c57-5c78419d2ec3/manager/0.log"
Jul 02 20:32:52.379804 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:52.379774    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc6b5b4c9-nmcb7_f783ce27-7d7f-4dfe-9c57-5c78419d2ec3/copy-manifests/0.log"
Jul 02 20:32:52.507710 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:52.507687    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ws9cq_e467aafe-df10-4f34-ad3c-43ebc8cb9363/postgres/0.log"
Jul 02 20:32:53.966211 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:53.966177    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8fr4v_b392b1a2-f614-461b-a9a5-7e3e356b8e35/openshift-lws-operator/0.log"
Jul 02 20:32:54.861166 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:54.861079    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5pkpm_7887f30d-53e6-49cf-bc76-03ece410dc3d/discovery/0.log"
Jul 02 20:32:54.871838 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:54.871810    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79ff5d7d55-9sdcp_a982badb-8c88-4845-b7cc-3c3f02b57462/kube-auth-proxy/0.log"
Jul 02 20:32:54.960280 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:54.960234    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-t82dn_1a78d0de-750c-4ff4-b784-036b9c2ff5bf/payload-pre-processing/0.log"
Jul 02 20:32:54.996840 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:54.996811    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dbzf2_c9ac2435-354e-446a-93a0-9a44767318e4/payload-processing/0.log"
Jul 02 20:32:56.263360 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:56.263306    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5pkpm_7887f30d-53e6-49cf-bc76-03ece410dc3d/discovery/0.log"
Jul 02 20:32:56.278925 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:56.278833    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79ff5d7d55-9sdcp_a982badb-8c88-4845-b7cc-3c3f02b57462/kube-auth-proxy/0.log"
Jul 02 20:32:56.389926 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:56.389892    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-t82dn_1a78d0de-750c-4ff4-b784-036b9c2ff5bf/payload-pre-processing/0.log"
Jul 02 20:32:56.429635 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:56.429605    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dbzf2_c9ac2435-354e-446a-93a0-9a44767318e4/payload-processing/0.log"
Jul 02 20:32:59.054990 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:59.054967    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-mntd7_437bbf26-d8c2-4325-84ae-a514ee741d67/migrator/0.log"
Jul 02 20:32:59.075621 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:32:59.075586    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-mntd7_437bbf26-d8c2-4325-84ae-a514ee741d67/graceful-termination/0.log"
Jul 02 20:33:00.747197 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:00.747170    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnpsf_40bf2d56-28e2-45ff-b807-2c3517a4e7d6/kube-multus-additional-cni-plugins/0.log"
Jul 02 20:33:00.766826 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:00.766800    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnpsf_40bf2d56-28e2-45ff-b807-2c3517a4e7d6/egress-router-binary-copy/0.log"
Jul 02 20:33:00.785726 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:00.785700    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnpsf_40bf2d56-28e2-45ff-b807-2c3517a4e7d6/cni-plugins/0.log"
Jul 02 20:33:00.806009 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:00.805978    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnpsf_40bf2d56-28e2-45ff-b807-2c3517a4e7d6/bond-cni-plugin/0.log"
Jul 02 20:33:00.826728 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:00.826705    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnpsf_40bf2d56-28e2-45ff-b807-2c3517a4e7d6/routeoverride-cni/0.log"
Jul 02 20:33:00.846340 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:00.846308    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnpsf_40bf2d56-28e2-45ff-b807-2c3517a4e7d6/whereabouts-cni-bincopy/0.log"
Jul 02 20:33:00.866724 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:00.866701    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xnpsf_40bf2d56-28e2-45ff-b807-2c3517a4e7d6/whereabouts-cni/0.log"
Jul 02 20:33:00.899724 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:00.899690    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bvtcx_c74366c9-55c2-489e-87f5-039729691572/kube-multus/0.log"
Jul 02 20:33:01.005640 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:01.005546    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cpx79_77025d92-7c39-45a3-a54c-4ff7a1ec2d39/network-metrics-daemon/0.log"
Jul 02 20:33:01.024537 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:01.024498    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cpx79_77025d92-7c39-45a3-a54c-4ff7a1ec2d39/kube-rbac-proxy/0.log"
Jul 02 20:33:02.052175 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:02.052145    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9dh9_541e48fc-bb7c-49ec-a7c8-b72ba27ed643/ovn-controller/0.log"
Jul 02 20:33:02.076600 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:02.076575    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9dh9_541e48fc-bb7c-49ec-a7c8-b72ba27ed643/ovn-acl-logging/0.log"
Jul 02 20:33:02.097393 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:02.097366    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9dh9_541e48fc-bb7c-49ec-a7c8-b72ba27ed643/kube-rbac-proxy-node/0.log"
Jul 02 20:33:02.118171 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:02.118140    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9dh9_541e48fc-bb7c-49ec-a7c8-b72ba27ed643/kube-rbac-proxy-ovn-metrics/0.log"
Jul 02 20:33:02.138311 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:02.138264    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9dh9_541e48fc-bb7c-49ec-a7c8-b72ba27ed643/northd/0.log"
Jul 02 20:33:02.160538 ip-10-0-130-14 kubenswrapper[2556]: I0702 20:33:02.160507    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9dh9_541e48fc-bb7c-49ec-a7c8-b72ba27ed643/nbdb/0.log"