Jul 10 17:57:57.322771 ip-10-0-139-9 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 10 17:57:57.322781 ip-10-0-139-9 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 10 17:57:57.322788 ip-10-0-139-9 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 10 17:57:57.323053 ip-10-0-139-9 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 10 17:58:07.351211 ip-10-0-139-9 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 10 17:58:07.351233 ip-10-0-139-9 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot dc6e520185154774802930ff3f30ea8c --
Jul 10 18:00:06.008413 ip-10-0-139-9 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.622638    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630473    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630497    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630501    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630504    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630508    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630511    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630515    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:00:07.673854 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630517    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630520    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630525    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630532    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630535    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630591    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630594    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630598    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630603    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630606    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630609    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630612    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630616    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630620    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630623    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630629    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630632    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630636    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630640    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630643    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:00:07.675558 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630646    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630649    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630652    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630655    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630658    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630661    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630664    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630669    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630672    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630675    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630678    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630682    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630685    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630692    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630695    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630698    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630701    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630704    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630707    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:00:07.676902 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630712    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630715    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630718    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630720    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630723    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630725    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630728    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630732    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630735    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630738    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630740    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630743    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630746    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630751    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630754    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630756    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630759    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630764    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630767    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:00:07.681691 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630771    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630773    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630776    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630779    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630782    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630784    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630790    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630793    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630796    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630799    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630803    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630806    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630808    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630811    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630814    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630817    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630820    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630823    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630829    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630832    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:00:07.682603 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630836    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630848    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630852    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630855    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630858    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630862    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630865    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630869    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630872    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630875    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630881    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630884    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630886    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.630890    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648449    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648471    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648475    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648479    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648482    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:00:07.684125 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648485    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648488    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648491    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648493    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648496    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648502    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648507    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648510    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648514    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648517    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648521    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648524    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648527    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648531    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648534    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648538    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648541    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648544    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648547    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:00:07.685031 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648550    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648553    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648555    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648558    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648560    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648563    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648566    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648568    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648572    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648576    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648579    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648581    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648584    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648586    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648589    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648592    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648595    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648597    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648600    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648603    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:00:07.686145 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648606    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648608    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648613    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648616    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648619    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648622    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648625    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648627    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648630    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648632    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648635    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648638    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648641    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648643    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648646    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648648    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648651    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648653    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648656    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648660    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:00:07.691034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648663    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648666    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648669    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648672    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648675    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648677    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648680    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648683    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648686    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648688    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648692    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648695    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648697    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648700    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648702    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648705    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648707    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648710    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648712    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648726    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:00:07.691914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648729    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648731    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648734    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648737    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648739    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648742    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648745    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648748    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648751    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648753    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648756    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648761    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648764    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648767    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.648770    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649196    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649201    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649204    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649207    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:00:07.692798 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649210    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649213    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649216    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649219    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649222    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649225    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649228    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649232    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649236    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649239    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649242    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649245    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649248    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649251    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649253    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649256    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649259    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649261    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649264    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649267    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:00:07.694570 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649270    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649273    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649275    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649278    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649284    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649288    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649291    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649295    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649297    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649301    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649303    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649329    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649334    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649336    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649340    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649342    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649345    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649348    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649350    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:00:07.695488 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649353    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649356    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649358    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649361    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649365    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649367    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649371    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649373    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649376    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649379    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649381    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649384    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649387    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649389    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649391    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649394    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649397    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649402    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649405    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649408    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:00:07.696591 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649410    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649413    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649415    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649418    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649421    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649423    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649426    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649428    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649431    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649434    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649436    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649439    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649441    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649444    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649447    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649449    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649452    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649454    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649458    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:00:07.772933 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649463    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:00:07.731173 ip-10-0-139-9 systemd[1]: Started Kubernetes Kubelet.
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649468    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649471    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649474    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649477    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649480    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649482    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649485    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649490    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649493    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649497    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649500    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649502    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649505    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649507    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649510    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.649513    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649594    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649603    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649611    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649616    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 18:00:07.773986 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649620    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649624    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649638    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649644    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649647    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649651    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649655    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649658    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649661    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649664    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649667    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649670    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649675    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649678    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649683    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649686    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649689    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649692    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649696    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649701    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649704    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649710    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649713    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649717    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 18:00:07.775681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649720    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649723    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649726    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649729    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649733    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649737    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649740    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649743    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649746    2569 flags.go:64] FLAG: --enable-server="true"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649749    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649753    2569 flags.go:64] FLAG: --event-burst="100"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649757    2569 flags.go:64] FLAG: --event-qps="50"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649760    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649763    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649766    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649770    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649773    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649776    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649779    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649782    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649785    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649789    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649792    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649796    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649798    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 18:00:07.776751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649801    2569 flags.go:64] FLAG: --feature-gates=""
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649805    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649810    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649813    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649818    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649821    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649825    2569 flags.go:64] FLAG: --help="false"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649828    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-139-9.ec2.internal"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649831    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649834    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649837    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649840    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649844    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649847    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649850    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649853    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649855    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649859    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649862    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649865    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649868    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649871    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649874    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649877    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 18:00:07.778675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649880    2569 flags.go:64] FLAG: --lock-file=""
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649883    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649886    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649889    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649895    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649899    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649902    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649905    2569 flags.go:64] FLAG: --logging-format="text"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649908    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649911    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649916    2569 flags.go:64] FLAG: --manifest-url=""
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649919    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649924    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649928    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649932    2569 flags.go:64] FLAG: --max-pods="110"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649935    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649938    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649941    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649944    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649947    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649950    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649953    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649961    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649964    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649968    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 18:00:07.779738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649971    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649974    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649980    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649983    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649987    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649990    2569 flags.go:64] FLAG: --port="10250"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649993    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.649997    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01010ac81632f300b"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650000    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650003    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650006    2569 flags.go:64] FLAG: --register-node="true"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650009    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650013    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650017    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650020    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650023    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650027    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650032    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650035    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650037    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650043    2569 flags.go:64] FLAG: --runonce="false"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650046    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650049    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650052    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650055    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 18:00:07.780805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650058    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650061    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650064    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650068    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650071    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650075    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650078    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650081    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650084    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650087    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650090    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650095    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650098    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650101    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650106    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650109    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650112    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650114    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650117    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650121    2569 flags.go:64] FLAG: --v="2"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650126    2569 flags.go:64] FLAG: --version="false"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650131    2569 flags.go:64] FLAG: --vmodule=""
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650135    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.650139    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 18:00:07.781899 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650272    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650277    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650282    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650287    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650291    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650293    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650297    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650300    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650303    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650329    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650333    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650336    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650339    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650342    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650345    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650348    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650350    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650353    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650356    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:00:07.782756 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650358    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650361    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650363    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650366    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650368    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650371    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650374    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650376    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650379    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650382    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650385    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650389    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650392    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650396    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650399    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650402    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650406    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650408    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650411    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650413    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:00:07.783609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650416    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650419    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650421    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650424    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650427    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650430    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650432    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650435    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650438    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650440    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650443    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650445    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650448    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650451    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650453    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650456    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650458    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650461    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650464    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650466    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:00:07.784329 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650469    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650472    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650474    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650477    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650480    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650484    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650487    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650489    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650494    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650497    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650499    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650502    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650505    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650507    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650510    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650512    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650515    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650517    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650520    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650523    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:00:07.785113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650525    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650528    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650531    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650534    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650536    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650539    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650543    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650547    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650549    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650552    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650554    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650557    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650560    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650563    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650565    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650568    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650571    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650576    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650578    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:00:07.786225 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.650581    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.651355    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.659070    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.659096    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.659120    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.659126    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659209    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659215    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659218    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659221    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659225    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659228    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659231    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659233    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659236    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:00:07.787208 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659239    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659241    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659244    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659246    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659249    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659251    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659254    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659257    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659259    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659263    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659266    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659268    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659271    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659274    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659276    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659288    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659291    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659293    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659296    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:00:07.787762 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659299    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659305    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659326    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659329    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659332    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659334    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659337    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659340    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659343    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659346    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659349    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659351    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659358    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659362    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659366    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659368    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659371    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659374    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659377    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659380    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:00:07.788634 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659383    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659385    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659388    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659391    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659394    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659397    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659399    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659403    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659407    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659412    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659415    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659418    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659420    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659424    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659427    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659430    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659432    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659435    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659437    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:00:07.790609 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659440    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659445    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659448    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659451    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659454    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659462    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659465    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659469    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659472    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659475    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659478    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659481    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659484    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659486    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659489    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659492    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659494    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659497    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659499    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:00:07.791654 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659502    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659505    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659507    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659510    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659513    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659516    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659518    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659523    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659526    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659529    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659532    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659535    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659538    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.659543    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659684    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:00:07.793523 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659688    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659691    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659694    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659699    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659702    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659705    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659707    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659710    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659713    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659716    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659718    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659721    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659724    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659726    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659729    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659732    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659734    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659738    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659741    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:00:07.794583 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659744    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659748    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659750    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659754    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659756    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659759    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659766    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659769    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659771    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659774    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659777    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659779    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659782    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659785    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659787    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659790    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659794    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659797    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659800    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659803    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:00:07.796101 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659805    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659808    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659811    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659814    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659816    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659819    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659822    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659824    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659827    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659830    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659832    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659835    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659837    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659840    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659842    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659846    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659849    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659852    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659856    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659859    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:00:07.796787 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659862    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659864    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659867    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659869    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659872    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659875    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659877    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659880    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659883    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659886    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659890    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659893    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659897    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659899    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659902    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659905    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659908    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659910    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659913    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:00:07.797668 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659915    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659918    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659920    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659923    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659926    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659928    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659931    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659933    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659936    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659938    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659942    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659946    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659948    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659951    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659954    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659956    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659959    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659962    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659964    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:00:07.798795 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:07.659967    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:00:07.799594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.659972    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:00:07.799594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.660127    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 18:00:07.799594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.663116    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 18:00:07.799594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.664547    2569 server.go:1019] "Starting client certificate rotation"
Jul 10 18:00:07.799594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.664667    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 18:00:07.799594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.664704    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 18:00:07.799594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.667284    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 18:00:07.799594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.668879    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 18:00:07.799594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.680963    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 10 18:00:07.799594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.683303    2569 log.go:25] "Validated CRI v1 image API"
Jul 10 18:00:07.799594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.684902    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 18:00:07.799594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.690116    2569 fs.go:135] Filesystem UUIDs: map[5d98f900-52af-44db-9936-198980c763e9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 86095ea8-5154-44d4-9d46-e76d79d30faf:/dev/nvme0n1p4]
Jul 10 18:00:07.800802 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.690135    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 18:00:07.800802 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.702977    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.708801    2569 manager.go:216] Machine: {Timestamp:2026-07-10 18:00:07.706753891 +0000 UTC m=+0.385021461 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100216 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26c5158e312d00148e96cc4fdea937 SystemUUID:ec26c515-8e31-2d00-148e-96cc4fdea937 BootID:dc6e5201-8515-4774-8029-30ff3f30ea8c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:34:5c:44:e0:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:34:5c:44:e0:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:17:48:4b:f3:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.708933    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.709111    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.711433    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n8h4h"
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.712508    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.712552    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-9.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.713371    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.713383    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.713393    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.714057    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.715828    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.716734    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n8h4h"
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.719236    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.719399    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.719438    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.719449    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 18:00:07.801208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.719465    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.719474    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.719485    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.719860    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.719875    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.721976    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724292    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724343    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724507    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724520    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724526    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724533    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724541    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724547    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724893    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724899    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724906    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724912    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724931    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.724940    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.725525    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.725602    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.730293    2569 server.go:1268] "Started kubelet"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.734456    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.734508    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.734549    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.734914    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.736205    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.737075    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.737716    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.739389    2569 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-9.ec2.internal" not found
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.740195    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.740885    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:07.743833    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-9.ec2.internal\" not found"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:07.744340    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.744496    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.744525    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.744547    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.744721    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.744731    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.752546    2569 factory.go:55] Registering systemd factory
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.752568    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.752988    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.753000    2569 factory.go:153] Registering CRI-O factory
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.753017    2569 factory.go:223] Registration of the crio container factory successfully
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.753097    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.753325    2569 factory.go:103] Registering Raw factory
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.753378    2569 manager.go:1196] Started watching for new ooms in manager
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.754182    2569 manager.go:349] Starting recovery of all containers
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:07.757433    2569 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-9.ec2.internal\" not found" node="ip-10-0-139-9.ec2.internal"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.757502    2569 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-9.ec2.internal" not found
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.757934    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.794872    2569 manager.go:354] Recovery completed
Jul 10 18:00:07.801927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.799883    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.809424    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.809459    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.809470    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-9.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.832032    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.833048    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.833062    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.833088    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.834450    2569 policy_none.go:49] "None policy: Start"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.834470    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.834486    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.835072    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.835103    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.835117    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-9.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.835532    2569 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-9.ec2.internal" not found
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.835580    2569 policy_none.go:47] "Start"
Jul 10 18:00:07.879952 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:07.849764    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-9.ec2.internal\" not found"
Jul 10 18:00:07.950524 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.928112    2569 manager.go:337] "Starting Device Plugin manager"
Jul 10 18:00:07.950524 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:07.928300    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 18:00:07.950524 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.928330    2569 server.go:87] "Starting device plugin registration server"
Jul 10 18:00:07.950524 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.928580    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 18:00:07.950524 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.928590    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 18:00:07.950524 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.935351    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 18:00:07.950524 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.935475    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 18:00:07.950524 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.935485    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 18:00:07.950524 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:07.936006    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 18:00:07.950524 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:07.936058    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-9.ec2.internal\" not found"
Jul 10 18:00:07.950524 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:07.946972    2569 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2609 into the system container \"/system.slice\": <nil>"
Jul 10 18:00:08.058798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.006910    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 18:00:08.058798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.006978    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 18:00:08.058798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.007018    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 18:00:08.058798 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:08.007061    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 18:00:08.058798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.009589    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:00:08.058798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.029357    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:00:08.058798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.030451    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:00:08.058798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.030480    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:00:08.058798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.030489    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-9.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:00:08.058798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.030511    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.058798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.039612    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.058798 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:08.039641    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-9.ec2.internal\": node \"ip-10-0-139-9.ec2.internal\" not found"
Jul 10 18:00:08.127739 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.107672    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-9.ec2.internal"]
Jul 10 18:00:08.127739 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.109752    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.127739 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.111008    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.200047 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.154846    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7d8eb65068a8bb501871987dce52055-config\") pod \"kube-apiserver-proxy-ip-10-0-139-9.ec2.internal\" (UID: \"e7d8eb65068a8bb501871987dce52055\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.200047 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.154882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e5b5f6f4096b5c894a87a557b0f7ba2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal\" (UID: \"2e5b5f6f4096b5c894a87a557b0f7ba2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.200047 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.154902    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e5b5f6f4096b5c894a87a557b0f7ba2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal\" (UID: \"2e5b5f6f4096b5c894a87a557b0f7ba2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.289262 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.259146    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e5b5f6f4096b5c894a87a557b0f7ba2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal\" (UID: \"2e5b5f6f4096b5c894a87a557b0f7ba2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.289262 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.259246    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e5b5f6f4096b5c894a87a557b0f7ba2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal\" (UID: \"2e5b5f6f4096b5c894a87a557b0f7ba2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.289262 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.259258    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e5b5f6f4096b5c894a87a557b0f7ba2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal\" (UID: \"2e5b5f6f4096b5c894a87a557b0f7ba2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.289262 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.259282    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7d8eb65068a8bb501871987dce52055-config\") pod \"kube-apiserver-proxy-ip-10-0-139-9.ec2.internal\" (UID: \"e7d8eb65068a8bb501871987dce52055\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.289262 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.259334    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7d8eb65068a8bb501871987dce52055-config\") pod \"kube-apiserver-proxy-ip-10-0-139-9.ec2.internal\" (UID: \"e7d8eb65068a8bb501871987dce52055\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.289262 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.259361    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e5b5f6f4096b5c894a87a557b0f7ba2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal\" (UID: \"2e5b5f6f4096b5c894a87a557b0f7ba2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.289262 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.259406    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.289262 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.263840    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.289262 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.275107    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 18:00:08.289262 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.278003    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.369937 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.353088    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 18:00:08.369937 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.355725    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal"
Jul 10 18:00:08.663538 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.663501    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 18:00:08.663788 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.663760    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:00:08.663864 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.663760    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:00:08.663864 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.663759    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:00:08.720327 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.720270    2569 apiserver.go:52] "Watching apiserver"
Jul 10 18:00:08.721407 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.721349    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 17:55:07 +0000 UTC" deadline="2028-04-17 22:16:53.889223148 +0000 UTC"
Jul 10 18:00:08.721460 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.721408    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15532h16m45.16781759s"
Jul 10 18:00:08.727206 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.727182    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 18:00:08.729289 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.729256    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-lmwg6","openshift-network-operator/iptables-alerter-tz6c7","openshift-ovn-kubernetes/ovnkube-node-fqn7g","kube-system/global-pull-secret-syncer-chhnz","kube-system/konnectivity-agent-dpgcv","kube-system/kube-apiserver-proxy-ip-10-0-139-9.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6","openshift-cluster-node-tuning-operator/tuned-rzjl2","openshift-dns/node-resolver-hsvnp","openshift-multus/multus-4bqj6","openshift-network-diagnostics/network-check-target-b4zhd","openshift-image-registry/node-ca-qgmdb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal","openshift-multus/multus-additional-cni-plugins-vcdpx"]
Jul 10 18:00:08.730986 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.730959    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:08.731084 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:08.731057    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:08.732195 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.732165    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tz6c7"
Jul 10 18:00:08.733397 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.733370    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.734425 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.734397    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:00:08.734519 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.734487    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 18:00:08.734622 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.734604    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-52qbr\""
Jul 10 18:00:08.734679 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.734629    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 18:00:08.734679 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.734606    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:08.734757 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:08.734718    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:08.735292 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.735271    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 18:00:08.735739 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.735723    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 18:00:08.735848 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.735747    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 18:00:08.735848 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.735841    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jxlnc\""
Jul 10 18:00:08.736249 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.736231    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 18:00:08.736327 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.736234    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 18:00:08.736555 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.736543    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 18:00:08.736615 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.736574    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dpgcv"
Jul 10 18:00:08.737814 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.737798    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.738434 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.738418    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 18:00:08.738652 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.738631    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 18:00:08.738887 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.738874    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d4c4v\""
Jul 10 18:00:08.739047 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.739031    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.739919 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.739886    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 18:00:08.740012 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.739977    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 18:00:08.740012 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.740000    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sm85d\""
Jul 10 18:00:08.740246 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.740230    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 18:00:08.740328 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.740271    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hsvnp"
Jul 10 18:00:08.741037 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.741020    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:00:08.741097 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.741021    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 18:00:08.741768 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.741751    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.742382 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.742365    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 18:00:08.742442 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.742365    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6jspl\""
Jul 10 18:00:08.742442 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.742423    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 18:00:08.742628 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.742613    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7f87z\""
Jul 10 18:00:08.742994 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.742978    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:08.743078 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:08.743058    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:08.743804 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.743784    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 18:00:08.743960 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.743943    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 18:00:08.744035 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.743955    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n6xqx\""
Jul 10 18:00:08.744035 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.743990    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 18:00:08.744035 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.743994    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 18:00:08.744187 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.743995    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 18:00:08.744401 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.744387    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qgmdb"
Jul 10 18:00:08.747470 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.746948    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.747470 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.747161    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bmrl7\""
Jul 10 18:00:08.747470 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.747293    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 18:00:08.747717 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.747665    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 18:00:08.747717 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.747693    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 18:00:08.749759 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.749733    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 18:00:08.749895 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.749795    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dkx8d\""
Jul 10 18:00:08.749973 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.749959    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 18:00:08.756417 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.756397    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 18:00:08.762563 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762531    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f85edd65-07d9-4601-97be-59a36f93f0e1-agent-certs\") pod \"konnectivity-agent-dpgcv\" (UID: \"f85edd65-07d9-4601-97be-59a36f93f0e1\") " pod="kube-system/konnectivity-agent-dpgcv"
Jul 10 18:00:08.762680 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762570    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-systemd-units\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.762680 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762590    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-slash\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.762680 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762630    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:08.762680 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762652    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea71c047-efda-4a04-9ff0-9616073d30ab-tmp\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.762680 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762668    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-multus-conf-dir\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.762891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762684    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-run-netns\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.762891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762706    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e176d398-2a86-4a7e-97c0-d62f73823291-ovnkube-script-lib\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.762891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762730    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08677185-1b3a-4cb6-878a-8f87e68b6286-tmp-dir\") pod \"node-resolver-hsvnp\" (UID: \"08677185-1b3a-4cb6-878a-8f87e68b6286\") " pod="openshift-dns/node-resolver-hsvnp"
Jul 10 18:00:08.762891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762747    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b966395-a7e0-4d67-8430-8b3a5a22e127-host-slash\") pod \"iptables-alerter-tz6c7\" (UID: \"4b966395-a7e0-4d67-8430-8b3a5a22e127\") " pod="openshift-network-operator/iptables-alerter-tz6c7"
Jul 10 18:00:08.762891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762784    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-tuned\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.762891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762798    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-log-socket\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.762891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762819    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlwfj\" (UniqueName: \"kubernetes.io/projected/08677185-1b3a-4cb6-878a-8f87e68b6286-kube-api-access-qlwfj\") pod \"node-resolver-hsvnp\" (UID: \"08677185-1b3a-4cb6-878a-8f87e68b6286\") " pod="openshift-dns/node-resolver-hsvnp"
Jul 10 18:00:08.762891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762850    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-system-cni-dir\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.762891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762869    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08677185-1b3a-4cb6-878a-8f87e68b6286-hosts-file\") pod \"node-resolver-hsvnp\" (UID: \"08677185-1b3a-4cb6-878a-8f87e68b6286\") " pod="openshift-dns/node-resolver-hsvnp"
Jul 10 18:00:08.762891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762889    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9214d3e7-1ca6-470f-b8ce-c030fdbb4737-serviceca\") pod \"node-ca-qgmdb\" (UID: \"9214d3e7-1ca6-470f-b8ce-c030fdbb4737\") " pod="openshift-image-registry/node-ca-qgmdb"
Jul 10 18:00:08.763208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762923    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2e3e163-237c-469a-a80e-a349c39e483b-system-cni-dir\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.763208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762968    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2e3e163-237c-469a-a80e-a349c39e483b-cnibin\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.763208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.762996    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f85edd65-07d9-4601-97be-59a36f93f0e1-konnectivity-ca\") pod \"konnectivity-agent-dpgcv\" (UID: \"f85edd65-07d9-4601-97be-59a36f93f0e1\") " pod="kube-system/konnectivity-agent-dpgcv"
Jul 10 18:00:08.763208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763029    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-run-k8s-cni-cncf-io\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.763208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-run-multus-certs\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.763208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763065    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-node-log\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.763208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763090    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e176d398-2a86-4a7e-97c0-d62f73823291-env-overrides\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.763208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763108    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4ngv\" (UniqueName: \"kubernetes.io/projected/e176d398-2a86-4a7e-97c0-d62f73823291-kube-api-access-p4ngv\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.763208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763124    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-sys\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.763208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-multus-socket-dir-parent\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.763208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763163    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-run-ovn-kubernetes\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.763208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763188    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6d991cf-1886-472c-8bde-025d82091dfd-kubelet-config\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:08.763208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763203    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-sys-fs\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763218    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-cnibin\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763232    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-os-release\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763253    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-etc-kubernetes\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763273    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-run-systemd\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763287    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9214d3e7-1ca6-470f-b8ce-c030fdbb4737-host\") pod \"node-ca-qgmdb\" (UID: \"9214d3e7-1ca6-470f-b8ce-c030fdbb4737\") " pod="openshift-image-registry/node-ca-qgmdb"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763327    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b966395-a7e0-4d67-8430-8b3a5a22e127-iptables-alerter-script\") pod \"iptables-alerter-tz6c7\" (UID: \"4b966395-a7e0-4d67-8430-8b3a5a22e127\") " pod="openshift-network-operator/iptables-alerter-tz6c7"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763343    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-device-dir\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763368    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-etc-selinux\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763383    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e176d398-2a86-4a7e-97c0-d62f73823291-ovn-node-metrics-cert\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763397    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e176d398-2a86-4a7e-97c0-d62f73823291-ovnkube-config\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763412    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2e3e163-237c-469a-a80e-a349c39e483b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763426    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-sysctl-d\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763440    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-host\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763455    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2e3e163-237c-469a-a80e-a349c39e483b-cni-binary-copy\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763471    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clwt6\" (UniqueName: \"kubernetes.io/projected/c2e3e163-237c-469a-a80e-a349c39e483b-kube-api-access-clwt6\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.763638 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763490    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j796m\" (UniqueName: \"kubernetes.io/projected/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-kube-api-access-j796m\") pod \"network-metrics-daemon-lmwg6\" (UID: \"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed\") " pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763505    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6d991cf-1886-472c-8bde-025d82091dfd-dbus\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763519    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-kubernetes\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763535    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-lib-modules\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763557    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-var-lib-openvswitch\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763587    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763608    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-sysconfig\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763631    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-sysctl-conf\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763656    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-systemd\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763671    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-multus-cni-dir\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763688    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-var-lib-cni-multus\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763706    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-etc-openvswitch\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763720    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-run-ovn\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763733    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-cni-netd\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4tmk\" (UniqueName: \"kubernetes.io/projected/4b966395-a7e0-4d67-8430-8b3a5a22e127-kube-api-access-s4tmk\") pod \"iptables-alerter-tz6c7\" (UID: \"4b966395-a7e0-4d67-8430-8b3a5a22e127\") " pod="openshift-network-operator/iptables-alerter-tz6c7"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763773    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r62c\" (UniqueName: \"kubernetes.io/projected/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-kube-api-access-8r62c\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.764191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763786    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvzhs\" (UniqueName: \"kubernetes.io/projected/ea71c047-efda-4a04-9ff0-9616073d30ab-kube-api-access-jvzhs\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763799    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-run-netns\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763837    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-var-lib-kubelet\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763854    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9gbp\" (UniqueName: \"kubernetes.io/projected/9214d3e7-1ca6-470f-b8ce-c030fdbb4737-kube-api-access-l9gbp\") pod \"node-ca-qgmdb\" (UID: \"9214d3e7-1ca6-470f-b8ce-c030fdbb4737\") " pod="openshift-image-registry/node-ca-qgmdb"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763871    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c2e3e163-237c-469a-a80e-a349c39e483b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763887    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763930    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-var-lib-kubelet\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763963    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-cni-binary-copy\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763980    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-registration-dir\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.763996    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-modprobe-d\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.764009    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-var-lib-cni-bin\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.764022    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-hostroot\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.764036    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-run-openvswitch\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.764069    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6xvz\" (UniqueName: \"kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz\") pod \"network-check-target-b4zhd\" (UID: \"202e4b7c-3f4b-43dd-99c0-8e52a7672de7\") " pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.764090    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2e3e163-237c-469a-a80e-a349c39e483b-os-release\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.764106    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c2e3e163-237c-469a-a80e-a349c39e483b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.764651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.764147    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs\") pod \"network-metrics-daemon-lmwg6\" (UID: \"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed\") " pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:08.765119 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.764167    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-socket-dir\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.765119 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.764184    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-run\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.765119 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.764201    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-multus-daemon-config\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.765119 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.764217    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqpbl\" (UniqueName: \"kubernetes.io/projected/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-kube-api-access-qqpbl\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.765119 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.764231    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-kubelet\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.765119 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.764245    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-cni-bin\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.786189 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.786150    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lcbxv"
Jul 10 18:00:08.794755 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.794723    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lcbxv"
Jul 10 18:00:08.845194 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.845167    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 18:00:08.864915 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.864884    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6d991cf-1886-472c-8bde-025d82091dfd-kubelet-config\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:08.865080 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.864924    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-sys-fs\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.865080 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.864948    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-cnibin\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.865080 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.864970    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-os-release\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.865080 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.864993    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-etc-kubernetes\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.865080 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.864992    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6d991cf-1886-472c-8bde-025d82091dfd-kubelet-config\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:08.865080 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865013    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-run-systemd\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.865080 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865042    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-cnibin\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865088    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-sys-fs\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865106    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-os-release\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865090    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9214d3e7-1ca6-470f-b8ce-c030fdbb4737-host\") pod \"node-ca-qgmdb\" (UID: \"9214d3e7-1ca6-470f-b8ce-c030fdbb4737\") " pod="openshift-image-registry/node-ca-qgmdb"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865123    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9214d3e7-1ca6-470f-b8ce-c030fdbb4737-host\") pod \"node-ca-qgmdb\" (UID: \"9214d3e7-1ca6-470f-b8ce-c030fdbb4737\") " pod="openshift-image-registry/node-ca-qgmdb"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865144    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b966395-a7e0-4d67-8430-8b3a5a22e127-iptables-alerter-script\") pod \"iptables-alerter-tz6c7\" (UID: \"4b966395-a7e0-4d67-8430-8b3a5a22e127\") " pod="openshift-network-operator/iptables-alerter-tz6c7"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865149    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-etc-kubernetes\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865166    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-device-dir\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865183    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-etc-selinux\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865190    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-run-systemd\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865199    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e176d398-2a86-4a7e-97c0-d62f73823291-ovn-node-metrics-cert\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865215    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e176d398-2a86-4a7e-97c0-d62f73823291-ovnkube-config\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865232    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2e3e163-237c-469a-a80e-a349c39e483b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865252    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-sysctl-d\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865251    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-device-dir\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865267    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-host\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865302    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-host\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.865481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865327    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-etc-selinux\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865347    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2e3e163-237c-469a-a80e-a349c39e483b-cni-binary-copy\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865418    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clwt6\" (UniqueName: \"kubernetes.io/projected/c2e3e163-237c-469a-a80e-a349c39e483b-kube-api-access-clwt6\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865463    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j796m\" (UniqueName: \"kubernetes.io/projected/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-kube-api-access-j796m\") pod \"network-metrics-daemon-lmwg6\" (UID: \"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed\") " pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865457    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-sysctl-d\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865486    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6d991cf-1886-472c-8bde-025d82091dfd-dbus\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865508    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-kubernetes\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865532    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-lib-modules\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865571    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-var-lib-openvswitch\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865597    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865620    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-sysconfig\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865712    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-sysctl-conf\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865736    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-systemd\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865732    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865761    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-multus-cni-dir\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865795    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-lib-modules\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865817    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-var-lib-cni-multus\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.866284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865862    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-etc-openvswitch\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865888    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-run-ovn\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865913    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-cni-netd\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865948    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6d991cf-1886-472c-8bde-025d82091dfd-dbus\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865996    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4tmk\" (UniqueName: \"kubernetes.io/projected/4b966395-a7e0-4d67-8430-8b3a5a22e127-kube-api-access-s4tmk\") pod \"iptables-alerter-tz6c7\" (UID: \"4b966395-a7e0-4d67-8430-8b3a5a22e127\") " pod="openshift-network-operator/iptables-alerter-tz6c7"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866027    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2e3e163-237c-469a-a80e-a349c39e483b-cni-binary-copy\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866037    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r62c\" (UniqueName: \"kubernetes.io/projected/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-kube-api-access-8r62c\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866068    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvzhs\" (UniqueName: \"kubernetes.io/projected/ea71c047-efda-4a04-9ff0-9616073d30ab-kube-api-access-jvzhs\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866104    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-run-netns\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866114    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866131    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-var-lib-kubelet\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866141    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-multus-cni-dir\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.865863    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-kubernetes\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866162    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9gbp\" (UniqueName: \"kubernetes.io/projected/9214d3e7-1ca6-470f-b8ce-c030fdbb4737-kube-api-access-l9gbp\") pod \"node-ca-qgmdb\" (UID: \"9214d3e7-1ca6-470f-b8ce-c030fdbb4737\") " pod="openshift-image-registry/node-ca-qgmdb"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866202    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-run-ovn\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866206    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c2e3e163-237c-469a-a80e-a349c39e483b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866219    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-etc-openvswitch\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.868466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866235    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866261    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-var-lib-kubelet\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866287    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-cni-binary-copy\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866351    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-registration-dir\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866373    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-modprobe-d\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866397    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-var-lib-cni-bin\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866423    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-hostroot\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866449    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-run-openvswitch\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866476    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b966395-a7e0-4d67-8430-8b3a5a22e127-iptables-alerter-script\") pod \"iptables-alerter-tz6c7\" (UID: \"4b966395-a7e0-4d67-8430-8b3a5a22e127\") " pod="openshift-network-operator/iptables-alerter-tz6c7"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866483    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-sysctl-conf\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866484    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-systemd\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866161    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-var-lib-cni-multus\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866105    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-cni-netd\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866478    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xvz\" (UniqueName: \"kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz\") pod \"network-check-target-b4zhd\" (UID: \"202e4b7c-3f4b-43dd-99c0-8e52a7672de7\") " pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866553    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-run-openvswitch\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866558    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2e3e163-237c-469a-a80e-a349c39e483b-os-release\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866563    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-run-netns\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.869205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866136    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-var-lib-openvswitch\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866632    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-var-lib-kubelet\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866658    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-modprobe-d\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866671    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-sysconfig\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866693    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-var-lib-cni-bin\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866739    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866785    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-registration-dir\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866799    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-hostroot\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866826    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-var-lib-kubelet\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866868    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e176d398-2a86-4a7e-97c0-d62f73823291-ovnkube-config\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866894    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2e3e163-237c-469a-a80e-a349c39e483b-os-release\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.866587    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c2e3e163-237c-469a-a80e-a349c39e483b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867074    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs\") pod \"network-metrics-daemon-lmwg6\" (UID: \"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed\") " pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867099    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-socket-dir\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867123    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-run\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867148    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-multus-daemon-config\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867172    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqpbl\" (UniqueName: \"kubernetes.io/projected/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-kube-api-access-qqpbl\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.869981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867197    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-kubelet\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867223    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-cni-bin\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867240    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-cni-binary-copy\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867248    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f85edd65-07d9-4601-97be-59a36f93f0e1-agent-certs\") pod \"konnectivity-agent-dpgcv\" (UID: \"f85edd65-07d9-4601-97be-59a36f93f0e1\") " pod="kube-system/konnectivity-agent-dpgcv"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867275    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-run\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867213    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c2e3e163-237c-469a-a80e-a349c39e483b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867273    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-systemd-units\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867295    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-socket-dir\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867342    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-cni-bin\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867350    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-slash\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867386    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-slash\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867402    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867435    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea71c047-efda-4a04-9ff0-9616073d30ab-tmp\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867457    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-multus-conf-dir\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867478    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-run-netns\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867501    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e176d398-2a86-4a7e-97c0-d62f73823291-ovnkube-script-lib\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867527    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08677185-1b3a-4cb6-878a-8f87e68b6286-tmp-dir\") pod \"node-resolver-hsvnp\" (UID: \"08677185-1b3a-4cb6-878a-8f87e68b6286\") " pod="openshift-dns/node-resolver-hsvnp"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867530    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-kubelet\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.870819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867566    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c2e3e163-237c-469a-a80e-a349c39e483b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867579    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b966395-a7e0-4d67-8430-8b3a5a22e127-host-slash\") pod \"iptables-alerter-tz6c7\" (UID: \"4b966395-a7e0-4d67-8430-8b3a5a22e127\") " pod="openshift-network-operator/iptables-alerter-tz6c7"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867619    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b966395-a7e0-4d67-8430-8b3a5a22e127-host-slash\") pod \"iptables-alerter-tz6c7\" (UID: \"4b966395-a7e0-4d67-8430-8b3a5a22e127\") " pod="openshift-network-operator/iptables-alerter-tz6c7"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867655    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-tuned\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867689    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-log-socket\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:08.867700    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867719    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlwfj\" (UniqueName: \"kubernetes.io/projected/08677185-1b3a-4cb6-878a-8f87e68b6286-kube-api-access-qlwfj\") pod \"node-resolver-hsvnp\" (UID: \"08677185-1b3a-4cb6-878a-8f87e68b6286\") " pod="openshift-dns/node-resolver-hsvnp"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867735    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-multus-daemon-config\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867745    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-system-cni-dir\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:08.867771    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs podName:2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed nodeName:}" failed. No retries permitted until 2026-07-10 18:00:09.367750658 +0000 UTC m=+2.046018216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs") pod "network-metrics-daemon-lmwg6" (UID: "2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867789    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-system-cni-dir\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867799    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-systemd-units\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867808    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08677185-1b3a-4cb6-878a-8f87e68b6286-tmp-dir\") pod \"node-resolver-hsvnp\" (UID: \"08677185-1b3a-4cb6-878a-8f87e68b6286\") " pod="openshift-dns/node-resolver-hsvnp"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867864    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08677185-1b3a-4cb6-878a-8f87e68b6286-hosts-file\") pod \"node-resolver-hsvnp\" (UID: \"08677185-1b3a-4cb6-878a-8f87e68b6286\") " pod="openshift-dns/node-resolver-hsvnp"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867890    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9214d3e7-1ca6-470f-b8ce-c030fdbb4737-serviceca\") pod \"node-ca-qgmdb\" (UID: \"9214d3e7-1ca6-470f-b8ce-c030fdbb4737\") " pod="openshift-image-registry/node-ca-qgmdb"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867879    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2e3e163-237c-469a-a80e-a349c39e483b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:08.867911    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867915    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2e3e163-237c-469a-a80e-a349c39e483b-system-cni-dir\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.871675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867943    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2e3e163-237c-469a-a80e-a349c39e483b-cnibin\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867950    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-log-socket\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:08.867969    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret podName:b6d991cf-1886-472c-8bde-025d82091dfd nodeName:}" failed. No retries permitted until 2026-07-10 18:00:09.367952864 +0000 UTC m=+2.046220451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret") pod "global-pull-secret-syncer-chhnz" (UID: "b6d991cf-1886-472c-8bde-025d82091dfd") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.867989    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f85edd65-07d9-4601-97be-59a36f93f0e1-konnectivity-ca\") pod \"konnectivity-agent-dpgcv\" (UID: \"f85edd65-07d9-4601-97be-59a36f93f0e1\") " pod="kube-system/konnectivity-agent-dpgcv"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.868015    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-run-k8s-cni-cncf-io\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.868041    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-run-multus-certs\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.868084    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-node-log\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.868084    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2e3e163-237c-469a-a80e-a349c39e483b-cnibin\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.868514    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2e3e163-237c-469a-a80e-a349c39e483b-system-cni-dir\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.868910    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-run-k8s-cni-cncf-io\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.869281    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-run-netns\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.869495    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f85edd65-07d9-4601-97be-59a36f93f0e1-konnectivity-ca\") pod \"konnectivity-agent-dpgcv\" (UID: \"f85edd65-07d9-4601-97be-59a36f93f0e1\") " pod="kube-system/konnectivity-agent-dpgcv"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.868017    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08677185-1b3a-4cb6-878a-8f87e68b6286-hosts-file\") pod \"node-resolver-hsvnp\" (UID: \"08677185-1b3a-4cb6-878a-8f87e68b6286\") " pod="openshift-dns/node-resolver-hsvnp"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.869758    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-multus-conf-dir\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870002    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e176d398-2a86-4a7e-97c0-d62f73823291-ovn-node-metrics-cert\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870178    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e176d398-2a86-4a7e-97c0-d62f73823291-env-overrides\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870213    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4ngv\" (UniqueName: \"kubernetes.io/projected/e176d398-2a86-4a7e-97c0-d62f73823291-kube-api-access-p4ngv\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.872591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870223    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-host-run-multus-certs\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.873417 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870245    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-sys\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.873417 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870269    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e176d398-2a86-4a7e-97c0-d62f73823291-ovnkube-script-lib\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.873417 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870277    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-multus-socket-dir-parent\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.873417 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-run-ovn-kubernetes\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.873417 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870427    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9214d3e7-1ca6-470f-b8ce-c030fdbb4737-serviceca\") pod \"node-ca-qgmdb\" (UID: \"9214d3e7-1ca6-470f-b8ce-c030fdbb4737\") " pod="openshift-image-registry/node-ca-qgmdb"
Jul 10 18:00:08.873417 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870465    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea71c047-efda-4a04-9ff0-9616073d30ab-sys\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.873417 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870530    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-host-run-ovn-kubernetes\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.873417 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870530    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-multus-socket-dir-parent\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.873417 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870785    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e176d398-2a86-4a7e-97c0-d62f73823291-env-overrides\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.873417 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.870931    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea71c047-efda-4a04-9ff0-9616073d30ab-etc-tuned\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.873417 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.871298    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e176d398-2a86-4a7e-97c0-d62f73823291-node-log\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.875395 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.875365    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j796m\" (UniqueName: \"kubernetes.io/projected/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-kube-api-access-j796m\") pod \"network-metrics-daemon-lmwg6\" (UID: \"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed\") " pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:08.876280 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.875964    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f85edd65-07d9-4601-97be-59a36f93f0e1-agent-certs\") pod \"konnectivity-agent-dpgcv\" (UID: \"f85edd65-07d9-4601-97be-59a36f93f0e1\") " pod="kube-system/konnectivity-agent-dpgcv"
Jul 10 18:00:08.876280 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:08.876246    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:00:08.876280 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:08.876269    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:00:08.876280 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:08.876283    2569 projected.go:196] Error preparing data for projected volume kube-api-access-h6xvz for pod openshift-network-diagnostics/network-check-target-b4zhd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:08.877288 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.876515    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clwt6\" (UniqueName: \"kubernetes.io/projected/c2e3e163-237c-469a-a80e-a349c39e483b-kube-api-access-clwt6\") pod \"multus-additional-cni-plugins-vcdpx\" (UID: \"c2e3e163-237c-469a-a80e-a349c39e483b\") " pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.877288 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:08.876659    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz podName:202e4b7c-3f4b-43dd-99c0-8e52a7672de7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:09.376594456 +0000 UTC m=+2.054862026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xvz" (UniqueName: "kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz") pod "network-check-target-b4zhd" (UID: "202e4b7c-3f4b-43dd-99c0-8e52a7672de7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:08.877288 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.876860    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9gbp\" (UniqueName: \"kubernetes.io/projected/9214d3e7-1ca6-470f-b8ce-c030fdbb4737-kube-api-access-l9gbp\") pod \"node-ca-qgmdb\" (UID: \"9214d3e7-1ca6-470f-b8ce-c030fdbb4737\") " pod="openshift-image-registry/node-ca-qgmdb"
Jul 10 18:00:08.877756 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.877702    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4tmk\" (UniqueName: \"kubernetes.io/projected/4b966395-a7e0-4d67-8430-8b3a5a22e127-kube-api-access-s4tmk\") pod \"iptables-alerter-tz6c7\" (UID: \"4b966395-a7e0-4d67-8430-8b3a5a22e127\") " pod="openshift-network-operator/iptables-alerter-tz6c7"
Jul 10 18:00:08.877876 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.877827    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvzhs\" (UniqueName: \"kubernetes.io/projected/ea71c047-efda-4a04-9ff0-9616073d30ab-kube-api-access-jvzhs\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.878033 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.878006    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea71c047-efda-4a04-9ff0-9616073d30ab-tmp\") pod \"tuned-rzjl2\" (UID: \"ea71c047-efda-4a04-9ff0-9616073d30ab\") " pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:08.879135 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.879103    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlwfj\" (UniqueName: \"kubernetes.io/projected/08677185-1b3a-4cb6-878a-8f87e68b6286-kube-api-access-qlwfj\") pod \"node-resolver-hsvnp\" (UID: \"08677185-1b3a-4cb6-878a-8f87e68b6286\") " pod="openshift-dns/node-resolver-hsvnp"
Jul 10 18:00:08.879397 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.879380    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4ngv\" (UniqueName: \"kubernetes.io/projected/e176d398-2a86-4a7e-97c0-d62f73823291-kube-api-access-p4ngv\") pod \"ovnkube-node-fqn7g\" (UID: \"e176d398-2a86-4a7e-97c0-d62f73823291\") " pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:08.879497 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.879463    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqpbl\" (UniqueName: \"kubernetes.io/projected/d5ff0f9f-a7ad-45a7-a68e-9428230bfe27-kube-api-access-qqpbl\") pod \"multus-4bqj6\" (UID: \"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27\") " pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.879913 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.879892    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r62c\" (UniqueName: \"kubernetes.io/projected/1d530b02-b61c-4e4d-8b5e-0bd49685a9eb-kube-api-access-8r62c\") pod \"aws-ebs-csi-driver-node-zh2m6\" (UID: \"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:08.886423 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.886395    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4bqj6"
Jul 10 18:00:08.914217 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.914139    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qgmdb"
Jul 10 18:00:08.918705 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.918677    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vcdpx"
Jul 10 18:00:08.921087 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:08.921051    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d8eb65068a8bb501871987dce52055.slice/crio-45e9031b40d0bad43c32826658fdfb02e0cacd4762e7c92d5a760651fd2dd4fd WatchSource:0}: Error finding container 45e9031b40d0bad43c32826658fdfb02e0cacd4762e7c92d5a760651fd2dd4fd: Status 404 returned error can't find the container with id 45e9031b40d0bad43c32826658fdfb02e0cacd4762e7c92d5a760651fd2dd4fd
Jul 10 18:00:08.921888 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:08.921861    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5ff0f9f_a7ad_45a7_a68e_9428230bfe27.slice/crio-5c60d81cb01ee4d0defa6dc6ee1fa8f31092806d266e82977b81258594272b26 WatchSource:0}: Error finding container 5c60d81cb01ee4d0defa6dc6ee1fa8f31092806d266e82977b81258594272b26: Status 404 returned error can't find the container with id 5c60d81cb01ee4d0defa6dc6ee1fa8f31092806d266e82977b81258594272b26
Jul 10 18:00:08.926556 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:08.926533    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:00:08.926939 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:08.926907    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9214d3e7_1ca6_470f_b8ce_c030fdbb4737.slice/crio-7ef55ed1d1ec306e6bea017b11708e9369d114d5b51417ec0c57c2402d45bf59 WatchSource:0}: Error finding container 7ef55ed1d1ec306e6bea017b11708e9369d114d5b51417ec0c57c2402d45bf59: Status 404 returned error can't find the container with id 7ef55ed1d1ec306e6bea017b11708e9369d114d5b51417ec0c57c2402d45bf59
Jul 10 18:00:08.927865 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:08.927840    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e3e163_237c_469a_a80e_a349c39e483b.slice/crio-0a051e1c9bd631f7e1d84e9552e60201df4a016c93aa66def5232571f9748d2f WatchSource:0}: Error finding container 0a051e1c9bd631f7e1d84e9552e60201df4a016c93aa66def5232571f9748d2f: Status 404 returned error can't find the container with id 0a051e1c9bd631f7e1d84e9552e60201df4a016c93aa66def5232571f9748d2f
Jul 10 18:00:09.010957 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.010907    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-9.ec2.internal" event={"ID":"e7d8eb65068a8bb501871987dce52055","Type":"ContainerStarted","Data":"45e9031b40d0bad43c32826658fdfb02e0cacd4762e7c92d5a760651fd2dd4fd"}
Jul 10 18:00:09.012057 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.012027    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcdpx" event={"ID":"c2e3e163-237c-469a-a80e-a349c39e483b","Type":"ContainerStarted","Data":"0a051e1c9bd631f7e1d84e9552e60201df4a016c93aa66def5232571f9748d2f"}
Jul 10 18:00:09.013054 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.013029    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qgmdb" event={"ID":"9214d3e7-1ca6-470f-b8ce-c030fdbb4737","Type":"ContainerStarted","Data":"7ef55ed1d1ec306e6bea017b11708e9369d114d5b51417ec0c57c2402d45bf59"}
Jul 10 18:00:09.014158 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.014137    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4bqj6" event={"ID":"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27","Type":"ContainerStarted","Data":"5c60d81cb01ee4d0defa6dc6ee1fa8f31092806d266e82977b81258594272b26"}
Jul 10 18:00:09.071552 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.071515    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tz6c7"
Jul 10 18:00:09.073730 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.073705    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:09.082491 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:09.082457    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b966395_a7e0_4d67_8430_8b3a5a22e127.slice/crio-2316b23937b372fe24bcfd70c83e33db07fa9c0b734aa44d6a88d2e4382125a2 WatchSource:0}: Error finding container 2316b23937b372fe24bcfd70c83e33db07fa9c0b734aa44d6a88d2e4382125a2: Status 404 returned error can't find the container with id 2316b23937b372fe24bcfd70c83e33db07fa9c0b734aa44d6a88d2e4382125a2
Jul 10 18:00:09.083127 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:09.083097    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode176d398_2a86_4a7e_97c0_d62f73823291.slice/crio-38a66330e58c7f0ec42972fa9ed6270290b61e40a8aaed8b054c3574e5971011 WatchSource:0}: Error finding container 38a66330e58c7f0ec42972fa9ed6270290b61e40a8aaed8b054c3574e5971011: Status 404 returned error can't find the container with id 38a66330e58c7f0ec42972fa9ed6270290b61e40a8aaed8b054c3574e5971011
Jul 10 18:00:09.086261 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.086243    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dpgcv"
Jul 10 18:00:09.094398 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:09.094364    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85edd65_07d9_4601_97be_59a36f93f0e1.slice/crio-8a263beb0c63e41d6093a24e188d478a535fbcee21e0be097e024f3ea73174ac WatchSource:0}: Error finding container 8a263beb0c63e41d6093a24e188d478a535fbcee21e0be097e024f3ea73174ac: Status 404 returned error can't find the container with id 8a263beb0c63e41d6093a24e188d478a535fbcee21e0be097e024f3ea73174ac
Jul 10 18:00:09.123007 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.122962    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6"
Jul 10 18:00:09.131585 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:09.131548    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d530b02_b61c_4e4d_8b5e_0bd49685a9eb.slice/crio-895626de70a58d58abd1d64e729677b16cff92b16bc7ea7409a7b6a8664401cd WatchSource:0}: Error finding container 895626de70a58d58abd1d64e729677b16cff92b16bc7ea7409a7b6a8664401cd: Status 404 returned error can't find the container with id 895626de70a58d58abd1d64e729677b16cff92b16bc7ea7409a7b6a8664401cd
Jul 10 18:00:09.141262 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.141229    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rzjl2"
Jul 10 18:00:09.150522 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:09.150492    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea71c047_efda_4a04_9ff0_9616073d30ab.slice/crio-00616ed511825d4815f8573c26f462a0d9e6d727de02caac115af4e57859178e WatchSource:0}: Error finding container 00616ed511825d4815f8573c26f462a0d9e6d727de02caac115af4e57859178e: Status 404 returned error can't find the container with id 00616ed511825d4815f8573c26f462a0d9e6d727de02caac115af4e57859178e
Jul 10 18:00:09.157984 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.157958    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hsvnp"
Jul 10 18:00:09.165942 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:09.165883    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08677185_1b3a_4cb6_878a_8f87e68b6286.slice/crio-d75b5faeb6ad6cccaf63107266c4037095ccde088b82f0b0c918165c268101e9 WatchSource:0}: Error finding container d75b5faeb6ad6cccaf63107266c4037095ccde088b82f0b0c918165c268101e9: Status 404 returned error can't find the container with id d75b5faeb6ad6cccaf63107266c4037095ccde088b82f0b0c918165c268101e9
Jul 10 18:00:09.375559 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.375519    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs\") pod \"network-metrics-daemon-lmwg6\" (UID: \"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed\") " pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:09.375559 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.375559    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:09.375762 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:09.375677    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:09.375762 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:09.375686    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:09.375762 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:09.375729    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret podName:b6d991cf-1886-472c-8bde-025d82091dfd nodeName:}" failed. No retries permitted until 2026-07-10 18:00:10.375715577 +0000 UTC m=+3.053983133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret") pod "global-pull-secret-syncer-chhnz" (UID: "b6d991cf-1886-472c-8bde-025d82091dfd") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:09.375762 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:09.375742    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs podName:2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed nodeName:}" failed. No retries permitted until 2026-07-10 18:00:10.375735985 +0000 UTC m=+3.054003541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs") pod "network-metrics-daemon-lmwg6" (UID: "2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:09.455164 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:09.455134    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5b5f6f4096b5c894a87a557b0f7ba2.slice/crio-760bb5f96dcc765a136d773a61d576af7bb988ef6a3e582d60571efd477c5745 WatchSource:0}: Error finding container 760bb5f96dcc765a136d773a61d576af7bb988ef6a3e582d60571efd477c5745: Status 404 returned error can't find the container with id 760bb5f96dcc765a136d773a61d576af7bb988ef6a3e582d60571efd477c5745
Jul 10 18:00:09.476384 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.476255    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xvz\" (UniqueName: \"kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz\") pod \"network-check-target-b4zhd\" (UID: \"202e4b7c-3f4b-43dd-99c0-8e52a7672de7\") " pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:09.476586 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:09.476441    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:00:09.476586 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:09.476471    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:00:09.476586 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:09.476484    2569 projected.go:196] Error preparing data for projected volume kube-api-access-h6xvz for pod openshift-network-diagnostics/network-check-target-b4zhd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:09.476586 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:09.476560    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz podName:202e4b7c-3f4b-43dd-99c0-8e52a7672de7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:10.476531469 +0000 UTC m=+3.154799041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xvz" (UniqueName: "kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz") pod "network-check-target-b4zhd" (UID: "202e4b7c-3f4b-43dd-99c0-8e52a7672de7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:09.655187 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.654897    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:00:09.735280 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.735194    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:00:09.798300 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.798229    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 17:55:08 +0000 UTC" deadline="2027-12-15 17:03:56.071839389 +0000 UTC"
Jul 10 18:00:09.798300 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:09.798297    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12551h3m46.273547502s"
Jul 10 18:00:10.010410 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.009452    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:10.010410 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:10.009685    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:10.010410 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.010141    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:10.010410 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:10.010243    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:10.010966 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.010825    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:10.010966 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:10.010922    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:10.033695 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.033652    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal" event={"ID":"2e5b5f6f4096b5c894a87a557b0f7ba2","Type":"ContainerStarted","Data":"760bb5f96dcc765a136d773a61d576af7bb988ef6a3e582d60571efd477c5745"}
Jul 10 18:00:10.052725 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.052495    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hsvnp" event={"ID":"08677185-1b3a-4cb6-878a-8f87e68b6286","Type":"ContainerStarted","Data":"d75b5faeb6ad6cccaf63107266c4037095ccde088b82f0b0c918165c268101e9"}
Jul 10 18:00:10.067701 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.067613    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rzjl2" event={"ID":"ea71c047-efda-4a04-9ff0-9616073d30ab","Type":"ContainerStarted","Data":"00616ed511825d4815f8573c26f462a0d9e6d727de02caac115af4e57859178e"}
Jul 10 18:00:10.080728 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.080684    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dpgcv" event={"ID":"f85edd65-07d9-4601-97be-59a36f93f0e1","Type":"ContainerStarted","Data":"8a263beb0c63e41d6093a24e188d478a535fbcee21e0be097e024f3ea73174ac"}
Jul 10 18:00:10.099201 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.099155    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6" event={"ID":"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb","Type":"ContainerStarted","Data":"895626de70a58d58abd1d64e729677b16cff92b16bc7ea7409a7b6a8664401cd"}
Jul 10 18:00:10.112199 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.112154    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g" event={"ID":"e176d398-2a86-4a7e-97c0-d62f73823291","Type":"ContainerStarted","Data":"38a66330e58c7f0ec42972fa9ed6270290b61e40a8aaed8b054c3574e5971011"}
Jul 10 18:00:10.119853 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.119813    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tz6c7" event={"ID":"4b966395-a7e0-4d67-8430-8b3a5a22e127","Type":"ContainerStarted","Data":"2316b23937b372fe24bcfd70c83e33db07fa9c0b734aa44d6a88d2e4382125a2"}
Jul 10 18:00:10.206257 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.206219    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:00:10.382726 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.382636    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs\") pod \"network-metrics-daemon-lmwg6\" (UID: \"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed\") " pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:10.382726 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.382693    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:10.382960 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:10.382845    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:10.382960 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:10.382909    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret podName:b6d991cf-1886-472c-8bde-025d82091dfd nodeName:}" failed. No retries permitted until 2026-07-10 18:00:12.382888658 +0000 UTC m=+5.061156218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret") pod "global-pull-secret-syncer-chhnz" (UID: "b6d991cf-1886-472c-8bde-025d82091dfd") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:10.383361 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:10.383339    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:10.383451 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:10.383403    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs podName:2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed nodeName:}" failed. No retries permitted until 2026-07-10 18:00:12.383383819 +0000 UTC m=+5.061651377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs") pod "network-metrics-daemon-lmwg6" (UID: "2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:10.483276 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.483230    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xvz\" (UniqueName: \"kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz\") pod \"network-check-target-b4zhd\" (UID: \"202e4b7c-3f4b-43dd-99c0-8e52a7672de7\") " pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:10.483509 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:10.483489    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:00:10.483581 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:10.483517    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:00:10.483581 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:10.483531    2569 projected.go:196] Error preparing data for projected volume kube-api-access-h6xvz for pod openshift-network-diagnostics/network-check-target-b4zhd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:10.483701 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:10.483588    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz podName:202e4b7c-3f4b-43dd-99c0-8e52a7672de7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:12.483571341 +0000 UTC m=+5.161838902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xvz" (UniqueName: "kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz") pod "network-check-target-b4zhd" (UID: "202e4b7c-3f4b-43dd-99c0-8e52a7672de7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:10.799170 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.799129    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 17:55:08 +0000 UTC" deadline="2028-04-08 01:40:09.51231066 +0000 UTC"
Jul 10 18:00:10.799170 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:10.799168    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15295h39m58.713146717s"
Jul 10 18:00:12.008942 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:12.008418    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:12.008942 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:12.008555    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:12.008942 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:12.008418    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:12.008942 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:12.008676    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:12.008942 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:12.008720    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:12.008942 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:12.008780    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:12.400594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:12.400501    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs\") pod \"network-metrics-daemon-lmwg6\" (UID: \"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed\") " pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:12.400594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:12.400564    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:12.400827 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:12.400730    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:12.400827 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:12.400794    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret podName:b6d991cf-1886-472c-8bde-025d82091dfd nodeName:}" failed. No retries permitted until 2026-07-10 18:00:16.400775975 +0000 UTC m=+9.079043534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret") pod "global-pull-secret-syncer-chhnz" (UID: "b6d991cf-1886-472c-8bde-025d82091dfd") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:12.401209 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:12.401187    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:12.401290 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:12.401246    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs podName:2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed nodeName:}" failed. No retries permitted until 2026-07-10 18:00:16.401229207 +0000 UTC m=+9.079496766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs") pod "network-metrics-daemon-lmwg6" (UID: "2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:12.501922 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:12.501879    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xvz\" (UniqueName: \"kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz\") pod \"network-check-target-b4zhd\" (UID: \"202e4b7c-3f4b-43dd-99c0-8e52a7672de7\") " pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:12.502098 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:12.502085    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:00:12.502166 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:12.502110    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:00:12.502166 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:12.502125    2569 projected.go:196] Error preparing data for projected volume kube-api-access-h6xvz for pod openshift-network-diagnostics/network-check-target-b4zhd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:12.502270 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:12.502185    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz podName:202e4b7c-3f4b-43dd-99c0-8e52a7672de7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:16.502164679 +0000 UTC m=+9.180432250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xvz" (UniqueName: "kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz") pod "network-check-target-b4zhd" (UID: "202e4b7c-3f4b-43dd-99c0-8e52a7672de7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:14.008542 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:14.008431    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:14.008542 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:14.008431    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:14.009137 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:14.008573    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:14.009137 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:14.008660    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:14.009137 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:14.008704    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:14.009137 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:14.008767    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:16.007645 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:16.007607    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:16.007645 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:16.007627    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:16.008158 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:16.007607    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:16.008158 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:16.007744    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:16.008158 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:16.007834    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:16.008158 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:16.007924    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:16.439459 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:16.439361    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs\") pod \"network-metrics-daemon-lmwg6\" (UID: \"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed\") " pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:16.439459 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:16.439416    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:16.439698 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:16.439554    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:16.439698 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:16.439619    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret podName:b6d991cf-1886-472c-8bde-025d82091dfd nodeName:}" failed. No retries permitted until 2026-07-10 18:00:24.439599695 +0000 UTC m=+17.117867255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret") pod "global-pull-secret-syncer-chhnz" (UID: "b6d991cf-1886-472c-8bde-025d82091dfd") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:16.440157 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:16.440044    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:16.440157 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:16.440104    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs podName:2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed nodeName:}" failed. No retries permitted until 2026-07-10 18:00:24.440085528 +0000 UTC m=+17.118353096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs") pod "network-metrics-daemon-lmwg6" (UID: "2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:16.540888 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:16.540707    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xvz\" (UniqueName: \"kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz\") pod \"network-check-target-b4zhd\" (UID: \"202e4b7c-3f4b-43dd-99c0-8e52a7672de7\") " pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:16.540888 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:16.540870    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:00:16.540888 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:16.540896    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:00:16.541164 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:16.540910    2569 projected.go:196] Error preparing data for projected volume kube-api-access-h6xvz for pod openshift-network-diagnostics/network-check-target-b4zhd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:16.541164 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:16.540980    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz podName:202e4b7c-3f4b-43dd-99c0-8e52a7672de7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:24.540959328 +0000 UTC m=+17.219226887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xvz" (UniqueName: "kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz") pod "network-check-target-b4zhd" (UID: "202e4b7c-3f4b-43dd-99c0-8e52a7672de7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:18.008413 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:18.008352    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:18.008413 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:18.008380    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:18.008927 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:18.008480    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:18.008927 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:18.008546    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:18.008927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:18.008598    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:18.008927 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:18.008679    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:20.008323 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:20.008267    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:20.008323 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:20.008289    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:20.008816 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:20.008267    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:20.008816 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:20.008421    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:20.008816 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:20.008505    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:20.008816 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:20.008607    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:22.007329 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:22.007275    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:22.007803 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:22.007417    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:22.007803 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:22.007415    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:22.007803 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:22.007519    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:22.007803 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:22.007571    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:22.007803 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:22.007664    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:24.008137 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:24.008099    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:24.008635 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:24.008099    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:24.008635 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:24.008249    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:24.008635 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:24.008099    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:24.008635 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:24.008338    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:24.008635 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:24.008379    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:24.502672 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:24.502632    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs\") pod \"network-metrics-daemon-lmwg6\" (UID: \"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed\") " pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:24.502901 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:24.502685    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:24.502901 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:24.502791    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:24.502901 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:24.502862    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret podName:b6d991cf-1886-472c-8bde-025d82091dfd nodeName:}" failed. No retries permitted until 2026-07-10 18:00:40.502844223 +0000 UTC m=+33.181111798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret") pod "global-pull-secret-syncer-chhnz" (UID: "b6d991cf-1886-472c-8bde-025d82091dfd") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:24.502901 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:24.502793    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:24.503127 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:24.502951    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs podName:2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed nodeName:}" failed. No retries permitted until 2026-07-10 18:00:40.502924727 +0000 UTC m=+33.181192287 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs") pod "network-metrics-daemon-lmwg6" (UID: "2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:24.603716 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:24.603678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xvz\" (UniqueName: \"kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz\") pod \"network-check-target-b4zhd\" (UID: \"202e4b7c-3f4b-43dd-99c0-8e52a7672de7\") " pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:24.603934 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:24.603879    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:00:24.603934 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:24.603904    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:00:24.603934 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:24.603914    2569 projected.go:196] Error preparing data for projected volume kube-api-access-h6xvz for pod openshift-network-diagnostics/network-check-target-b4zhd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:24.604095 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:24.603979    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz podName:202e4b7c-3f4b-43dd-99c0-8e52a7672de7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:40.603964675 +0000 UTC m=+33.282232230 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xvz" (UniqueName: "kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz") pod "network-check-target-b4zhd" (UID: "202e4b7c-3f4b-43dd-99c0-8e52a7672de7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:26.010713 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:26.010496    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:26.011173 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:26.010496    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:26.011173 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:26.010802    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:26.011173 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:26.010592    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:26.011173 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:26.010914    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:26.011173 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:26.011030    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:28.008221 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:28.008186    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:28.008681 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:28.008279    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:28.008681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:28.008375    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:28.008681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:28.008517    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:28.008681 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:28.008519    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:28.008681 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:28.008618    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:30.007433 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.007359    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:30.008035 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:30.007498    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:30.008035 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.007516    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:30.008035 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.007609    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:30.008035 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:30.007718    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:30.008035 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:30.007819    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:30.169410 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.169377    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4bqj6" event={"ID":"d5ff0f9f-a7ad-45a7-a68e-9428230bfe27","Type":"ContainerStarted","Data":"98d1166ffdc0f98952d9a85beb69649fe3b6a435a579d280fac2cda59c7b1ad1"}
Jul 10 18:00:30.171275 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.171251    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:00:30.171646 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.171625    2569 generic.go:356] "Generic (PLEG): container finished" podID="e176d398-2a86-4a7e-97c0-d62f73823291" containerID="244d8982d12259615de793cdd19f2e230b7cec6fe8eda7bada6125219f699310" exitCode=1
Jul 10 18:00:30.171717 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.171696    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g" event={"ID":"e176d398-2a86-4a7e-97c0-d62f73823291","Type":"ContainerStarted","Data":"f7015b6171ca990f84d55bf16ec82da78f1cd0c71206d9a8e1eddcf19eef4c33"}
Jul 10 18:00:30.171776 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.171761    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g" event={"ID":"e176d398-2a86-4a7e-97c0-d62f73823291","Type":"ContainerDied","Data":"244d8982d12259615de793cdd19f2e230b7cec6fe8eda7bada6125219f699310"}
Jul 10 18:00:30.171829 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.171796    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g" event={"ID":"e176d398-2a86-4a7e-97c0-d62f73823291","Type":"ContainerStarted","Data":"55508742fa175f492eba61ef3707053c1bd26a098a3b7463bfabf212aef696c1"}
Jul 10 18:00:30.173196 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.173172    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-9.ec2.internal" event={"ID":"e7d8eb65068a8bb501871987dce52055","Type":"ContainerStarted","Data":"c5f343a89bffbf7b026551815b4b9b0c3c26ec70532b4b363269e4d173ce1215"}
Jul 10 18:00:30.174682 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.174557    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rzjl2" event={"ID":"ea71c047-efda-4a04-9ff0-9616073d30ab","Type":"ContainerStarted","Data":"b8905668d83762232663023ae2591eb1d442398987325e5bf80f0e3f379ea607"}
Jul 10 18:00:30.201294 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.201022    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4bqj6" podStartSLOduration=1.518298817 podStartE2EDuration="22.200998543s" totalImagesPullingTime="20.682699726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:30.18678896 +0000 UTC m=+22.865056540" watchObservedRunningTime="2026-07-10 18:00:30.200998543 +0000 UTC m=+22.879266124"
Jul 10 18:00:30.201923 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.201883    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rzjl2" podStartSLOduration=1.7825826340000002 podStartE2EDuration="22.201870198s" totalImagesPullingTime="20.419287564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:30.201447386 +0000 UTC m=+22.879714985" watchObservedRunningTime="2026-07-10 18:00:30.201870198 +0000 UTC m=+22.880137775"
Jul 10 18:00:30.216758 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:30.216696    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-9.ec2.internal" podStartSLOduration=22.216678422 podStartE2EDuration="22.216678422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:30.216244538 +0000 UTC m=+22.894512117" watchObservedRunningTime="2026-07-10 18:00:30.216678422 +0000 UTC m=+22.894946000"
Jul 10 18:00:31.178694 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.178367    2569 generic.go:356] "Generic (PLEG): container finished" podID="c2e3e163-237c-469a-a80e-a349c39e483b" containerID="311ccd0d8dbe4cd4a16a3fc6bd0a70288207fc9a74c50284003d0877a33fe955" exitCode=0
Jul 10 18:00:31.179533 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.178457    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcdpx" event={"ID":"c2e3e163-237c-469a-a80e-a349c39e483b","Type":"ContainerDied","Data":"311ccd0d8dbe4cd4a16a3fc6bd0a70288207fc9a74c50284003d0877a33fe955"}
Jul 10 18:00:31.180484 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.180458    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qgmdb" event={"ID":"9214d3e7-1ca6-470f-b8ce-c030fdbb4737","Type":"ContainerStarted","Data":"9ed40a814b098e68734079cd5ba21f31582e6df3b45da583ebff2a5f187b04ba"}
Jul 10 18:00:31.182234 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.182204    2569 generic.go:356] "Generic (PLEG): container finished" podID="2e5b5f6f4096b5c894a87a557b0f7ba2" containerID="1ac4c7309c0d6188f06422c6e3789d9eec571620bb04d287f73213bd5fc87ffa" exitCode=0
Jul 10 18:00:31.182387 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.182287    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal" event={"ID":"2e5b5f6f4096b5c894a87a557b0f7ba2","Type":"ContainerDied","Data":"1ac4c7309c0d6188f06422c6e3789d9eec571620bb04d287f73213bd5fc87ffa"}
Jul 10 18:00:31.184193 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.184141    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hsvnp" event={"ID":"08677185-1b3a-4cb6-878a-8f87e68b6286","Type":"ContainerStarted","Data":"66139bfc6c6116a9e04b65aad0162fd26e4153c36a5fca1cc9d0012750453c8c"}
Jul 10 18:00:31.186159 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.186132    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dpgcv" event={"ID":"f85edd65-07d9-4601-97be-59a36f93f0e1","Type":"ContainerStarted","Data":"6cf805c627c4ea019b709d4422cf2926a4b6ab083494ce4156bbdb1111f3a482"}
Jul 10 18:00:31.187818 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.187790    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6" event={"ID":"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb","Type":"ContainerStarted","Data":"3824ee03b3e7cb1d492875f1b22730a684c0c6f4afe5b2083165ddd8fbeb983a"}
Jul 10 18:00:31.190677 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.190656    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:00:31.191108 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.191085    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g" event={"ID":"e176d398-2a86-4a7e-97c0-d62f73823291","Type":"ContainerStarted","Data":"490f142ae6d8052f65612fc93d7e9e63ddc11763c7120bb75873dc25e0198bcb"}
Jul 10 18:00:31.191189 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.191160    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g" event={"ID":"e176d398-2a86-4a7e-97c0-d62f73823291","Type":"ContainerStarted","Data":"a4586c4c6fe47136e147b4c7fda6803cc14fc04686422b87b65b6d14bc7e48b6"}
Jul 10 18:00:31.191249 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.191206    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g" event={"ID":"e176d398-2a86-4a7e-97c0-d62f73823291","Type":"ContainerStarted","Data":"814fe1e7f8cb20feda765cdc97fc2bb8741abea9055aa6d83a7baa968599efb1"}
Jul 10 18:00:31.192711 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.192680    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tz6c7" event={"ID":"4b966395-a7e0-4d67-8430-8b3a5a22e127","Type":"ContainerStarted","Data":"b9b455b81779114bd69cf44528fdbf9cdb54452928425009a408b75376bd01d6"}
Jul 10 18:00:31.212163 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.212104    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tz6c7" podStartSLOduration=2.7251249189999998 podStartE2EDuration="23.212089007s" totalImagesPullingTime="20.486964088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:31.211625102 +0000 UTC m=+23.889892681" watchObservedRunningTime="2026-07-10 18:00:31.212089007 +0000 UTC m=+23.890356584"
Jul 10 18:00:31.224895 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.224852    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dpgcv" podStartSLOduration=2.773612732 podStartE2EDuration="23.224835696s" totalImagesPullingTime="20.451222964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:31.22452223 +0000 UTC m=+23.902789810" watchObservedRunningTime="2026-07-10 18:00:31.224835696 +0000 UTC m=+23.903103273"
Jul 10 18:00:31.237367 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.237301    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qgmdb" podStartSLOduration=2.596118663 podStartE2EDuration="23.237284598s" totalImagesPullingTime="20.641165935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:31.237075424 +0000 UTC m=+23.915343017" watchObservedRunningTime="2026-07-10 18:00:31.237284598 +0000 UTC m=+23.915552176"
Jul 10 18:00:31.267218 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.267167    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hsvnp" podStartSLOduration=2.864622895 podStartE2EDuration="23.267150801s" totalImagesPullingTime="20.402527906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:31.26658934 +0000 UTC m=+23.944856919" watchObservedRunningTime="2026-07-10 18:00:31.267150801 +0000 UTC m=+23.945418378"
Jul 10 18:00:31.361639 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.361593    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:31.430701 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:31.430661    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:32.007458 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:32.007385    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:32.007645 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:32.007543    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:32.007645 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:32.007548    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:32.007875 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:32.007663    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:32.007875 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:32.007852    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:32.008009 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:32.007982    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:32.055255 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:32.055226    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 18:00:32.196752 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:32.196646    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal" event={"ID":"2e5b5f6f4096b5c894a87a557b0f7ba2","Type":"ContainerStarted","Data":"a8f5e3c55ece17a40d1c55b74017d88bf518d6af62c5dcd223cc31a12572cd67"}
Jul 10 18:00:32.198808 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:32.198765    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6" event={"ID":"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb","Type":"ContainerStarted","Data":"6e572336d052c05b316545807198793e2712741b67b085b006b7bb6f45d45deb"}
Jul 10 18:00:32.210809 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:32.210744    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-9.ec2.internal" podStartSLOduration=24.210722245 podStartE2EDuration="24.210722245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:32.209716402 +0000 UTC m=+24.887984189" watchObservedRunningTime="2026-07-10 18:00:32.210722245 +0000 UTC m=+24.888989825"
Jul 10 18:00:32.491383 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:32.491288    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:32.947569 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:32.947461    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T18:00:32.055246441Z","UUID":"c7e23f78-c183-42ef-b32e-a2f8536c16d2","Handler":null,"Name":"","Endpoint":""}
Jul 10 18:00:32.949026 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:32.948999    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 18:00:32.949174 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:32.949036    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 18:00:33.205424 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:33.205345    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:00:33.206014 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:33.205984    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g" event={"ID":"e176d398-2a86-4a7e-97c0-d62f73823291","Type":"ContainerStarted","Data":"fa621cb760547c2545d017855256ce112b9b71a5e3b129f2551c8badaa92db52"}
Jul 10 18:00:33.273158 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:33.273122    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dpgcv"
Jul 10 18:00:33.273751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:33.273731    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dpgcv"
Jul 10 18:00:34.008110 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:34.008077    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:34.008303 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:34.008077    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:34.008303 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:34.008201    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:34.008436 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:34.008301    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:34.008436 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:34.008081    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:34.008512 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:34.008433    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:34.086622 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:34.086540    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:34.210709 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:34.210650    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6" event={"ID":"1d530b02-b61c-4e4d-8b5e-0bd49685a9eb","Type":"ContainerStarted","Data":"4ef0ab882a956ac8c1d853b551cf9740beb2b2fef4ede737e39d6cd8a4f3e779"}
Jul 10 18:00:34.211197 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:34.210754    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dpgcv"
Jul 10 18:00:34.211329 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:34.211291    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dpgcv"
Jul 10 18:00:34.237412 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:34.235750    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh2m6" podStartSLOduration=2.7641242139999997 podStartE2EDuration="26.235728681s" totalImagesPullingTime="23.471604467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:34.235262581 +0000 UTC m=+26.913530159" watchObservedRunningTime="2026-07-10 18:00:34.235728681 +0000 UTC m=+26.913996254"
Jul 10 18:00:34.304209 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:34.304119    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:34.380119 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:34.380069    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:36.008064 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:36.007842    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:36.008680 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:36.007841    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:36.008680 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:36.008171    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:36.008680 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:36.007851    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:36.008680 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:36.008285    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:36.008680 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:36.008377    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:36.532216 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:36.532181    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:36.630065 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:36.630031    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:37.219466 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:37.219224    2569 generic.go:356] "Generic (PLEG): container finished" podID="c2e3e163-237c-469a-a80e-a349c39e483b" containerID="4d26b9dbcf1022aea546534ae0387989a54363e17855d19cf040b8eb1d56f01f" exitCode=0
Jul 10 18:00:37.220209 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:37.219271    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcdpx" event={"ID":"c2e3e163-237c-469a-a80e-a349c39e483b","Type":"ContainerDied","Data":"4d26b9dbcf1022aea546534ae0387989a54363e17855d19cf040b8eb1d56f01f"}
Jul 10 18:00:37.223290 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:37.223272    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:00:37.223705 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:37.223680    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g" event={"ID":"e176d398-2a86-4a7e-97c0-d62f73823291","Type":"ContainerStarted","Data":"3caad66445540d2f4fa8608aecd3a4b4eaf26be71f6c04ddb4125ce6067c9878"}
Jul 10 18:00:37.224000 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:37.223981    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:37.224346 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:37.224326    2569 scope.go:117] "RemoveContainer" containerID="244d8982d12259615de793cdd19f2e230b7cec6fe8eda7bada6125219f699310"
Jul 10 18:00:37.240835 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:37.240805    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:38.008458 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.008419    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:38.008891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.008493    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:38.008891 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:38.008509    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:38.008891 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:38.008596    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:38.008891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.008604    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:38.008891 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:38.008688    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:38.230725 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.230699    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:00:38.231139 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.231107    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g" event={"ID":"e176d398-2a86-4a7e-97c0-d62f73823291","Type":"ContainerStarted","Data":"3f74b1ce81b684a7d174d8a8c627ed05dbea9fa1bfc338bfc9e3856019eb4777"}
Jul 10 18:00:38.231508 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.231487    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:38.231636 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.231562    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:38.249225 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.249192    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:00:38.257441 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.257386    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g" podStartSLOduration=9.526104883 podStartE2EDuration="30.257368454s" totalImagesPullingTime="20.731263571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:38.255968965 +0000 UTC m=+30.934236566" watchObservedRunningTime="2026-07-10 18:00:38.257368454 +0000 UTC m=+30.935636026"
Jul 10 18:00:38.613064 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.613035    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-chhnz"]
Jul 10 18:00:38.613203 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.613184    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:38.613324 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:38.613285    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:38.615111 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.615082    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b4zhd"]
Jul 10 18:00:38.615249 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.615180    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:38.615329 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:38.615254    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:38.624750 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.624715    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lmwg6"]
Jul 10 18:00:38.624934 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:38.624856    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:38.625006 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:38.624979    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:39.236218 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:39.236184    2569 generic.go:356] "Generic (PLEG): container finished" podID="c2e3e163-237c-469a-a80e-a349c39e483b" containerID="45a8e05748adafecfeb090c5fc7beb5af9484d7cc2dfd1063d9c0b6b8c4e4f61" exitCode=0
Jul 10 18:00:39.236675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:39.236267    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcdpx" event={"ID":"c2e3e163-237c-469a-a80e-a349c39e483b","Type":"ContainerDied","Data":"45a8e05748adafecfeb090c5fc7beb5af9484d7cc2dfd1063d9c0b6b8c4e4f61"}
Jul 10 18:00:39.304053 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:39.304015    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:39.358801 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:39.358762    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:39.416455 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:39.416368    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:39.471004 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:39.470968    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:40.007686 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:40.007649    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:40.007891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:40.007649    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:40.007891 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:40.007807    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:40.007891 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:40.007869    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:40.500646 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:40.500449    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:40.526431 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:40.526385    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs\") pod \"network-metrics-daemon-lmwg6\" (UID: \"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed\") " pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:40.526431 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:40.526436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:40.526641 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:40.526532    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:40.526641 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:40.526603    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs podName:2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed nodeName:}" failed. No retries permitted until 2026-07-10 18:01:12.526585358 +0000 UTC m=+65.204852918 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs") pod "network-metrics-daemon-lmwg6" (UID: "2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:00:40.526641 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:40.526538    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:40.526735 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:40.526677    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret podName:b6d991cf-1886-472c-8bde-025d82091dfd nodeName:}" failed. No retries permitted until 2026-07-10 18:01:12.526657002 +0000 UTC m=+65.204924558 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret") pod "global-pull-secret-syncer-chhnz" (UID: "b6d991cf-1886-472c-8bde-025d82091dfd") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:00:40.627276 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:40.627235    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xvz\" (UniqueName: \"kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz\") pod \"network-check-target-b4zhd\" (UID: \"202e4b7c-3f4b-43dd-99c0-8e52a7672de7\") " pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:40.627460 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:40.627445    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:00:40.627515 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:40.627473    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:00:40.627515 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:40.627488    2569 projected.go:196] Error preparing data for projected volume kube-api-access-h6xvz for pod openshift-network-diagnostics/network-check-target-b4zhd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:40.627576 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:40.627541    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz podName:202e4b7c-3f4b-43dd-99c0-8e52a7672de7 nodeName:}" failed. No retries permitted until 2026-07-10 18:01:12.62752737 +0000 UTC m=+65.305794926 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6xvz" (UniqueName: "kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz") pod "network-check-target-b4zhd" (UID: "202e4b7c-3f4b-43dd-99c0-8e52a7672de7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:00:40.938534 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:40.938495    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:41.006453 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:41.006412    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:41.007207 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:41.007182    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:41.007343 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:41.007279    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4zhd" podUID="202e4b7c-3f4b-43dd-99c0-8e52a7672de7"
Jul 10 18:00:41.213588 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:41.213554    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:41.244067 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:41.244034    2569 generic.go:356] "Generic (PLEG): container finished" podID="c2e3e163-237c-469a-a80e-a349c39e483b" containerID="c876d79e8d88e3f0746fda892226a54832ea6bf194106520597c2742db18d682" exitCode=0
Jul 10 18:00:41.244230 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:41.244105    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcdpx" event={"ID":"c2e3e163-237c-469a-a80e-a349c39e483b","Type":"ContainerDied","Data":"c876d79e8d88e3f0746fda892226a54832ea6bf194106520597c2742db18d682"}
Jul 10 18:00:41.288360 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:41.288236    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:41.389703 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:41.389645    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:41.484345 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:41.484270    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:41.584300 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:41.584202    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:42.007929 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.007889    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:42.007929 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.007919    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:42.008350 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:42.008046    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmwg6" podUID="2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed"
Jul 10 18:00:42.008350 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:42.008181    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-chhnz" podUID="b6d991cf-1886-472c-8bde-025d82091dfd"
Jul 10 18:00:42.575176 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.575147    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-9.ec2.internal" event="NodeReady"
Jul 10 18:00:42.575363 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.575286    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 18:00:42.617445 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.617411    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s7gsk"]
Jul 10 18:00:42.619429 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.619364    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:42.620543 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.620475    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5zwmc"]
Jul 10 18:00:42.621784 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.621663    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xxlp9\""
Jul 10 18:00:42.621784 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.621751    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 18:00:42.621784 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.621769    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 18:00:42.625924 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.625439    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5zwmc"
Jul 10 18:00:42.628322 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.627727    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 18:00:42.628322 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.627758    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 18:00:42.628322 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.628209    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 18:00:42.628322 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.628259    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mzh8h\""
Jul 10 18:00:42.630357 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.630330    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s7gsk"]
Jul 10 18:00:42.633811 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.633762    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5zwmc"]
Jul 10 18:00:42.741547 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.741514    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08a38409-e805-44e5-95d9-8adfbf9dd299-config-volume\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:42.741547 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.741546    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:42.741765 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.741581    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w27gf\" (UniqueName: \"kubernetes.io/projected/926b7b00-c6c9-43d2-9502-a23ed2d0ce7b-kube-api-access-w27gf\") pod \"ingress-canary-5zwmc\" (UID: \"926b7b00-c6c9-43d2-9502-a23ed2d0ce7b\") " pod="openshift-ingress-canary/ingress-canary-5zwmc"
Jul 10 18:00:42.741765 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.741617    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6bq8\" (UniqueName: \"kubernetes.io/projected/08a38409-e805-44e5-95d9-8adfbf9dd299-kube-api-access-z6bq8\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:42.741765 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.741686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/926b7b00-c6c9-43d2-9502-a23ed2d0ce7b-cert\") pod \"ingress-canary-5zwmc\" (UID: \"926b7b00-c6c9-43d2-9502-a23ed2d0ce7b\") " pod="openshift-ingress-canary/ingress-canary-5zwmc"
Jul 10 18:00:42.741765 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.741757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08a38409-e805-44e5-95d9-8adfbf9dd299-tmp-dir\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:42.745766 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.745730    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:42.831524 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.831435    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-x49tp"]
Jul 10 18:00:42.833631 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.833601    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp"
Jul 10 18:00:42.837188 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.837152    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hcvv8\""
Jul 10 18:00:42.837367 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.837152    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 10 18:00:42.837367 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.837153    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 10 18:00:42.837367 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.837279    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 10 18:00:42.837615 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.837588    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 10 18:00:42.842267 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.842237    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08a38409-e805-44e5-95d9-8adfbf9dd299-config-volume\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:42.842425 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.842281    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:42.842425 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.842346    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w27gf\" (UniqueName: \"kubernetes.io/projected/926b7b00-c6c9-43d2-9502-a23ed2d0ce7b-kube-api-access-w27gf\") pod \"ingress-canary-5zwmc\" (UID: \"926b7b00-c6c9-43d2-9502-a23ed2d0ce7b\") " pod="openshift-ingress-canary/ingress-canary-5zwmc"
Jul 10 18:00:42.842425 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.842377    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6bq8\" (UniqueName: \"kubernetes.io/projected/08a38409-e805-44e5-95d9-8adfbf9dd299-kube-api-access-z6bq8\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:42.842425 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.842405    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/926b7b00-c6c9-43d2-9502-a23ed2d0ce7b-cert\") pod \"ingress-canary-5zwmc\" (UID: \"926b7b00-c6c9-43d2-9502-a23ed2d0ce7b\") " pod="openshift-ingress-canary/ingress-canary-5zwmc"
Jul 10 18:00:42.842681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.842427    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08a38409-e805-44e5-95d9-8adfbf9dd299-tmp-dir\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:42.842681 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:42.842487    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:00:42.842681 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:42.842558    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls podName:08a38409-e805-44e5-95d9-8adfbf9dd299 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:43.342537346 +0000 UTC m=+36.020804923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls") pod "dns-default-s7gsk" (UID: "08a38409-e805-44e5-95d9-8adfbf9dd299") : secret "dns-default-metrics-tls" not found
Jul 10 18:00:42.842841 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.842716    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08a38409-e805-44e5-95d9-8adfbf9dd299-tmp-dir\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:42.842980 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.842953    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08a38409-e805-44e5-95d9-8adfbf9dd299-config-volume\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:42.847000 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.846960    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-x49tp"]
Jul 10 18:00:42.848084 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.848008    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/926b7b00-c6c9-43d2-9502-a23ed2d0ce7b-cert\") pod \"ingress-canary-5zwmc\" (UID: \"926b7b00-c6c9-43d2-9502-a23ed2d0ce7b\") " pod="openshift-ingress-canary/ingress-canary-5zwmc"
Jul 10 18:00:42.858608 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.858494    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:42.861383 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.861355    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6bq8\" (UniqueName: \"kubernetes.io/projected/08a38409-e805-44e5-95d9-8adfbf9dd299-kube-api-access-z6bq8\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:42.861544 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.861525    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w27gf\" (UniqueName: \"kubernetes.io/projected/926b7b00-c6c9-43d2-9502-a23ed2d0ce7b-kube-api-access-w27gf\") pod \"ingress-canary-5zwmc\" (UID: \"926b7b00-c6c9-43d2-9502-a23ed2d0ce7b\") " pod="openshift-ingress-canary/ingress-canary-5zwmc"
Jul 10 18:00:42.941593 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.941552    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5zwmc"
Jul 10 18:00:42.942843 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.942819    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g74ng\" (UniqueName: \"kubernetes.io/projected/7c33a061-eb61-47c5-88dd-16ac0aff0b36-kube-api-access-g74ng\") pod \"service-ca-79f68b9f4f-x49tp\" (UID: \"7c33a061-eb61-47c5-88dd-16ac0aff0b36\") " pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp"
Jul 10 18:00:42.942974 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.942956    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7c33a061-eb61-47c5-88dd-16ac0aff0b36-signing-key\") pod \"service-ca-79f68b9f4f-x49tp\" (UID: \"7c33a061-eb61-47c5-88dd-16ac0aff0b36\") " pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp"
Jul 10 18:00:42.943024 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:42.943000    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7c33a061-eb61-47c5-88dd-16ac0aff0b36-signing-cabundle\") pod \"service-ca-79f68b9f4f-x49tp\" (UID: \"7c33a061-eb61-47c5-88dd-16ac0aff0b36\") " pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp"
Jul 10 18:00:43.007549 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.007518    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:00:43.010505 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.010226    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 18:00:43.010505 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.010282    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 18:00:43.010505 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.010391    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-25vgp\""
Jul 10 18:00:43.012733 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.012678    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4nsr6"]
Jul 10 18:00:43.019231 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.019203    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.022344 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.022224    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 18:00:43.022344 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.022341    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 18:00:43.022533 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.022375    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pcwng\""
Jul 10 18:00:43.022533 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.022395    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 18:00:43.022533 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.022223    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 18:00:43.026446 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.025796    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4nsr6"]
Jul 10 18:00:43.044728 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.044198    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7c33a061-eb61-47c5-88dd-16ac0aff0b36-signing-key\") pod \"service-ca-79f68b9f4f-x49tp\" (UID: \"7c33a061-eb61-47c5-88dd-16ac0aff0b36\") " pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp"
Jul 10 18:00:43.044728 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.044251    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7c33a061-eb61-47c5-88dd-16ac0aff0b36-signing-cabundle\") pod \"service-ca-79f68b9f4f-x49tp\" (UID: \"7c33a061-eb61-47c5-88dd-16ac0aff0b36\") " pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp"
Jul 10 18:00:43.044728 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.044305    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g74ng\" (UniqueName: \"kubernetes.io/projected/7c33a061-eb61-47c5-88dd-16ac0aff0b36-kube-api-access-g74ng\") pod \"service-ca-79f68b9f4f-x49tp\" (UID: \"7c33a061-eb61-47c5-88dd-16ac0aff0b36\") " pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp"
Jul 10 18:00:43.045456 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.045429    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7c33a061-eb61-47c5-88dd-16ac0aff0b36-signing-cabundle\") pod \"service-ca-79f68b9f4f-x49tp\" (UID: \"7c33a061-eb61-47c5-88dd-16ac0aff0b36\") " pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp"
Jul 10 18:00:43.046753 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.046724    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:43.048210 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.048190    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7c33a061-eb61-47c5-88dd-16ac0aff0b36-signing-key\") pod \"service-ca-79f68b9f4f-x49tp\" (UID: \"7c33a061-eb61-47c5-88dd-16ac0aff0b36\") " pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp"
Jul 10 18:00:43.055544 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.055493    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g74ng\" (UniqueName: \"kubernetes.io/projected/7c33a061-eb61-47c5-88dd-16ac0aff0b36-kube-api-access-g74ng\") pod \"service-ca-79f68b9f4f-x49tp\" (UID: \"7c33a061-eb61-47c5-88dd-16ac0aff0b36\") " pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp"
Jul 10 18:00:43.110287 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.110023    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5zwmc"]
Jul 10 18:00:43.110834 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.110806    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:43.114889 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:43.114862    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod926b7b00_c6c9_43d2_9502_a23ed2d0ce7b.slice/crio-f7a00dbbb62a5fd5f1c3f3bb1c943f6b1579171bb2ec8c4fd102fbf08b4b2e84 WatchSource:0}: Error finding container f7a00dbbb62a5fd5f1c3f3bb1c943f6b1579171bb2ec8c4fd102fbf08b4b2e84: Status 404 returned error can't find the container with id f7a00dbbb62a5fd5f1c3f3bb1c943f6b1579171bb2ec8c4fd102fbf08b4b2e84
Jul 10 18:00:43.145027 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.144989    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp"
Jul 10 18:00:43.145179 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.145123    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba19b36b-d069-4bee-a3de-303c6b6080b7-crio-socket\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.145259 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.145243    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.145349 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.145290    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba19b36b-d069-4bee-a3de-303c6b6080b7-data-volume\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.145434 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.145413    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.145474 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.145446    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sx4z\" (UniqueName: \"kubernetes.io/projected/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-api-access-2sx4z\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.246896 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.246848    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba19b36b-d069-4bee-a3de-303c6b6080b7-crio-socket\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.247114 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.246957    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.247114 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.246987    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba19b36b-d069-4bee-a3de-303c6b6080b7-data-volume\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.247114 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.247026    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.247114 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.247052    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sx4z\" (UniqueName: \"kubernetes.io/projected/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-api-access-2sx4z\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.247114 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:43.247099    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:00:43.247435 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:43.247167    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls podName:ba19b36b-d069-4bee-a3de-303c6b6080b7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:43.747142227 +0000 UTC m=+36.425409797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nsr6" (UID: "ba19b36b-d069-4bee-a3de-303c6b6080b7") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:00:43.247435 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.247181    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba19b36b-d069-4bee-a3de-303c6b6080b7-crio-socket\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.247435 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:43.247265    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:00:43.247435 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.247353    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba19b36b-d069-4bee-a3de-303c6b6080b7-data-volume\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.247435 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:43.247361    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm podName:ba19b36b-d069-4bee-a3de-303c6b6080b7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:43.747342454 +0000 UTC m=+36.425610028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4nsr6" (UID: "ba19b36b-d069-4bee-a3de-303c6b6080b7") : configmap "kube-rbac-proxy" not found
Jul 10 18:00:43.251695 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.251645    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5zwmc" event={"ID":"926b7b00-c6c9-43d2-9502-a23ed2d0ce7b","Type":"ContainerStarted","Data":"f7a00dbbb62a5fd5f1c3f3bb1c943f6b1579171bb2ec8c4fd102fbf08b4b2e84"}
Jul 10 18:00:43.257571 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.257536    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sx4z\" (UniqueName: \"kubernetes.io/projected/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-api-access-2sx4z\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.296022 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.295981    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-x49tp"]
Jul 10 18:00:43.301012 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:43.300983    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c33a061_eb61_47c5_88dd_16ac0aff0b36.slice/crio-21231fc6d24ff2ab9c47c868eb3f28244400e8d4d90af69914a17971c70fc4d4 WatchSource:0}: Error finding container 21231fc6d24ff2ab9c47c868eb3f28244400e8d4d90af69914a17971c70fc4d4: Status 404 returned error can't find the container with id 21231fc6d24ff2ab9c47c868eb3f28244400e8d4d90af69914a17971c70fc4d4
Jul 10 18:00:43.347503 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.347464    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:43.347786 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:43.347692    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:00:43.347855 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:43.347848    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls podName:08a38409-e805-44e5-95d9-8adfbf9dd299 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:44.347824793 +0000 UTC m=+37.026092373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls") pod "dns-default-s7gsk" (UID: "08a38409-e805-44e5-95d9-8adfbf9dd299") : secret "dns-default-metrics-tls" not found
Jul 10 18:00:43.751120 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.751068    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.752106 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.751195    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:43.752106 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:43.751299    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:00:43.752106 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:43.751359    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:00:43.752106 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:43.751398    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm podName:ba19b36b-d069-4bee-a3de-303c6b6080b7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:44.751374761 +0000 UTC m=+37.429642341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4nsr6" (UID: "ba19b36b-d069-4bee-a3de-303c6b6080b7") : configmap "kube-rbac-proxy" not found
Jul 10 18:00:43.752106 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:43.751416    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls podName:ba19b36b-d069-4bee-a3de-303c6b6080b7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:44.751408072 +0000 UTC m=+37.429675629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nsr6" (UID: "ba19b36b-d069-4bee-a3de-303c6b6080b7") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:00:43.802848 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:43.802780    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:44.007502 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:44.007415    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:00:44.007679 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:44.007415    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:00:44.011186 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:44.010968    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 18:00:44.011186 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:44.010995    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 18:00:44.013300 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:44.012957    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s4tg5\""
Jul 10 18:00:44.256938 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:44.256891    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp" event={"ID":"7c33a061-eb61-47c5-88dd-16ac0aff0b36","Type":"ContainerStarted","Data":"21231fc6d24ff2ab9c47c868eb3f28244400e8d4d90af69914a17971c70fc4d4"}
Jul 10 18:00:44.357273 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:44.357170    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:44.357472 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:44.357363    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:00:44.357472 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:44.357427    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls podName:08a38409-e805-44e5-95d9-8adfbf9dd299 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:46.357408208 +0000 UTC m=+39.035675764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls") pod "dns-default-s7gsk" (UID: "08a38409-e805-44e5-95d9-8adfbf9dd299") : secret "dns-default-metrics-tls" not found
Jul 10 18:00:44.760048 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:44.759923    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:44.760565 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:44.760054    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:44.760565 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:44.760210    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:00:44.760565 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:44.760280    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls podName:ba19b36b-d069-4bee-a3de-303c6b6080b7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:46.760259516 +0000 UTC m=+39.438527074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nsr6" (UID: "ba19b36b-d069-4bee-a3de-303c6b6080b7") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:00:44.760750 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:44.760701    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:00:44.760806 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:44.760757    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm podName:ba19b36b-d069-4bee-a3de-303c6b6080b7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:46.76073874 +0000 UTC m=+39.439006296 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4nsr6" (UID: "ba19b36b-d069-4bee-a3de-303c6b6080b7") : configmap "kube-rbac-proxy" not found
Jul 10 18:00:46.000600 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:46.000564    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hsvnp_08677185-1b3a-4cb6-878a-8f87e68b6286/dns-node-resolver/0.log"
Jul 10 18:00:46.373295 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:46.373198    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:46.373551 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:46.373402    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:00:46.373551 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:46.373484    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls podName:08a38409-e805-44e5-95d9-8adfbf9dd299 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:50.373460453 +0000 UTC m=+43.051728013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls") pod "dns-default-s7gsk" (UID: "08a38409-e805-44e5-95d9-8adfbf9dd299") : secret "dns-default-metrics-tls" not found
Jul 10 18:00:46.777041 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:46.776999    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:46.777246 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:46.777131    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:46.777246 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:46.777153    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:00:46.777246 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:46.777233    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm podName:ba19b36b-d069-4bee-a3de-303c6b6080b7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:50.777216979 +0000 UTC m=+43.455484535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4nsr6" (UID: "ba19b36b-d069-4bee-a3de-303c6b6080b7") : configmap "kube-rbac-proxy" not found
Jul 10 18:00:46.777427 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:46.777256    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:00:46.777427 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:46.777304    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls podName:ba19b36b-d069-4bee-a3de-303c6b6080b7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:50.777291179 +0000 UTC m=+43.455558752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nsr6" (UID: "ba19b36b-d069-4bee-a3de-303c6b6080b7") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:00:47.001428 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:47.001392    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qgmdb_9214d3e7-1ca6-470f-b8ce-c030fdbb4737/node-ca/0.log"
Jul 10 18:00:47.199341 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:47.199228    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:47.892244 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:47.892209    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:49.273455 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:49.273416    2569 generic.go:356] "Generic (PLEG): container finished" podID="c2e3e163-237c-469a-a80e-a349c39e483b" containerID="6b73de76d84be39b63cb248134d588156ee352201592c35bdc6facb2042326d8" exitCode=0
Jul 10 18:00:49.273986 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:49.273498    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcdpx" event={"ID":"c2e3e163-237c-469a-a80e-a349c39e483b","Type":"ContainerDied","Data":"6b73de76d84be39b63cb248134d588156ee352201592c35bdc6facb2042326d8"}
Jul 10 18:00:49.275197 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:49.275168    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5zwmc" event={"ID":"926b7b00-c6c9-43d2-9502-a23ed2d0ce7b","Type":"ContainerStarted","Data":"df8c619bc948dcc04fe0ac4c5a3ab432ab53b582374df83fd9bfa951f2d75d75"}
Jul 10 18:00:49.276770 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:49.276743    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp" event={"ID":"7c33a061-eb61-47c5-88dd-16ac0aff0b36","Type":"ContainerStarted","Data":"d578caf464b1ee2bf0af9ed5ab36f4fa724f9f5bb523bee38c82fda741cc2ebf"}
Jul 10 18:00:49.308519 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:49.308457    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5zwmc" podStartSLOduration=2.105534534 podStartE2EDuration="7.308437165s" totalImagesPullingTime="5.202902631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:49.307156557 +0000 UTC m=+41.985424159" watchObservedRunningTime="2026-07-10 18:00:49.308437165 +0000 UTC m=+41.986704743"
Jul 10 18:00:49.323559 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:49.323496    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-x49tp" podStartSLOduration=2.30008378 podStartE2EDuration="7.323474868s" totalImagesPullingTime="5.023391088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:49.323161966 +0000 UTC m=+42.001429568" watchObservedRunningTime="2026-07-10 18:00:49.323474868 +0000 UTC m=+42.001742447"
Jul 10 18:00:49.633581 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:49.633481    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:49.782397 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:49.782283    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:49.882756 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:49.882702    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:49.986066 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:49.985971    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:50.278885 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:50.278835    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:50.283384 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:50.283349    2569 generic.go:356] "Generic (PLEG): container finished" podID="c2e3e163-237c-469a-a80e-a349c39e483b" containerID="f432d36c422584809a4915f4f68e3dda29a1981d1dc8a8c0ea7c33ce09281978" exitCode=0
Jul 10 18:00:50.283576 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:50.283425    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcdpx" event={"ID":"c2e3e163-237c-469a-a80e-a349c39e483b","Type":"ContainerDied","Data":"f432d36c422584809a4915f4f68e3dda29a1981d1dc8a8c0ea7c33ce09281978"}
Jul 10 18:00:50.336108 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:50.336071    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:50.408495 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:50.408447    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:50.408697 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:50.408626    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:00:50.408755 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:50.408715    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls podName:08a38409-e805-44e5-95d9-8adfbf9dd299 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:58.408696089 +0000 UTC m=+51.086963645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls") pod "dns-default-s7gsk" (UID: "08a38409-e805-44e5-95d9-8adfbf9dd299") : secret "dns-default-metrics-tls" not found
Jul 10 18:00:50.810978 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:50.810945    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:50.811156 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:50.811039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:50.811156 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:50.811084    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:00:50.811156 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:50.811147    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm podName:ba19b36b-d069-4bee-a3de-303c6b6080b7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:58.81113258 +0000 UTC m=+51.489400136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4nsr6" (UID: "ba19b36b-d069-4bee-a3de-303c6b6080b7") : configmap "kube-rbac-proxy" not found
Jul 10 18:00:50.811263 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:50.811160    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:00:50.811263 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:50.811207    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls podName:ba19b36b-d069-4bee-a3de-303c6b6080b7 nodeName:}" failed. No retries permitted until 2026-07-10 18:00:58.811189479 +0000 UTC m=+51.489457052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nsr6" (UID: "ba19b36b-d069-4bee-a3de-303c6b6080b7") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:00:51.289425 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:51.289381    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vcdpx" event={"ID":"c2e3e163-237c-469a-a80e-a349c39e483b","Type":"ContainerStarted","Data":"db608add3121175ffb9b1c0299957b4989494a585701457894a6b45dd0fdc122"}
Jul 10 18:00:51.312101 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:51.312037    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vcdpx" podStartSLOduration=7.504937124 podStartE2EDuration="43.312013143s" totalImagesPullingTime="35.807076019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:00:51.310527164 +0000 UTC m=+43.988794766" watchObservedRunningTime="2026-07-10 18:00:51.312013143 +0000 UTC m=+43.990280723"
Jul 10 18:00:51.380846 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:51.380811    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:51.731880 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:51.731789    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:51.925405 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:51.925355    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:52.127600 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:52.127559    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:52.530797 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:52.530763    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:53.049112 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:53.049080    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:53.149078 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:53.149031    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:53.593440 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:53.593401    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:53.731146 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:53.731107    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:53.927532 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:53.927441    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:54.141757 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:54.141721    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:54.205888 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:54.205801    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:54.538159 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:54.538123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:55.131746 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:55.131710    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:55.345034 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:55.344994    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:55.539223 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:55.539189    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:55.750931 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:55.750882    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:55.852091 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:55.852001    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:56.131464 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:56.131361    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:56.935722 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:56.935682    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:57.329377 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:57.329340    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:57.530600 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:57.530557    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:57.730805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:57.730711    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:58.126680 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:58.126633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:58.474646 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:58.474544    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:58.477704 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:58.477662    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a38409-e805-44e5-95d9-8adfbf9dd299-metrics-tls\") pod \"dns-default-s7gsk\" (UID: \"08a38409-e805-44e5-95d9-8adfbf9dd299\") " pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:58.534503 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:58.534458    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:00:58.681688 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:58.681646    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s7gsk"]
Jul 10 18:00:58.685862 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:00:58.685830    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a38409_e805_44e5_95d9_8adfbf9dd299.slice/crio-0e381aea00146df183f0ec333cac7e0c080a8e3e9a9aa9219a5c17e755ddc9d3 WatchSource:0}: Error finding container 0e381aea00146df183f0ec333cac7e0c080a8e3e9a9aa9219a5c17e755ddc9d3: Status 404 returned error can't find the container with id 0e381aea00146df183f0ec333cac7e0c080a8e3e9a9aa9219a5c17e755ddc9d3
Jul 10 18:00:58.878110 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:58.878063    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:58.878300 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:58.878147    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:58.878300 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:58.878261    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:00:58.878411 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:00:58.878348    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls podName:ba19b36b-d069-4bee-a3de-303c6b6080b7 nodeName:}" failed. No retries permitted until 2026-07-10 18:01:14.878333051 +0000 UTC m=+67.556600619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nsr6" (UID: "ba19b36b-d069-4bee-a3de-303c6b6080b7") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:00:58.878611 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:58.878590    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba19b36b-d069-4bee-a3de-303c6b6080b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:00:58.933956 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:58.933916    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:59.197040 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:59.196952    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:59.311631 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:59.311595    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s7gsk" event={"ID":"08a38409-e805-44e5-95d9-8adfbf9dd299","Type":"ContainerStarted","Data":"0e381aea00146df183f0ec333cac7e0c080a8e3e9a9aa9219a5c17e755ddc9d3"}
Jul 10 18:00:59.381299 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:59.381267    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:00:59.728964 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:00:59.728925    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:00.140057 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:00.139983    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:00.329744 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:00.329701    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:01.649600 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.649568    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf"]
Jul 10 18:01:01.664940 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.664906    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"]
Jul 10 18:01:01.665121 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.665093    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf"
Jul 10 18:01:01.667726 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.667698    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 10 18:01:01.667726 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.667716    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 10 18:01:01.668802 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.668661    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 10 18:01:01.669154 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.669133    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dmz4c\""
Jul 10 18:01:01.669373 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.669303    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 10 18:01:01.675288 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.675024    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"]
Jul 10 18:01:01.675288 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.675238    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"
Jul 10 18:01:01.677885 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.677861    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 10 18:01:01.682854 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.682821    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf"]
Jul 10 18:01:01.682854 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.682861    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"]
Jul 10 18:01:01.683086 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.682890    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"]
Jul 10 18:01:01.683086 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.682986    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.685471 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.685400    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 10 18:01:01.685612 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.685520    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 10 18:01:01.685612 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.685544    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 10 18:01:01.685779 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.685695    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 10 18:01:01.699676 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.699624    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c744829d-f098-440b-8199-8703012ed512-hub\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.699735 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.699704    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1082a4c7-fe3b-492d-b441-1274cdcfb1ad-tmp\") pod \"klusterlet-addon-workmgr-559db9c5-bzrsd\" (UID: \"1082a4c7-fe3b-492d-b441-1274cdcfb1ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"
Jul 10 18:01:01.699769 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.699741    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v5rf\" (UniqueName: \"kubernetes.io/projected/f1c20a02-c60e-42db-b4a7-df552ce944b8-kube-api-access-2v5rf\") pod \"managed-serviceaccount-addon-agent-bf59bd76-rzrwf\" (UID: \"f1c20a02-c60e-42db-b4a7-df552ce944b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf"
Jul 10 18:01:01.699836 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.699809    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5bn9\" (UniqueName: \"kubernetes.io/projected/1082a4c7-fe3b-492d-b441-1274cdcfb1ad-kube-api-access-v5bn9\") pod \"klusterlet-addon-workmgr-559db9c5-bzrsd\" (UID: \"1082a4c7-fe3b-492d-b441-1274cdcfb1ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"
Jul 10 18:01:01.699936 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.699840    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c744829d-f098-440b-8199-8703012ed512-ca\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.699936 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.699862    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c744829d-f098-440b-8199-8703012ed512-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.699936 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.699909    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4jr2\" (UniqueName: \"kubernetes.io/projected/c744829d-f098-440b-8199-8703012ed512-kube-api-access-h4jr2\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.699936 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.699932    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1082a4c7-fe3b-492d-b441-1274cdcfb1ad-klusterlet-config\") pod \"klusterlet-addon-workmgr-559db9c5-bzrsd\" (UID: \"1082a4c7-fe3b-492d-b441-1274cdcfb1ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"
Jul 10 18:01:01.700110 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.699952    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1c20a02-c60e-42db-b4a7-df552ce944b8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bf59bd76-rzrwf\" (UID: \"f1c20a02-c60e-42db-b4a7-df552ce944b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf"
Jul 10 18:01:01.700110 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.699992    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c744829d-f098-440b-8199-8703012ed512-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.700110 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.700026    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c744829d-f098-440b-8199-8703012ed512-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.758471 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.758429    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:01.801073 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.801030    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c744829d-f098-440b-8199-8703012ed512-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.801073 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.801078    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c744829d-f098-440b-8199-8703012ed512-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.801383 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.801123    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c744829d-f098-440b-8199-8703012ed512-hub\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.801383 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.801155    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1082a4c7-fe3b-492d-b441-1274cdcfb1ad-tmp\") pod \"klusterlet-addon-workmgr-559db9c5-bzrsd\" (UID: \"1082a4c7-fe3b-492d-b441-1274cdcfb1ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"
Jul 10 18:01:01.801383 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.801171    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v5rf\" (UniqueName: \"kubernetes.io/projected/f1c20a02-c60e-42db-b4a7-df552ce944b8-kube-api-access-2v5rf\") pod \"managed-serviceaccount-addon-agent-bf59bd76-rzrwf\" (UID: \"f1c20a02-c60e-42db-b4a7-df552ce944b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf"
Jul 10 18:01:01.801383 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.801207    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5bn9\" (UniqueName: \"kubernetes.io/projected/1082a4c7-fe3b-492d-b441-1274cdcfb1ad-kube-api-access-v5bn9\") pod \"klusterlet-addon-workmgr-559db9c5-bzrsd\" (UID: \"1082a4c7-fe3b-492d-b441-1274cdcfb1ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"
Jul 10 18:01:01.801383 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.801229    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c744829d-f098-440b-8199-8703012ed512-ca\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.801658 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.801502    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c744829d-f098-440b-8199-8703012ed512-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.801658 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.801561    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4jr2\" (UniqueName: \"kubernetes.io/projected/c744829d-f098-440b-8199-8703012ed512-kube-api-access-h4jr2\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.801658 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.801589    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1082a4c7-fe3b-492d-b441-1274cdcfb1ad-klusterlet-config\") pod \"klusterlet-addon-workmgr-559db9c5-bzrsd\" (UID: \"1082a4c7-fe3b-492d-b441-1274cdcfb1ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"
Jul 10 18:01:01.801658 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.801634    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1c20a02-c60e-42db-b4a7-df552ce944b8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bf59bd76-rzrwf\" (UID: \"f1c20a02-c60e-42db-b4a7-df552ce944b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf"
Jul 10 18:01:01.801853 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.801651    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1082a4c7-fe3b-492d-b441-1274cdcfb1ad-tmp\") pod \"klusterlet-addon-workmgr-559db9c5-bzrsd\" (UID: \"1082a4c7-fe3b-492d-b441-1274cdcfb1ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"
Jul 10 18:01:01.802501 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.802447    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c744829d-f098-440b-8199-8703012ed512-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.804226 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.804187    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c744829d-f098-440b-8199-8703012ed512-ca\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.804388 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.804229    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c744829d-f098-440b-8199-8703012ed512-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.804459 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.804407    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c744829d-f098-440b-8199-8703012ed512-hub\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.804514 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.804466    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c744829d-f098-440b-8199-8703012ed512-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.804564 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.804516    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1082a4c7-fe3b-492d-b441-1274cdcfb1ad-klusterlet-config\") pod \"klusterlet-addon-workmgr-559db9c5-bzrsd\" (UID: \"1082a4c7-fe3b-492d-b441-1274cdcfb1ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"
Jul 10 18:01:01.804564 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.804518    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1c20a02-c60e-42db-b4a7-df552ce944b8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bf59bd76-rzrwf\" (UID: \"f1c20a02-c60e-42db-b4a7-df552ce944b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf"
Jul 10 18:01:01.810028 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.809996    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5bn9\" (UniqueName: \"kubernetes.io/projected/1082a4c7-fe3b-492d-b441-1274cdcfb1ad-kube-api-access-v5bn9\") pod \"klusterlet-addon-workmgr-559db9c5-bzrsd\" (UID: \"1082a4c7-fe3b-492d-b441-1274cdcfb1ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"
Jul 10 18:01:01.810028 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.810006    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v5rf\" (UniqueName: \"kubernetes.io/projected/f1c20a02-c60e-42db-b4a7-df552ce944b8-kube-api-access-2v5rf\") pod \"managed-serviceaccount-addon-agent-bf59bd76-rzrwf\" (UID: \"f1c20a02-c60e-42db-b4a7-df552ce944b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf"
Jul 10 18:01:01.810330 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.810287    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4jr2\" (UniqueName: \"kubernetes.io/projected/c744829d-f098-440b-8199-8703012ed512-kube-api-access-h4jr2\") pod \"cluster-proxy-proxy-agent-5d7dd85558-zr2h2\" (UID: \"c744829d-f098-440b-8199-8703012ed512\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:01.830433 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.830397    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:01.931561 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:01.931525    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:02.009654 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.009630    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf"
Jul 10 18:01:02.019745 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.019712    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"
Jul 10 18:01:02.027055 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.027032    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"
Jul 10 18:01:02.030934 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.030901    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:02.135629 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.135573    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:02.186893 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.186656    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf"]
Jul 10 18:01:02.192217 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:01:02.192183    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1c20a02_c60e_42db_b4a7_df552ce944b8.slice/crio-527c7d372eebccf9da6b0a11a321da0c3d0ed137f1efe5089d6a94f8063d768a WatchSource:0}: Error finding container 527c7d372eebccf9da6b0a11a321da0c3d0ed137f1efe5089d6a94f8063d768a: Status 404 returned error can't find the container with id 527c7d372eebccf9da6b0a11a321da0c3d0ed137f1efe5089d6a94f8063d768a
Jul 10 18:01:02.205155 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.205083    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:02.211952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.211915    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"]
Jul 10 18:01:02.214992 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:01:02.214962    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1082a4c7_fe3b_492d_b441_1274cdcfb1ad.slice/crio-954e1b173e5fba26715d2cbd38e27d7c9c60a9e8638dcab791b07c31b8f7f370 WatchSource:0}: Error finding container 954e1b173e5fba26715d2cbd38e27d7c9c60a9e8638dcab791b07c31b8f7f370: Status 404 returned error can't find the container with id 954e1b173e5fba26715d2cbd38e27d7c9c60a9e8638dcab791b07c31b8f7f370
Jul 10 18:01:02.238156 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.238071    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2"]
Jul 10 18:01:02.242544 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:01:02.242514    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc744829d_f098_440b_8199_8703012ed512.slice/crio-d12afad6f2242d289271fac57d873b70701f62a6677cff45182145db73a1313f WatchSource:0}: Error finding container d12afad6f2242d289271fac57d873b70701f62a6677cff45182145db73a1313f: Status 404 returned error can't find the container with id d12afad6f2242d289271fac57d873b70701f62a6677cff45182145db73a1313f
Jul 10 18:01:02.321017 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.320913    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2" event={"ID":"c744829d-f098-440b-8199-8703012ed512","Type":"ContainerStarted","Data":"d12afad6f2242d289271fac57d873b70701f62a6677cff45182145db73a1313f"}
Jul 10 18:01:02.322752 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.322718    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s7gsk" event={"ID":"08a38409-e805-44e5-95d9-8adfbf9dd299","Type":"ContainerStarted","Data":"b2a869dd42ed02d41b7778ad853f3983e3095ee20940fb7f3acd56ae441b0cd1"}
Jul 10 18:01:02.322946 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.322775    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s7gsk" event={"ID":"08a38409-e805-44e5-95d9-8adfbf9dd299","Type":"ContainerStarted","Data":"cf94305318b659d39cc3db57aa2ab38ec48fe43c9c7d407395164d9039ebfc26"}
Jul 10 18:01:02.322946 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.322838    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:01:02.323831 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.323805    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd" event={"ID":"1082a4c7-fe3b-492d-b441-1274cdcfb1ad","Type":"ContainerStarted","Data":"954e1b173e5fba26715d2cbd38e27d7c9c60a9e8638dcab791b07c31b8f7f370"}
Jul 10 18:01:02.324764 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.324741    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf" event={"ID":"f1c20a02-c60e-42db-b4a7-df552ce944b8","Type":"ContainerStarted","Data":"527c7d372eebccf9da6b0a11a321da0c3d0ed137f1efe5089d6a94f8063d768a"}
Jul 10 18:01:02.338970 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.338922    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s7gsk" podStartSLOduration=17.589746784 podStartE2EDuration="20.33890263s" totalImagesPullingTime="2.749155846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:02.337349859 +0000 UTC m=+55.015617458" watchObservedRunningTime="2026-07-10 18:01:02.33890263 +0000 UTC m=+55.017170209"
Jul 10 18:01:02.548237 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:02.548190    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:04.407424 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:04.407360    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:04.461751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:04.461687    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:05.171418 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:05.171369    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:05.225262 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:05.225214    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:06.341411 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:06.341363    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf" event={"ID":"f1c20a02-c60e-42db-b4a7-df552ce944b8","Type":"ContainerStarted","Data":"74696ddd884c523023611003edc06d2d79d6710bb5177e2278514abfa796d62f"}
Jul 10 18:01:08.195031 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:08.194984    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:08.295530 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:08.295492    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:08.527242 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:08.527202    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:08.624348 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:08.624291    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:08.718905 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:08.718862    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:08.826135 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:08.826033    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:09.353779 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:09.353663    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2" event={"ID":"c744829d-f098-440b-8199-8703012ed512","Type":"ContainerStarted","Data":"d13855ae85558c9de710d64072bbb23786724f47fb0c6b2bfed7aae546c94b46"}
Jul 10 18:01:09.353779 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:09.353730    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2" event={"ID":"c744829d-f098-440b-8199-8703012ed512","Type":"ContainerStarted","Data":"08c2e9de499573fd550df8deefaf144c455ad659be873f0787685fe07f255e5a"}
Jul 10 18:01:09.353779 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:09.353750    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2" event={"ID":"c744829d-f098-440b-8199-8703012ed512","Type":"ContainerStarted","Data":"7e48c5f50a54c76d6c4ebdcfdcf10bfcddd31992de73e9e40bd2bc127f7c5cd4"}
Jul 10 18:01:09.355232 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:09.355203    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd" event={"ID":"1082a4c7-fe3b-492d-b441-1274cdcfb1ad","Type":"ContainerStarted","Data":"e24ca2a375c619baf45cae51a38e49f6ea85e3207e2b5fd6399c1fc3f5c1884c"}
Jul 10 18:01:09.355350 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:09.355301    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"
Jul 10 18:01:09.357155 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:09.357129    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd"
Jul 10 18:01:09.371857 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:09.371802    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bf59bd76-rzrwf" podStartSLOduration=5.000966759 podStartE2EDuration="8.371785935s" totalImagesPullingTime="3.370819176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:06.356173948 +0000 UTC m=+59.034441529" watchObservedRunningTime="2026-07-10 18:01:09.371785935 +0000 UTC m=+62.050053574"
Jul 10 18:01:09.372024 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:09.371886    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7dd85558-zr2h2" podStartSLOduration=1.61772011 podStartE2EDuration="8.371881289s" totalImagesPullingTime="6.754161179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:09.37123457 +0000 UTC m=+62.049502165" watchObservedRunningTime="2026-07-10 18:01:09.371881289 +0000 UTC m=+62.050148867"
Jul 10 18:01:09.385798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:09.385738    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-559db9c5-bzrsd" podStartSLOduration=1.619896107 podStartE2EDuration="8.38571805s" totalImagesPullingTime="6.765821943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:09.385649489 +0000 UTC m=+62.063917070" watchObservedRunningTime="2026-07-10 18:01:09.38571805 +0000 UTC m=+62.063985630"
Jul 10 18:01:10.250774 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:10.250740    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fqn7g"
Jul 10 18:01:10.403370 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:10.403331    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:10.504165 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:10.504066    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:10.552363 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:10.552298    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:11.716430 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:11.716393    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:11.782959 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:11.782914    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:12.331889 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.331858    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s7gsk"
Jul 10 18:01:12.595721 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.595614    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs\") pod \"network-metrics-daemon-lmwg6\" (UID: \"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed\") " pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:01:12.595721 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.595662    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:01:12.597989 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.597962    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 18:01:12.598091 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.597962    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 18:01:12.609179 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.609149    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6d991cf-1886-472c-8bde-025d82091dfd-original-pull-secret\") pod \"global-pull-secret-syncer-chhnz\" (UID: \"b6d991cf-1886-472c-8bde-025d82091dfd\") " pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:01:12.609179 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.609182    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed-metrics-certs\") pod \"network-metrics-daemon-lmwg6\" (UID: \"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed\") " pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:01:12.623226 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.623193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:12.696719 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.696665    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xvz\" (UniqueName: \"kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz\") pod \"network-check-target-b4zhd\" (UID: \"202e4b7c-3f4b-43dd-99c0-8e52a7672de7\") " pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:01:12.699163 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.699138    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 18:01:12.709762 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.709734    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 18:01:12.720257 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.720218    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6xvz\" (UniqueName: \"kubernetes.io/projected/202e4b7c-3f4b-43dd-99c0-8e52a7672de7-kube-api-access-h6xvz\") pod \"network-check-target-b4zhd\" (UID: \"202e4b7c-3f4b-43dd-99c0-8e52a7672de7\") " pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:01:12.726420 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.726392    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-25vgp\""
Jul 10 18:01:12.734703 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.734677    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:01:12.829153 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.829118    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s4tg5\""
Jul 10 18:01:12.833767 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.833732    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-chhnz"
Jul 10 18:01:12.835950 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.835920    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmwg6"
Jul 10 18:01:12.869091 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.869045    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b4zhd"]
Jul 10 18:01:12.871836 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:01:12.871729    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202e4b7c_3f4b_43dd_99c0_8e52a7672de7.slice/crio-e24e6ac54ab88b097304ca4bc322a2e8ed7e996b20b06423f500882270a2a8e1 WatchSource:0}: Error finding container e24e6ac54ab88b097304ca4bc322a2e8ed7e996b20b06423f500882270a2a8e1: Status 404 returned error can't find the container with id e24e6ac54ab88b097304ca4bc322a2e8ed7e996b20b06423f500882270a2a8e1
Jul 10 18:01:12.977248 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.977209    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-chhnz"]
Jul 10 18:01:12.981856 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:01:12.981827    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d991cf_1886_472c_8bde_025d82091dfd.slice/crio-95ba2da6d525f51d959407221a02f99ba20eb2b7d5e4fa41ae12a69d9d039257 WatchSource:0}: Error finding container 95ba2da6d525f51d959407221a02f99ba20eb2b7d5e4fa41ae12a69d9d039257: Status 404 returned error can't find the container with id 95ba2da6d525f51d959407221a02f99ba20eb2b7d5e4fa41ae12a69d9d039257
Jul 10 18:01:12.995669 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:12.995631    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lmwg6"]
Jul 10 18:01:12.998826 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:01:12.998797    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0a389a_b3ab_4c00_ac1f_fa53a4df21ed.slice/crio-54b5a4d2a5d9df10909578c3b3d36128fe2dc109dc16b86654a4687eb072cf86 WatchSource:0}: Error finding container 54b5a4d2a5d9df10909578c3b3d36128fe2dc109dc16b86654a4687eb072cf86: Status 404 returned error can't find the container with id 54b5a4d2a5d9df10909578c3b3d36128fe2dc109dc16b86654a4687eb072cf86
Jul 10 18:01:13.369985 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:13.369945    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lmwg6" event={"ID":"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed","Type":"ContainerStarted","Data":"54b5a4d2a5d9df10909578c3b3d36128fe2dc109dc16b86654a4687eb072cf86"}
Jul 10 18:01:13.371258 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:13.371225    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-chhnz" event={"ID":"b6d991cf-1886-472c-8bde-025d82091dfd","Type":"ContainerStarted","Data":"95ba2da6d525f51d959407221a02f99ba20eb2b7d5e4fa41ae12a69d9d039257"}
Jul 10 18:01:13.372433 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:13.372402    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b4zhd" event={"ID":"202e4b7c-3f4b-43dd-99c0-8e52a7672de7","Type":"ContainerStarted","Data":"e24e6ac54ab88b097304ca4bc322a2e8ed7e996b20b06423f500882270a2a8e1"}
Jul 10 18:01:14.916788 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:14.916692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:01:14.919525 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:14.919493    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba19b36b-d069-4bee-a3de-303c6b6080b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nsr6\" (UID: \"ba19b36b-d069-4bee-a3de-303c6b6080b7\") " pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:01:15.139969 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:15.139930    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pcwng\""
Jul 10 18:01:15.147925 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:15.147887    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4nsr6"
Jul 10 18:01:15.385736 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:15.385694    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lmwg6" event={"ID":"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed","Type":"ContainerStarted","Data":"64b8551cd42e364c7bfaa54638797677029add2350ae8125faec2a63774c51a0"}
Jul 10 18:01:15.385913 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:15.385762    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lmwg6" event={"ID":"2d0a389a-b3ab-4c00-ac1f-fa53a4df21ed","Type":"ContainerStarted","Data":"187f62193000da7d50a09a17171b0d4baa847efcb866a01c88823ab1ee1dbf23"}
Jul 10 18:01:15.401669 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:15.401588    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lmwg6" podStartSLOduration=65.877714466 podStartE2EDuration="1m7.401561792s" totalImagesPullingTime="1.523847326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:15.40038401 +0000 UTC m=+68.078651596" watchObservedRunningTime="2026-07-10 18:01:15.401561792 +0000 UTC m=+68.079829372"
Jul 10 18:01:15.506897 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:15.506857    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:15.563641 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:15.563530    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:15.615704 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:15.615664    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:15.935458 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:15.935419    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:17.812723 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:17.812679    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4nsr6"]
Jul 10 18:01:17.872094 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:17.872054    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:18.132370 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.132296    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:18.141235 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.141199    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n45bs"]
Jul 10 18:01:18.144991 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.144970    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.147560 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.147300    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 18:01:18.147560 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.147393    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 18:01:18.147727 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.147630    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 18:01:18.148608 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.148411    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sqvhc\""
Jul 10 18:01:18.148608 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.148455    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 18:01:18.148608 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.148413    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 18:01:18.148816 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.148682    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 18:01:18.238292 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.238193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:18.244090 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.244053    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-wtmp\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.244269 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.244107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-tls\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.244269 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.244141    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff2ec86f-f908-428b-9915-2d13a5f9351b-metrics-client-ca\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.244269 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.244179    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ff2ec86f-f908-428b-9915-2d13a5f9351b-root\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.244269 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.244204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n692\" (UniqueName: \"kubernetes.io/projected/ff2ec86f-f908-428b-9915-2d13a5f9351b-kube-api-access-7n692\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.244269 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.244250    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-textfile\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.244559 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.244277    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-accelerators-collector-config\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.244559 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.244353    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.244559 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.244421    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff2ec86f-f908-428b-9915-2d13a5f9351b-sys\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.341724 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.340437    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:18.345655 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.345598    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ff2ec86f-f908-428b-9915-2d13a5f9351b-root\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.345840 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.345658    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n692\" (UniqueName: \"kubernetes.io/projected/ff2ec86f-f908-428b-9915-2d13a5f9351b-kube-api-access-7n692\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.345840 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.345700    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-textfile\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.345840 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.345728    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-accelerators-collector-config\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.345840 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.345783    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.345840 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.345837    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff2ec86f-f908-428b-9915-2d13a5f9351b-sys\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.346078 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.345865    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-wtmp\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.346078 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.345897    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-tls\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.346078 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.345925    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff2ec86f-f908-428b-9915-2d13a5f9351b-metrics-client-ca\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.346643 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.346611    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff2ec86f-f908-428b-9915-2d13a5f9351b-metrics-client-ca\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.346750 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.346700    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ff2ec86f-f908-428b-9915-2d13a5f9351b-root\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.347260 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.347235    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-textfile\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.347795 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.347760    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-accelerators-collector-config\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.348482 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:01:18.348174    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 10 18:01:18.348482 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:01:18.348249    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-tls podName:ff2ec86f-f908-428b-9915-2d13a5f9351b nodeName:}" failed. No retries permitted until 2026-07-10 18:01:18.848225571 +0000 UTC m=+71.526493132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-tls") pod "node-exporter-n45bs" (UID: "ff2ec86f-f908-428b-9915-2d13a5f9351b") : secret "node-exporter-tls" not found
Jul 10 18:01:18.348482 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.348419    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff2ec86f-f908-428b-9915-2d13a5f9351b-sys\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.348706 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.348572    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-wtmp\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.351537 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.351506    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.360487 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.360330    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n692\" (UniqueName: \"kubernetes.io/projected/ff2ec86f-f908-428b-9915-2d13a5f9351b-kube-api-access-7n692\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.401505 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.401415    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nsr6" event={"ID":"ba19b36b-d069-4bee-a3de-303c6b6080b7","Type":"ContainerStarted","Data":"7bd956201fc1a379c5622adeb61d6bb995963a5aaeec8188b765876253f6e57b"}
Jul 10 18:01:18.404615 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.404573    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-chhnz" event={"ID":"b6d991cf-1886-472c-8bde-025d82091dfd","Type":"ContainerStarted","Data":"a4f7422b1484654fa91c727840ebb9683a03486c240eb3f03a067f51c7b657e7"}
Jul 10 18:01:18.407709 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.407672    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b4zhd" event={"ID":"202e4b7c-3f4b-43dd-99c0-8e52a7672de7","Type":"ContainerStarted","Data":"ba457a5049331c6fce4aff473ead605a8ba42b6869a252e752fae53166dd663d"}
Jul 10 18:01:18.408201 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.408160    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:01:18.429462 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.429418    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:18.438799 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.438735    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-chhnz" podStartSLOduration=65.734208438 podStartE2EDuration="1m10.438711554s" totalImagesPullingTime="4.704503116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:18.424273986 +0000 UTC m=+71.102541564" watchObservedRunningTime="2026-07-10 18:01:18.438711554 +0000 UTC m=+71.116979132"
Jul 10 18:01:18.439927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.439874    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b4zhd" podStartSLOduration=65.638421791 podStartE2EDuration="1m10.439854325s" totalImagesPullingTime="4.801432534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:18.438680059 +0000 UTC m=+71.116947661" watchObservedRunningTime="2026-07-10 18:01:18.439854325 +0000 UTC m=+71.118121904"
Jul 10 18:01:18.498331 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.494663    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:18.653381 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.653281    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:18.851243 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.851204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-tls\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:18.854598 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:18.854548    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec86f-f908-428b-9915-2d13a5f9351b-node-exporter-tls\") pod \"node-exporter-n45bs\" (UID: \"ff2ec86f-f908-428b-9915-2d13a5f9351b\") " pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:19.055503 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:19.055464    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n45bs"
Jul 10 18:01:19.069738 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:01:19.069704    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2ec86f_f908_428b_9915_2d13a5f9351b.slice/crio-64b564cb3b12df3e2c92cb48918977fe51195b050ed2c017702db7bcae2e460a WatchSource:0}: Error finding container 64b564cb3b12df3e2c92cb48918977fe51195b050ed2c017702db7bcae2e460a: Status 404 returned error can't find the container with id 64b564cb3b12df3e2c92cb48918977fe51195b050ed2c017702db7bcae2e460a
Jul 10 18:01:19.103410 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:19.103376    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:19.195106 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:19.195064    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:19.325363 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:19.325250    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:19.418513 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:19.418465    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n45bs" event={"ID":"ff2ec86f-f908-428b-9915-2d13a5f9351b","Type":"ContainerStarted","Data":"64b564cb3b12df3e2c92cb48918977fe51195b050ed2c017702db7bcae2e460a"}
Jul 10 18:01:19.419948 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:19.419895    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:20.178520 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:20.178476    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:20.280707 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:20.280600    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:21.030590 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:21.030552    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:21.131103 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:21.131057    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:21.647933 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:21.647890    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:21.697088 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:21.697057    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:22.882187 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:22.882154    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:22.980773 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:22.980677    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:23.407462 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:23.407420    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:23.435195 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:23.435165    2569 generic.go:356] "Generic (PLEG): container finished" podID="ff2ec86f-f908-428b-9915-2d13a5f9351b" containerID="d4eedfc2db20704be8188a608de870c4f9cd6c47c87f941bfddaa30a36b3ec64" exitCode=0
Jul 10 18:01:23.435412 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:23.435254    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n45bs" event={"ID":"ff2ec86f-f908-428b-9915-2d13a5f9351b","Type":"ContainerDied","Data":"d4eedfc2db20704be8188a608de870c4f9cd6c47c87f941bfddaa30a36b3ec64"}
Jul 10 18:01:23.436841 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:23.436817    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nsr6" event={"ID":"ba19b36b-d069-4bee-a3de-303c6b6080b7","Type":"ContainerStarted","Data":"0c19b07f7b2d4570871a47f44f2f3ae1ddea513e217ae3550c1074779e263c9c"}
Jul 10 18:01:23.464675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:23.464638    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:24.349616 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:24.349579    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:24.442727 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:24.442684    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n45bs" event={"ID":"ff2ec86f-f908-428b-9915-2d13a5f9351b","Type":"ContainerStarted","Data":"4993f69098add8c68623baa33895d60ce80032b6a38e297f3aaaa74e39ef5afa"}
Jul 10 18:01:24.442927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:24.442745    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n45bs" event={"ID":"ff2ec86f-f908-428b-9915-2d13a5f9351b","Type":"ContainerStarted","Data":"240fffb0c71125be20fc66f51ff81518ec783ca344ed10d05cb9c55cbdf44032"}
Jul 10 18:01:24.444605 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:24.444575    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nsr6" event={"ID":"ba19b36b-d069-4bee-a3de-303c6b6080b7","Type":"ContainerStarted","Data":"90687cb58e0ab5fc0a901c90e1fcf58d395df9e6d87a7f7acd38227bfa7056b9"}
Jul 10 18:01:24.469782 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:24.469720    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n45bs" podStartSLOduration=2.978202243 podStartE2EDuration="6.469700974s" totalImagesPullingTime="3.400358979s" totalInitContainerRuntime="91.139752ms" isStatefulPod=true podCreationTimestamp="2026-07-10 18:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:24.467891646 +0000 UTC m=+77.146159249" watchObservedRunningTime="2026-07-10 18:01:24.469700974 +0000 UTC m=+77.147968530"
Jul 10 18:01:24.505844 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:24.505782    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:24.606167 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:24.606056    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:27.458159 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:27.458125    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nsr6" event={"ID":"ba19b36b-d069-4bee-a3de-303c6b6080b7","Type":"ContainerStarted","Data":"af18d161c48db82c3ca6d4e32f72dbdc4d54cea273cb465cbd06a98e79d72f14"}
Jul 10 18:01:27.475693 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:27.475632    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4nsr6" podStartSLOduration=36.736160472 podStartE2EDuration="45.475614552s" totalImagesPullingTime="8.73945408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:00:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:01:27.474117975 +0000 UTC m=+80.152385575" watchObservedRunningTime="2026-07-10 18:01:27.475614552 +0000 UTC m=+80.153882129"
Jul 10 18:01:30.458201 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:30.458077    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:30.507943 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:30.507902    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:32.258230 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:32.258193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:32.353159 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:32.353128    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:32.452337 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:32.452274    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:32.553091 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:32.552993    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:32.912915 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:32.912817    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:32.968107 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:32.968076    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:33.157253 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:33.157221    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:33.258028 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:33.257984    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:33.357331 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:33.357273    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:33.457997 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:33.457959    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:33.715559 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:33.715477    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:33.917438 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:33.917403    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:34.124298 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:34.124266    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:34.342883 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:34.342848    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:35.343486 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:35.343446    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:35.393296 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:35.393260    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:40.118118 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:40.118084    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:40.219543 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:40.219504    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:40.335031 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:40.334988    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:40.434803 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:40.434706    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:40.538767 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:40.538735    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:42.228238 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:42.228200    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:42.329052 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:42.329013    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:48.739154 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:48.739105    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:49.420905 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:49.420873    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b4zhd"
Jul 10 18:01:50.177372 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:50.177332    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:50.231678 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:50.231644    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:52.737834 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:52.737787    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:52.794558 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:52.794524    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:53.689038 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:53.689005    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5zwmc_926b7b00-c6c9-43d2-9502-a23ed2d0ce7b/serve-healthcheck-canary/0.log"
Jul 10 18:01:57.252167 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:57.252121    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:57.352445 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:57.352400    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:57.404551 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:57.404514    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:59.575091 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:59.575056    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:01:59.631336 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:01:59.631281    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:00.962018 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:00.961974    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:01.016181 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:01.016141    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:02.765976 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:02.765937    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:02.834101 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:02.834061    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:03.155405 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:03.155291    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:03.213255 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:03.213222    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:05.176085 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:05.176043    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:05.277106 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:05.277074    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:16.719787 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:16.719746    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:20.182246 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:20.182192    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:20.245391 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:20.245354    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:30.080507 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:30.080468    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:37.320738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:37.320699    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:37.980780 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:37.980742    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:46.647257 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:46.647214    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:46.741807 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:46.741771    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:46.842890 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:46.842851    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:47.324949 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:47.324920    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:57.736411 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:57.736356    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:57.791385 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:57.791348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:02:57.845954 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:02:57.845909    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:23.739824 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:03:23.739775    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:23.793291 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:03:23.793262    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:52.559204 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:03:52.559168    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:03:52.617396 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:03:52.617362    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:02.770193 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:04:02.770152    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:02.931503 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:04:02.931468    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:03.010379 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:04:03.010338    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:03.510205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:04:03.510170    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:03.558770 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:04:03.558729    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:04.534192 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:04:04.534150    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:04.585773 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:04:04.585739    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:14.072821 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:04:14.072785    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:14.173373 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:04:14.173342    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:14.230444 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:04:14.230402    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:20.187581 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:04:20.187542    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:20.289050 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:04:20.289012    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:04:50.450833 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:04:50.450788    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:07.761443 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:07.761414    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:05:07.766371 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:07.766346    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 18:05:07.768826 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:07.768804    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:05:10.707577 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:10.707542    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:12.137175 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:12.137131    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:32.261549 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:32.261498    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:33.030443 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:33.030403    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:35.868486 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:35.868444    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:35.966660 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:35.966611    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:37.646603 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:37.646570    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:37.765453 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:37.765414    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:37.872326 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:37.872269    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:40.333454 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:40.333415    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:40.547058 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:40.547025    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:42.651251 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:42.651217    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:42.751078 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:42.751046    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:45.525098 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:45.525064    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:45.643937 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:45.643893    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:47.360130 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:47.360091    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:49.071019 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:49.070978    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:49.170424 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:49.170384    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:51.082339 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.082291    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl"]
Jul 10 18:05:51.084230 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.084210    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl"
Jul 10 18:05:51.086451 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.086427    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 18:05:51.087304 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.087287    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vgmf4\""
Jul 10 18:05:51.087409 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.087288    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:05:51.095342 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.095289    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl"]
Jul 10 18:05:51.217484 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.217447    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af7ad199-d5d7-430f-b4c8-6c76976b965c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ffhzl\" (UID: \"af7ad199-d5d7-430f-b4c8-6c76976b965c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl"
Jul 10 18:05:51.217674 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.217494    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6nl9\" (UniqueName: \"kubernetes.io/projected/af7ad199-d5d7-430f-b4c8-6c76976b965c-kube-api-access-p6nl9\") pod \"openshift-lws-operator-fd8ccff4c-ffhzl\" (UID: \"af7ad199-d5d7-430f-b4c8-6c76976b965c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl"
Jul 10 18:05:51.317937 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.317903    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af7ad199-d5d7-430f-b4c8-6c76976b965c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ffhzl\" (UID: \"af7ad199-d5d7-430f-b4c8-6c76976b965c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl"
Jul 10 18:05:51.318116 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.317965    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6nl9\" (UniqueName: \"kubernetes.io/projected/af7ad199-d5d7-430f-b4c8-6c76976b965c-kube-api-access-p6nl9\") pod \"openshift-lws-operator-fd8ccff4c-ffhzl\" (UID: \"af7ad199-d5d7-430f-b4c8-6c76976b965c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl"
Jul 10 18:05:51.318329 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.318292    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af7ad199-d5d7-430f-b4c8-6c76976b965c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ffhzl\" (UID: \"af7ad199-d5d7-430f-b4c8-6c76976b965c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl"
Jul 10 18:05:51.326218 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.326188    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6nl9\" (UniqueName: \"kubernetes.io/projected/af7ad199-d5d7-430f-b4c8-6c76976b965c-kube-api-access-p6nl9\") pod \"openshift-lws-operator-fd8ccff4c-ffhzl\" (UID: \"af7ad199-d5d7-430f-b4c8-6c76976b965c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl"
Jul 10 18:05:51.392686 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.392586    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl"
Jul 10 18:05:51.523878 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.523844    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl"]
Jul 10 18:05:51.527630 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:05:51.527600    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf7ad199_d5d7_430f_b4c8_6c76976b965c.slice/crio-228edfd07354ef26aaaa937e99cb83b2b75c59ed41cf569bf0a6efe88a628bf3 WatchSource:0}: Error finding container 228edfd07354ef26aaaa937e99cb83b2b75c59ed41cf569bf0a6efe88a628bf3: Status 404 returned error can't find the container with id 228edfd07354ef26aaaa937e99cb83b2b75c59ed41cf569bf0a6efe88a628bf3
Jul 10 18:05:51.529633 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:51.529615    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:05:52.326977 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:52.326903    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl" event={"ID":"af7ad199-d5d7-430f-b4c8-6c76976b965c","Type":"ContainerStarted","Data":"228edfd07354ef26aaaa937e99cb83b2b75c59ed41cf569bf0a6efe88a628bf3"}
Jul 10 18:05:54.336143 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:54.336098    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl" event={"ID":"af7ad199-d5d7-430f-b4c8-6c76976b965c","Type":"ContainerStarted","Data":"b804361d44b6bb9dd38cc05adfec1daa2135e392e1cdee37ae04e04db1d7bab0"}
Jul 10 18:05:54.351671 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:54.351568    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ffhzl" podStartSLOduration=0.785916704 podStartE2EDuration="3.351547717s" totalImagesPullingTime="2.565631013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:05:54.350451536 +0000 UTC m=+347.028719115" watchObservedRunningTime="2026-07-10 18:05:54.351547717 +0000 UTC m=+347.029815294"
Jul 10 18:05:55.172548 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:55.172498    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:55.272505 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:55.272468    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:05:57.293923 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:05:57.293880    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:09.876914 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:09.876826    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:09.971116 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:09.971079    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:10.481372 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.481328    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:10.662882 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.662846    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:10.762288 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.762224    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:10.792348 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.792296    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"]
Jul 10 18:06:10.797653 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.797621    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.800599 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.800570    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 18:06:10.800759 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.800648    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 18:06:10.800861 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.800844    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 18:06:10.800922 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.800901    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8cfxm\""
Jul 10 18:06:10.800974 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.800952    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 18:06:10.817046 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.817010    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"]
Jul 10 18:06:10.868155 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.868118    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-tmp\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.868155 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.868164    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-manifests\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.868410 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.868189    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.868410 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.868235    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.868410 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.868286    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4crf2\" (UniqueName: \"kubernetes.io/projected/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-kube-api-access-4crf2\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.969622 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.969575    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4crf2\" (UniqueName: \"kubernetes.io/projected/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-kube-api-access-4crf2\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.970024 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.969659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-tmp\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.970024 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.969702    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-manifests\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.970024 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.969738    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.970024 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.969769    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.970158 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.970136    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-manifests\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.972186 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.972162    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.972453 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.972432    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-tmp\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.972568 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.972551    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:10.983031 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.982998    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:10.983202 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:10.983040    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4crf2\" (UniqueName: \"kubernetes.io/projected/97d0ccc3-62a0-4d68-8017-2d6f11607d2f-kube-api-access-4crf2\") pod \"opendatahub-operator-controller-manager-bb6dcc87f-kmh86\" (UID: \"97d0ccc3-62a0-4d68-8017-2d6f11607d2f\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:11.082917 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:11.082821    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:11.108887 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:11.108851    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:11.182498 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:11.182458    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:11.250568 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:11.250531    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"]
Jul 10 18:06:11.253072 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:11.253046    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:11.254873 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:06:11.254848    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d0ccc3_62a0_4d68_8017_2d6f11607d2f.slice/crio-7e3ecf7e475aaaaccc438b1518c8428ad4d67d381cb1101be3c68ed2f2adf4b7 WatchSource:0}: Error finding container 7e3ecf7e475aaaaccc438b1518c8428ad4d67d381cb1101be3c68ed2f2adf4b7: Status 404 returned error can't find the container with id 7e3ecf7e475aaaaccc438b1518c8428ad4d67d381cb1101be3c68ed2f2adf4b7
Jul 10 18:06:11.335612 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:11.335520    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:11.393260 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:11.393225    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86" event={"ID":"97d0ccc3-62a0-4d68-8017-2d6f11607d2f","Type":"ContainerStarted","Data":"7e3ecf7e475aaaaccc438b1518c8428ad4d67d381cb1101be3c68ed2f2adf4b7"}
Jul 10 18:06:11.443499 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:11.443460    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:15.414565 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:15.414523    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86" event={"ID":"97d0ccc3-62a0-4d68-8017-2d6f11607d2f","Type":"ContainerStarted","Data":"c70c715332ab1212f7e8a24a890c9d49ae5840c59fa3887200b53ac31cdf3d7c"}
Jul 10 18:06:16.420239 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:16.420200    2569 generic.go:356] "Generic (PLEG): container finished" podID="97d0ccc3-62a0-4d68-8017-2d6f11607d2f" containerID="c70c715332ab1212f7e8a24a890c9d49ae5840c59fa3887200b53ac31cdf3d7c" exitCode=0
Jul 10 18:06:16.420739 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:16.420277    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86" event={"ID":"97d0ccc3-62a0-4d68-8017-2d6f11607d2f","Type":"ContainerDied","Data":"c70c715332ab1212f7e8a24a890c9d49ae5840c59fa3887200b53ac31cdf3d7c"}
Jul 10 18:06:17.426099 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:17.426002    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86" event={"ID":"97d0ccc3-62a0-4d68-8017-2d6f11607d2f","Type":"ContainerStarted","Data":"4af8fd6bd45cee41823a241a7682694de440f80c8464ef7dbe1d4313b9ac98a6"}
Jul 10 18:06:17.426550 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:17.426129    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:17.454695 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:17.454636    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86" podStartSLOduration=2.439487771 podStartE2EDuration="7.454617789s" totalImagesPullingTime="3.982430328s" totalInitContainerRuntime="1.03269969s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:06:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:06:17.453464451 +0000 UTC m=+370.131732054" watchObservedRunningTime="2026-07-10 18:06:17.454617789 +0000 UTC m=+370.132885367"
Jul 10 18:06:21.698074 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:21.698029    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:21.786532 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:21.786502    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:21.890580 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:21.890541    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:22.013334 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:22.013273    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:22.114885 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:22.114854    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:23.510154 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:23.510125    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:23.618106 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:23.618059    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:28.433797 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:28.433764    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bb6dcc87f-kmh86"
Jul 10 18:06:31.254329 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.254277    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:31.350948 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.350904    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:31.553083 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.552982    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:31.588576 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.588545    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"]
Jul 10 18:06:31.591574 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.591549    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"
Jul 10 18:06:31.594085 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.594052    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 18:06:31.594232 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.594156    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-f5plj\""
Jul 10 18:06:31.594929 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.594904    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 18:06:31.595058 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.594910    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 18:06:31.595058 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.594980    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 18:06:31.606823 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.606792    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"]
Jul 10 18:06:31.731260 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.731216    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7f25ac-1be2-4181-859d-420992c69349-tls-certs\") pod \"kube-auth-proxy-5486d894ff-jn5ch\" (UID: \"9f7f25ac-1be2-4181-859d-420992c69349\") " pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"
Jul 10 18:06:31.731260 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.731264    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwctd\" (UniqueName: \"kubernetes.io/projected/9f7f25ac-1be2-4181-859d-420992c69349-kube-api-access-wwctd\") pod \"kube-auth-proxy-5486d894ff-jn5ch\" (UID: \"9f7f25ac-1be2-4181-859d-420992c69349\") " pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"
Jul 10 18:06:31.731517 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.731292    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f7f25ac-1be2-4181-859d-420992c69349-tmp\") pod \"kube-auth-proxy-5486d894ff-jn5ch\" (UID: \"9f7f25ac-1be2-4181-859d-420992c69349\") " pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"
Jul 10 18:06:31.783468 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.783431    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:31.832428 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.832345    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7f25ac-1be2-4181-859d-420992c69349-tls-certs\") pod \"kube-auth-proxy-5486d894ff-jn5ch\" (UID: \"9f7f25ac-1be2-4181-859d-420992c69349\") " pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"
Jul 10 18:06:31.832428 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.832396    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwctd\" (UniqueName: \"kubernetes.io/projected/9f7f25ac-1be2-4181-859d-420992c69349-kube-api-access-wwctd\") pod \"kube-auth-proxy-5486d894ff-jn5ch\" (UID: \"9f7f25ac-1be2-4181-859d-420992c69349\") " pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"
Jul 10 18:06:31.832428 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.832424    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f7f25ac-1be2-4181-859d-420992c69349-tmp\") pod \"kube-auth-proxy-5486d894ff-jn5ch\" (UID: \"9f7f25ac-1be2-4181-859d-420992c69349\") " pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"
Jul 10 18:06:31.834820 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.834795    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f7f25ac-1be2-4181-859d-420992c69349-tmp\") pod \"kube-auth-proxy-5486d894ff-jn5ch\" (UID: \"9f7f25ac-1be2-4181-859d-420992c69349\") " pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"
Jul 10 18:06:31.834925 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.834911    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7f25ac-1be2-4181-859d-420992c69349-tls-certs\") pod \"kube-auth-proxy-5486d894ff-jn5ch\" (UID: \"9f7f25ac-1be2-4181-859d-420992c69349\") " pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"
Jul 10 18:06:31.840272 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.840243    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwctd\" (UniqueName: \"kubernetes.io/projected/9f7f25ac-1be2-4181-859d-420992c69349-kube-api-access-wwctd\") pod \"kube-auth-proxy-5486d894ff-jn5ch\" (UID: \"9f7f25ac-1be2-4181-859d-420992c69349\") " pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"
Jul 10 18:06:31.902031 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:31.901989    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"
Jul 10 18:06:32.037352 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.037289    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch"]
Jul 10 18:06:32.041452 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:06:32.041422    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f7f25ac_1be2_4181_859d_420992c69349.slice/crio-dcb2286eed08158c37417b31e124ddd1f83cf2c280d6dadc5f9539c0c5211bca WatchSource:0}: Error finding container dcb2286eed08158c37417b31e124ddd1f83cf2c280d6dadc5f9539c0c5211bca: Status 404 returned error can't find the container with id dcb2286eed08158c37417b31e124ddd1f83cf2c280d6dadc5f9539c0c5211bca
Jul 10 18:06:32.485459 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.485421    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch" event={"ID":"9f7f25ac-1be2-4181-859d-420992c69349","Type":"ContainerStarted","Data":"dcb2286eed08158c37417b31e124ddd1f83cf2c280d6dadc5f9539c0c5211bca"}
Jul 10 18:06:32.570199 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.570161    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f42d8"]
Jul 10 18:06:32.576560 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.576526    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-f42d8"
Jul 10 18:06:32.579176 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.579139    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 10 18:06:32.579345 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.579140    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6dwtv\""
Jul 10 18:06:32.584381 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.584292    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f42d8"]
Jul 10 18:06:32.615227 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.615196    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:32.639883 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.639842    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae7a77d0-3c7c-49ef-91dd-09303896c369-cert\") pod \"odh-model-controller-7998c67dc4-f42d8\" (UID: \"ae7a77d0-3c7c-49ef-91dd-09303896c369\") " pod="opendatahub/odh-model-controller-7998c67dc4-f42d8"
Jul 10 18:06:32.639883 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.639884    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z9df\" (UniqueName: \"kubernetes.io/projected/ae7a77d0-3c7c-49ef-91dd-09303896c369-kube-api-access-7z9df\") pod \"odh-model-controller-7998c67dc4-f42d8\" (UID: \"ae7a77d0-3c7c-49ef-91dd-09303896c369\") " pod="opendatahub/odh-model-controller-7998c67dc4-f42d8"
Jul 10 18:06:32.691488 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.691449    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:32.740968 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.740865    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae7a77d0-3c7c-49ef-91dd-09303896c369-cert\") pod \"odh-model-controller-7998c67dc4-f42d8\" (UID: \"ae7a77d0-3c7c-49ef-91dd-09303896c369\") " pod="opendatahub/odh-model-controller-7998c67dc4-f42d8"
Jul 10 18:06:32.740968 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.740909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z9df\" (UniqueName: \"kubernetes.io/projected/ae7a77d0-3c7c-49ef-91dd-09303896c369-kube-api-access-7z9df\") pod \"odh-model-controller-7998c67dc4-f42d8\" (UID: \"ae7a77d0-3c7c-49ef-91dd-09303896c369\") " pod="opendatahub/odh-model-controller-7998c67dc4-f42d8"
Jul 10 18:06:32.741184 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:06:32.741020    2569 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 10 18:06:32.741184 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:06:32.741101    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae7a77d0-3c7c-49ef-91dd-09303896c369-cert podName:ae7a77d0-3c7c-49ef-91dd-09303896c369 nodeName:}" failed. No retries permitted until 2026-07-10 18:06:33.241078659 +0000 UTC m=+385.919346215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ae7a77d0-3c7c-49ef-91dd-09303896c369-cert") pod "odh-model-controller-7998c67dc4-f42d8" (UID: "ae7a77d0-3c7c-49ef-91dd-09303896c369") : secret "odh-model-controller-webhook-cert" not found
Jul 10 18:06:32.750190 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.750151    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z9df\" (UniqueName: \"kubernetes.io/projected/ae7a77d0-3c7c-49ef-91dd-09303896c369-kube-api-access-7z9df\") pod \"odh-model-controller-7998c67dc4-f42d8\" (UID: \"ae7a77d0-3c7c-49ef-91dd-09303896c369\") " pod="opendatahub/odh-model-controller-7998c67dc4-f42d8"
Jul 10 18:06:32.860160 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.860126    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-npxww"]
Jul 10 18:06:32.863791 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.863760    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:32.866038 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.866000    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 10 18:06:32.866203 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.866130    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 18:06:32.866203 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.866151    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bf92w\""
Jul 10 18:06:32.866203 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.866133    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 10 18:06:32.866203 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.866191    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 10 18:06:32.875223 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.875190    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-npxww"]
Jul 10 18:06:32.943366 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.943325    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-token\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:32.943603 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.943382    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:32.943603 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.943411    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:32.943603 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.943504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f58vj\" (UniqueName: \"kubernetes.io/projected/bd96015b-ff79-4ca9-973c-27c5c152e6ed-kube-api-access-f58vj\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:32.943603 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.943571    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-cacerts\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:32.943603 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.943602    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:32.943892 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:32.943650    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd96015b-ff79-4ca9-973c-27c5c152e6ed-local-certs\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.044737 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.044625    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-cacerts\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.044737 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.044681    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.045011 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.044826    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd96015b-ff79-4ca9-973c-27c5c152e6ed-local-certs\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.045011 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.044870    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-token\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.045011 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.044900    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.045011 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.044932    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.045011 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.044983    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f58vj\" (UniqueName: \"kubernetes.io/projected/bd96015b-ff79-4ca9-973c-27c5c152e6ed-kube-api-access-f58vj\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.045964 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.045782    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.048027 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.048003    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.048148 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.048069    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-cacerts\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.048148 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.048133    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.048812 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.048786    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd96015b-ff79-4ca9-973c-27c5c152e6ed-local-certs\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.053928 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.053890    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-token\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.054199 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.054176    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f58vj\" (UniqueName: \"kubernetes.io/projected/bd96015b-ff79-4ca9-973c-27c5c152e6ed-kube-api-access-f58vj\") pod \"istiod-openshift-gateway-7574459656-npxww\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.174398 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.174365    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:33.237503 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.237453    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:33.246724 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.246626    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae7a77d0-3c7c-49ef-91dd-09303896c369-cert\") pod \"odh-model-controller-7998c67dc4-f42d8\" (UID: \"ae7a77d0-3c7c-49ef-91dd-09303896c369\") " pod="opendatahub/odh-model-controller-7998c67dc4-f42d8"
Jul 10 18:06:33.253264 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.253229    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae7a77d0-3c7c-49ef-91dd-09303896c369-cert\") pod \"odh-model-controller-7998c67dc4-f42d8\" (UID: \"ae7a77d0-3c7c-49ef-91dd-09303896c369\") " pod="opendatahub/odh-model-controller-7998c67dc4-f42d8"
Jul 10 18:06:33.306345 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.306239    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:33.341691 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.341613    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-npxww"]
Jul 10 18:06:33.344914 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:06:33.344868    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd96015b_ff79_4ca9_973c_27c5c152e6ed.slice/crio-ea37c092ceefb679725a2332403b84ac3ef1a3d94e03c6b29a42164ed3c5716e WatchSource:0}: Error finding container ea37c092ceefb679725a2332403b84ac3ef1a3d94e03c6b29a42164ed3c5716e: Status 404 returned error can't find the container with id ea37c092ceefb679725a2332403b84ac3ef1a3d94e03c6b29a42164ed3c5716e
Jul 10 18:06:33.488381 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.488348    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-f42d8"
Jul 10 18:06:33.490504 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.490467    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww" event={"ID":"bd96015b-ff79-4ca9-973c-27c5c152e6ed","Type":"ContainerStarted","Data":"ea37c092ceefb679725a2332403b84ac3ef1a3d94e03c6b29a42164ed3c5716e"}
Jul 10 18:06:33.501985 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.501946    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:33.631171 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.630955    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f42d8"]
Jul 10 18:06:33.634113 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:06:33.634080    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7a77d0_3c7c_49ef_91dd_09303896c369.slice/crio-82cdbc3ef6ebbfcb18ffc3c89dfff1bfbd598c68d5b294978de859070d91719a WatchSource:0}: Error finding container 82cdbc3ef6ebbfcb18ffc3c89dfff1bfbd598c68d5b294978de859070d91719a: Status 404 returned error can't find the container with id 82cdbc3ef6ebbfcb18ffc3c89dfff1bfbd598c68d5b294978de859070d91719a
Jul 10 18:06:33.851933 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:33.851795    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:34.496984 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:34.496937    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-f42d8" event={"ID":"ae7a77d0-3c7c-49ef-91dd-09303896c369","Type":"ContainerStarted","Data":"82cdbc3ef6ebbfcb18ffc3c89dfff1bfbd598c68d5b294978de859070d91719a"}
Jul 10 18:06:37.616731 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:37.611213    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 18:06:37.616731 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:37.611671    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 18:06:38.507835 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:38.507794    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:38.517105 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:38.517069    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww" event={"ID":"bd96015b-ff79-4ca9-973c-27c5c152e6ed","Type":"ContainerStarted","Data":"7b47dc44edf7a40712e58b3d43bf5cbf8e183219cfea88d3b975c7a98dc4f599"}
Jul 10 18:06:38.517359 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:38.517263    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:38.519430 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:38.519349    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch" event={"ID":"9f7f25ac-1be2-4181-859d-420992c69349","Type":"ContainerStarted","Data":"4e4e9ad58239b3e4f3ceb9aa8c486eb56d66b3c28975a2e83720a1c47e04bd5c"}
Jul 10 18:06:38.519586 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:38.519451    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-npxww container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 10 18:06:38.519586 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:38.519504    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww" podUID="bd96015b-ff79-4ca9-973c-27c5c152e6ed" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 18:06:38.522002 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:38.521964    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-f42d8" event={"ID":"ae7a77d0-3c7c-49ef-91dd-09303896c369","Type":"ContainerStarted","Data":"147cd0683e9c9c4c702780898f2e47ef285e784cdbb9a03cfedf87b9cf67ef79"}
Jul 10 18:06:38.522163 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:38.522103    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-f42d8"
Jul 10 18:06:38.551646 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:38.551584    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww" podStartSLOduration=2.288250889 podStartE2EDuration="6.551563932s" totalImagesPullingTime="4.263313043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:06:38.549351879 +0000 UTC m=+391.227619453" watchObservedRunningTime="2026-07-10 18:06:38.551563932 +0000 UTC m=+391.229831509"
Jul 10 18:06:38.584009 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:38.583744    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5486d894ff-jn5ch" podStartSLOduration=2.00895365 podStartE2EDuration="7.583721721s" totalImagesPullingTime="5.574768071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:06:38.583405419 +0000 UTC m=+391.261673005" watchObservedRunningTime="2026-07-10 18:06:38.583721721 +0000 UTC m=+391.261989300"
Jul 10 18:06:38.618165 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:38.618123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:39.334053 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:39.334005    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:39.526634 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:39.526605    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:39.564656 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:39.564609    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:39.573799 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:39.573745    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-f42d8" podStartSLOduration=3.58661167 podStartE2EDuration="7.573727832s" totalImagesPullingTime="3.987116162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:06:38.616792711 +0000 UTC m=+391.295060291" watchObservedRunningTime="2026-07-10 18:06:39.573727832 +0000 UTC m=+392.251995409"
Jul 10 18:06:39.991151 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:39.991117    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:42.121098 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.121059    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:42.170704 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.170667    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr"]
Jul 10 18:06:42.173942 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.173913    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr"
Jul 10 18:06:42.176296 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.176261    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 10 18:06:42.176488 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.176333    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dtxfc\""
Jul 10 18:06:42.183407 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.182459    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"]
Jul 10 18:06:42.185972 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.185944    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr"]
Jul 10 18:06:42.186212 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.186055    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"
Jul 10 18:06:42.189279 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.189252    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 10 18:06:42.189451 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.189395    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-v9kbg\""
Jul 10 18:06:42.196160 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.196115    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"]
Jul 10 18:06:42.201564 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.201526    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:42.210747 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.210699    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng48g\" (UniqueName: \"kubernetes.io/projected/cf0e6f18-bc97-445e-8bc4-e86fe2e993fb-kube-api-access-ng48g\") pod \"kserve-controller-manager-d6f4b65b8-z8mvr\" (UID: \"cf0e6f18-bc97-445e-8bc4-e86fe2e993fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr"
Jul 10 18:06:42.210947 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.210796    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e958321-d88a-48c1-a80c-787d50044743-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6bzd5\" (UID: \"4e958321-d88a-48c1-a80c-787d50044743\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"
Jul 10 18:06:42.210947 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.210836    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqlbz\" (UniqueName: \"kubernetes.io/projected/4e958321-d88a-48c1-a80c-787d50044743-kube-api-access-kqlbz\") pod \"llmisvc-controller-manager-777c6bd7d5-6bzd5\" (UID: \"4e958321-d88a-48c1-a80c-787d50044743\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"
Jul 10 18:06:42.210947 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.210873    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf0e6f18-bc97-445e-8bc4-e86fe2e993fb-cert\") pod \"kserve-controller-manager-d6f4b65b8-z8mvr\" (UID: \"cf0e6f18-bc97-445e-8bc4-e86fe2e993fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr"
Jul 10 18:06:42.311480 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.311437    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng48g\" (UniqueName: \"kubernetes.io/projected/cf0e6f18-bc97-445e-8bc4-e86fe2e993fb-kube-api-access-ng48g\") pod \"kserve-controller-manager-d6f4b65b8-z8mvr\" (UID: \"cf0e6f18-bc97-445e-8bc4-e86fe2e993fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr"
Jul 10 18:06:42.311675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.311500    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e958321-d88a-48c1-a80c-787d50044743-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6bzd5\" (UID: \"4e958321-d88a-48c1-a80c-787d50044743\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"
Jul 10 18:06:42.311675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.311526    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqlbz\" (UniqueName: \"kubernetes.io/projected/4e958321-d88a-48c1-a80c-787d50044743-kube-api-access-kqlbz\") pod \"llmisvc-controller-manager-777c6bd7d5-6bzd5\" (UID: \"4e958321-d88a-48c1-a80c-787d50044743\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"
Jul 10 18:06:42.311675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.311554    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf0e6f18-bc97-445e-8bc4-e86fe2e993fb-cert\") pod \"kserve-controller-manager-d6f4b65b8-z8mvr\" (UID: \"cf0e6f18-bc97-445e-8bc4-e86fe2e993fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr"
Jul 10 18:06:42.311675 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:06:42.311646    2569 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 10 18:06:42.311829 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:06:42.311729    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e958321-d88a-48c1-a80c-787d50044743-cert podName:4e958321-d88a-48c1-a80c-787d50044743 nodeName:}" failed. No retries permitted until 2026-07-10 18:06:42.81170659 +0000 UTC m=+395.489974152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4e958321-d88a-48c1-a80c-787d50044743-cert") pod "llmisvc-controller-manager-777c6bd7d5-6bzd5" (UID: "4e958321-d88a-48c1-a80c-787d50044743") : secret "llmisvc-webhook-server-cert" not found
Jul 10 18:06:42.314215 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.314184    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf0e6f18-bc97-445e-8bc4-e86fe2e993fb-cert\") pod \"kserve-controller-manager-d6f4b65b8-z8mvr\" (UID: \"cf0e6f18-bc97-445e-8bc4-e86fe2e993fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr"
Jul 10 18:06:42.317839 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.317797    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:42.322277 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.322242    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng48g\" (UniqueName: \"kubernetes.io/projected/cf0e6f18-bc97-445e-8bc4-e86fe2e993fb-kube-api-access-ng48g\") pod \"kserve-controller-manager-d6f4b65b8-z8mvr\" (UID: \"cf0e6f18-bc97-445e-8bc4-e86fe2e993fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr"
Jul 10 18:06:42.323836 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.323813    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqlbz\" (UniqueName: \"kubernetes.io/projected/4e958321-d88a-48c1-a80c-787d50044743-kube-api-access-kqlbz\") pod \"llmisvc-controller-manager-777c6bd7d5-6bzd5\" (UID: \"4e958321-d88a-48c1-a80c-787d50044743\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"
Jul 10 18:06:42.456042 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.455931    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:42.487891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.487848    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr"
Jul 10 18:06:42.630387 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.630341    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr"]
Jul 10 18:06:42.633571 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:06:42.633544    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0e6f18_bc97_445e_8bc4_e86fe2e993fb.slice/crio-c6651904ad311853164983cd0414f1489f039b40289824388862c12959d4fa98 WatchSource:0}: Error finding container c6651904ad311853164983cd0414f1489f039b40289824388862c12959d4fa98: Status 404 returned error can't find the container with id c6651904ad311853164983cd0414f1489f039b40289824388862c12959d4fa98
Jul 10 18:06:42.816178 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.816134    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e958321-d88a-48c1-a80c-787d50044743-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6bzd5\" (UID: \"4e958321-d88a-48c1-a80c-787d50044743\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"
Jul 10 18:06:42.818660 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:42.818638    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e958321-d88a-48c1-a80c-787d50044743-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6bzd5\" (UID: \"4e958321-d88a-48c1-a80c-787d50044743\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"
Jul 10 18:06:43.100864 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:43.100768    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"
Jul 10 18:06:43.249783 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:43.249753    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"]
Jul 10 18:06:43.253071 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:06:43.253027    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4e958321_d88a_48c1_a80c_787d50044743.slice/crio-9d89842436e63c8b7438d791456c4ac439182f1d2111439d3d2fbcd4699bf101 WatchSource:0}: Error finding container 9d89842436e63c8b7438d791456c4ac439182f1d2111439d3d2fbcd4699bf101: Status 404 returned error can't find the container with id 9d89842436e63c8b7438d791456c4ac439182f1d2111439d3d2fbcd4699bf101
Jul 10 18:06:43.453270 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:43.453158    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:43.538660 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:43.538610    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:43.542889 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:43.542856    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5" event={"ID":"4e958321-d88a-48c1-a80c-787d50044743","Type":"ContainerStarted","Data":"9d89842436e63c8b7438d791456c4ac439182f1d2111439d3d2fbcd4699bf101"}
Jul 10 18:06:43.544014 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:43.543987    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr" event={"ID":"cf0e6f18-bc97-445e-8bc4-e86fe2e993fb","Type":"ContainerStarted","Data":"c6651904ad311853164983cd0414f1489f039b40289824388862c12959d4fa98"}
Jul 10 18:06:44.490674 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:44.490631    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:44.544908 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:44.544850    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:06:44.692462 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:44.692427    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-npxww"]
Jul 10 18:06:44.692672 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:44.692647    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww" podUID="bd96015b-ff79-4ca9-973c-27c5c152e6ed" containerName="discovery" containerID="cri-o://7b47dc44edf7a40712e58b3d43bf5cbf8e183219cfea88d3b975c7a98dc4f599" gracePeriod=30
Jul 10 18:06:45.531272 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.531236    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:45.537409 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.537370    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd96015b-ff79-4ca9-973c-27c5c152e6ed-local-certs\") pod \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") "
Jul 10 18:06:45.537601 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.537432    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-csr-dns-cert\") pod \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") "
Jul 10 18:06:45.537601 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.537469    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-csr-ca-configmap\") pod \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") "
Jul 10 18:06:45.537601 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.537537    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f58vj\" (UniqueName: \"kubernetes.io/projected/bd96015b-ff79-4ca9-973c-27c5c152e6ed-kube-api-access-f58vj\") pod \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") "
Jul 10 18:06:45.537777 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.537671    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-token\") pod \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") "
Jul 10 18:06:45.537777 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.537717    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-cacerts\") pod \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") "
Jul 10 18:06:45.537777 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.537752    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-kubeconfig\") pod \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\" (UID: \"bd96015b-ff79-4ca9-973c-27c5c152e6ed\") "
Jul 10 18:06:45.537932 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.537879    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "bd96015b-ff79-4ca9-973c-27c5c152e6ed" (UID: "bd96015b-ff79-4ca9-973c-27c5c152e6ed"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:06:45.538360 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.538008    2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-csr-ca-configmap\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:06:45.540372 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.540337    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-cacerts" (OuterVolumeSpecName: "cacerts") pod "bd96015b-ff79-4ca9-973c-27c5c152e6ed" (UID: "bd96015b-ff79-4ca9-973c-27c5c152e6ed"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:06:45.540482 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.540348    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "bd96015b-ff79-4ca9-973c-27c5c152e6ed" (UID: "bd96015b-ff79-4ca9-973c-27c5c152e6ed"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:06:45.540482 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.540402    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd96015b-ff79-4ca9-973c-27c5c152e6ed-kube-api-access-f58vj" (OuterVolumeSpecName: "kube-api-access-f58vj") pod "bd96015b-ff79-4ca9-973c-27c5c152e6ed" (UID: "bd96015b-ff79-4ca9-973c-27c5c152e6ed"). InnerVolumeSpecName "kube-api-access-f58vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:06:45.540574 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.540476    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "bd96015b-ff79-4ca9-973c-27c5c152e6ed" (UID: "bd96015b-ff79-4ca9-973c-27c5c152e6ed"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:06:45.540678 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.540658    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd96015b-ff79-4ca9-973c-27c5c152e6ed-local-certs" (OuterVolumeSpecName: "local-certs") pod "bd96015b-ff79-4ca9-973c-27c5c152e6ed" (UID: "bd96015b-ff79-4ca9-973c-27c5c152e6ed"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:06:45.541378 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.541355    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "bd96015b-ff79-4ca9-973c-27c5c152e6ed" (UID: "bd96015b-ff79-4ca9-973c-27c5c152e6ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:06:45.554410 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.554358    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr" event={"ID":"cf0e6f18-bc97-445e-8bc4-e86fe2e993fb","Type":"ContainerStarted","Data":"8c19d35be341af343f7ae31b1277481a86b0c22092d8c12e06816199857b102d"}
Jul 10 18:06:45.554607 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.554444    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr"
Jul 10 18:06:45.556487 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.556453    2569 generic.go:356] "Generic (PLEG): container finished" podID="bd96015b-ff79-4ca9-973c-27c5c152e6ed" containerID="7b47dc44edf7a40712e58b3d43bf5cbf8e183219cfea88d3b975c7a98dc4f599" exitCode=0
Jul 10 18:06:45.556675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.556509    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww"
Jul 10 18:06:45.556675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.556517    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww" event={"ID":"bd96015b-ff79-4ca9-973c-27c5c152e6ed","Type":"ContainerDied","Data":"7b47dc44edf7a40712e58b3d43bf5cbf8e183219cfea88d3b975c7a98dc4f599"}
Jul 10 18:06:45.556675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.556571    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww" event={"ID":"bd96015b-ff79-4ca9-973c-27c5c152e6ed","Type":"ContainerDied","Data":"ea37c092ceefb679725a2332403b84ac3ef1a3d94e03c6b29a42164ed3c5716e"}
Jul 10 18:06:45.556675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.556600    2569 scope.go:117] "RemoveContainer" containerID="7b47dc44edf7a40712e58b3d43bf5cbf8e183219cfea88d3b975c7a98dc4f599"
Jul 10 18:06:45.566265 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.566240    2569 scope.go:117] "RemoveContainer" containerID="7b47dc44edf7a40712e58b3d43bf5cbf8e183219cfea88d3b975c7a98dc4f599"
Jul 10 18:06:45.566733 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:06:45.566709    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b47dc44edf7a40712e58b3d43bf5cbf8e183219cfea88d3b975c7a98dc4f599\": container with ID starting with 7b47dc44edf7a40712e58b3d43bf5cbf8e183219cfea88d3b975c7a98dc4f599 not found: ID does not exist" containerID="7b47dc44edf7a40712e58b3d43bf5cbf8e183219cfea88d3b975c7a98dc4f599"
Jul 10 18:06:45.566826 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.566744    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b47dc44edf7a40712e58b3d43bf5cbf8e183219cfea88d3b975c7a98dc4f599"} err="failed to get container status \"7b47dc44edf7a40712e58b3d43bf5cbf8e183219cfea88d3b975c7a98dc4f599\": rpc error: code = NotFound desc = could not find container \"7b47dc44edf7a40712e58b3d43bf5cbf8e183219cfea88d3b975c7a98dc4f599\": container with ID starting with 7b47dc44edf7a40712e58b3d43bf5cbf8e183219cfea88d3b975c7a98dc4f599 not found: ID does not exist"
Jul 10 18:06:45.572789 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.572734    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr" podStartSLOduration=0.755195735 podStartE2EDuration="3.572713505s" totalImagesPullingTime="2.81751777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:06:45.57155489 +0000 UTC m=+398.249822470" watchObservedRunningTime="2026-07-10 18:06:45.572713505 +0000 UTC m=+398.250981084"
Jul 10 18:06:45.586718 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.586681    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-npxww"]
Jul 10 18:06:45.591199 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.591161    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-npxww"]
Jul 10 18:06:45.638657 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.638569    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-token\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:06:45.638657 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.638604    2569 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-cacerts\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:06:45.638657 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.638617    2569 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-kubeconfig\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:06:45.638657 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.638629    2569 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd96015b-ff79-4ca9-973c-27c5c152e6ed-local-certs\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:06:45.638657 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.638640    2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bd96015b-ff79-4ca9-973c-27c5c152e6ed-istio-csr-dns-cert\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:06:45.638657 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:45.638654    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f58vj\" (UniqueName: \"kubernetes.io/projected/bd96015b-ff79-4ca9-973c-27c5c152e6ed-kube-api-access-f58vj\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:06:46.014205 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:46.014170    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd96015b-ff79-4ca9-973c-27c5c152e6ed" path="/var/lib/kubelet/pods/bd96015b-ff79-4ca9-973c-27c5c152e6ed/volumes"
Jul 10 18:06:47.568763 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:47.568726    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5" event={"ID":"4e958321-d88a-48c1-a80c-787d50044743","Type":"ContainerStarted","Data":"7a205dee36ec3b1890d9b64ba8cfcbe7a3bc6104cc9ebf93970c1295ec8c55db"}
Jul 10 18:06:47.569284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:47.568872    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"
Jul 10 18:06:47.585268 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:47.585197    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5" podStartSLOduration=2.074097304 podStartE2EDuration="5.585175485s" totalImagesPullingTime="3.511078181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:06:47.585016755 +0000 UTC m=+400.263284357" watchObservedRunningTime="2026-07-10 18:06:47.585175485 +0000 UTC m=+400.263443064"
Jul 10 18:06:49.527740 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:49.527711    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-f42d8"
Jul 10 18:06:50.526188 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:50.526144    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-npxww container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.17:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 10 18:06:50.526418 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:06:50.526218    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-npxww" podUID="bd96015b-ff79-4ca9-973c-27c5c152e6ed" containerName="discovery" probeResult="failure" output="Get \"http://10.134.0.17:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 10 18:07:16.568200 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:16.568156    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8mvr"
Jul 10 18:07:16.606684 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:16.606638    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:18.575469 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:18.575433    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6bzd5"
Jul 10 18:07:33.013571 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.013477    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:33.110020 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.109986    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:33.143778 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.143741    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7xn5t"]
Jul 10 18:07:33.144051 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.144037    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd96015b-ff79-4ca9-973c-27c5c152e6ed" containerName="discovery"
Jul 10 18:07:33.144093 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.144052    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd96015b-ff79-4ca9-973c-27c5c152e6ed" containerName="discovery"
Jul 10 18:07:33.144127 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.144111    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd96015b-ff79-4ca9-973c-27c5c152e6ed" containerName="discovery"
Jul 10 18:07:33.146657 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.146635    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7xn5t"
Jul 10 18:07:33.150600 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.150574    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dmcns\""
Jul 10 18:07:33.150600 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.150595    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 18:07:33.150838 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.150646    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 18:07:33.160951 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.160907    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7xn5t"]
Jul 10 18:07:33.183331 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.183273    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhdvk\" (UniqueName: \"kubernetes.io/projected/5041d5c3-dcb8-4151-9e7b-035479abccc1-kube-api-access-mhdvk\") pod \"kuadrant-operator-catalog-7xn5t\" (UID: \"5041d5c3-dcb8-4151-9e7b-035479abccc1\") " pod="kuadrant-system/kuadrant-operator-catalog-7xn5t"
Jul 10 18:07:33.222092 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.222051    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:33.283993 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.283903    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhdvk\" (UniqueName: \"kubernetes.io/projected/5041d5c3-dcb8-4151-9e7b-035479abccc1-kube-api-access-mhdvk\") pod \"kuadrant-operator-catalog-7xn5t\" (UID: \"5041d5c3-dcb8-4151-9e7b-035479abccc1\") " pod="kuadrant-system/kuadrant-operator-catalog-7xn5t"
Jul 10 18:07:33.291957 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.291924    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhdvk\" (UniqueName: \"kubernetes.io/projected/5041d5c3-dcb8-4151-9e7b-035479abccc1-kube-api-access-mhdvk\") pod \"kuadrant-operator-catalog-7xn5t\" (UID: \"5041d5c3-dcb8-4151-9e7b-035479abccc1\") " pod="kuadrant-system/kuadrant-operator-catalog-7xn5t"
Jul 10 18:07:33.457700 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.457655    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7xn5t"
Jul 10 18:07:33.496232 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.496195    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7xn5t"]
Jul 10 18:07:33.601882 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.601819    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7xn5t"]
Jul 10 18:07:33.604736 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:07:33.604700    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5041d5c3_dcb8_4151_9e7b_035479abccc1.slice/crio-169085e43dde59e78fdcd307b7762944c97997d383e633071dcfacf1ebc01e41 WatchSource:0}: Error finding container 169085e43dde59e78fdcd307b7762944c97997d383e633071dcfacf1ebc01e41: Status 404 returned error can't find the container with id 169085e43dde59e78fdcd307b7762944c97997d383e633071dcfacf1ebc01e41
Jul 10 18:07:33.705017 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.704983    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-449kc"]
Jul 10 18:07:33.709328 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.709289    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-449kc"
Jul 10 18:07:33.715230 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.715192    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-449kc"]
Jul 10 18:07:33.751847 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.751809    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7xn5t" event={"ID":"5041d5c3-dcb8-4151-9e7b-035479abccc1","Type":"ContainerStarted","Data":"169085e43dde59e78fdcd307b7762944c97997d383e633071dcfacf1ebc01e41"}
Jul 10 18:07:33.788799 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.788751    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8pw7\" (UniqueName: \"kubernetes.io/projected/417b7c0b-e3c0-423d-81f4-071730d9c0b6-kube-api-access-h8pw7\") pod \"kuadrant-operator-catalog-449kc\" (UID: \"417b7c0b-e3c0-423d-81f4-071730d9c0b6\") " pod="kuadrant-system/kuadrant-operator-catalog-449kc"
Jul 10 18:07:33.890345 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.890213    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8pw7\" (UniqueName: \"kubernetes.io/projected/417b7c0b-e3c0-423d-81f4-071730d9c0b6-kube-api-access-h8pw7\") pod \"kuadrant-operator-catalog-449kc\" (UID: \"417b7c0b-e3c0-423d-81f4-071730d9c0b6\") " pod="kuadrant-system/kuadrant-operator-catalog-449kc"
Jul 10 18:07:33.897854 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:33.897827    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8pw7\" (UniqueName: \"kubernetes.io/projected/417b7c0b-e3c0-423d-81f4-071730d9c0b6-kube-api-access-h8pw7\") pod \"kuadrant-operator-catalog-449kc\" (UID: \"417b7c0b-e3c0-423d-81f4-071730d9c0b6\") " pod="kuadrant-system/kuadrant-operator-catalog-449kc"
Jul 10 18:07:34.020365 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:34.020297    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-449kc"
Jul 10 18:07:34.160868 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:34.160823    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-449kc"]
Jul 10 18:07:34.163056 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:07:34.163027    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod417b7c0b_e3c0_423d_81f4_071730d9c0b6.slice/crio-4315a8bc434dc3165ec1005658332476ce0754e14b446d536a7db253f7fc49e1 WatchSource:0}: Error finding container 4315a8bc434dc3165ec1005658332476ce0754e14b446d536a7db253f7fc49e1: Status 404 returned error can't find the container with id 4315a8bc434dc3165ec1005658332476ce0754e14b446d536a7db253f7fc49e1
Jul 10 18:07:34.762145 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:34.762102    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-449kc" event={"ID":"417b7c0b-e3c0-423d-81f4-071730d9c0b6","Type":"ContainerStarted","Data":"4315a8bc434dc3165ec1005658332476ce0754e14b446d536a7db253f7fc49e1"}
Jul 10 18:07:36.772759 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:36.772720    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-449kc" event={"ID":"417b7c0b-e3c0-423d-81f4-071730d9c0b6","Type":"ContainerStarted","Data":"516448cd3afed0917ff7480f1141cde19a9046e1082192a5881e09a6001cceb0"}
Jul 10 18:07:36.774305 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:36.774274    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7xn5t" event={"ID":"5041d5c3-dcb8-4151-9e7b-035479abccc1","Type":"ContainerStarted","Data":"0e0bf3538cf87c43f35547ac82289babe3b16210e44903515d5d7030e6f41b82"}
Jul 10 18:07:36.774485 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:36.774361    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7xn5t" podUID="5041d5c3-dcb8-4151-9e7b-035479abccc1" containerName="registry-server" containerID="cri-o://0e0bf3538cf87c43f35547ac82289babe3b16210e44903515d5d7030e6f41b82" gracePeriod=2
Jul 10 18:07:36.788069 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:36.788001    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-449kc" podStartSLOduration=2.01778489 podStartE2EDuration="3.787981656s" totalImagesPullingTime="1.770196766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:07:36.785962551 +0000 UTC m=+449.464230131" watchObservedRunningTime="2026-07-10 18:07:36.787981656 +0000 UTC m=+449.466249234"
Jul 10 18:07:36.799563 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:36.799508    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7xn5t" podStartSLOduration=1.488897254 podStartE2EDuration="3.799486345s" totalImagesPullingTime="2.310589091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:07:36.798683804 +0000 UTC m=+449.476951405" watchObservedRunningTime="2026-07-10 18:07:36.799486345 +0000 UTC m=+449.477753924"
Jul 10 18:07:37.017405 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:37.017372    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7xn5t"
Jul 10 18:07:37.118660 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:37.118562    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhdvk\" (UniqueName: \"kubernetes.io/projected/5041d5c3-dcb8-4151-9e7b-035479abccc1-kube-api-access-mhdvk\") pod \"5041d5c3-dcb8-4151-9e7b-035479abccc1\" (UID: \"5041d5c3-dcb8-4151-9e7b-035479abccc1\") "
Jul 10 18:07:37.120847 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:37.120813    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5041d5c3-dcb8-4151-9e7b-035479abccc1-kube-api-access-mhdvk" (OuterVolumeSpecName: "kube-api-access-mhdvk") pod "5041d5c3-dcb8-4151-9e7b-035479abccc1" (UID: "5041d5c3-dcb8-4151-9e7b-035479abccc1"). InnerVolumeSpecName "kube-api-access-mhdvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:07:37.220073 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:37.220029    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhdvk\" (UniqueName: \"kubernetes.io/projected/5041d5c3-dcb8-4151-9e7b-035479abccc1-kube-api-access-mhdvk\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:07:37.780435 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:37.780396    2569 generic.go:356] "Generic (PLEG): container finished" podID="5041d5c3-dcb8-4151-9e7b-035479abccc1" containerID="0e0bf3538cf87c43f35547ac82289babe3b16210e44903515d5d7030e6f41b82" exitCode=0
Jul 10 18:07:37.780852 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:37.780445    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7xn5t"
Jul 10 18:07:37.780852 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:37.780478    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7xn5t" event={"ID":"5041d5c3-dcb8-4151-9e7b-035479abccc1","Type":"ContainerDied","Data":"0e0bf3538cf87c43f35547ac82289babe3b16210e44903515d5d7030e6f41b82"}
Jul 10 18:07:37.780852 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:37.780537    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7xn5t" event={"ID":"5041d5c3-dcb8-4151-9e7b-035479abccc1","Type":"ContainerDied","Data":"169085e43dde59e78fdcd307b7762944c97997d383e633071dcfacf1ebc01e41"}
Jul 10 18:07:37.780852 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:37.780559    2569 scope.go:117] "RemoveContainer" containerID="0e0bf3538cf87c43f35547ac82289babe3b16210e44903515d5d7030e6f41b82"
Jul 10 18:07:37.789682 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:37.789664    2569 scope.go:117] "RemoveContainer" containerID="0e0bf3538cf87c43f35547ac82289babe3b16210e44903515d5d7030e6f41b82"
Jul 10 18:07:37.790048 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:07:37.790024    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e0bf3538cf87c43f35547ac82289babe3b16210e44903515d5d7030e6f41b82\": container with ID starting with 0e0bf3538cf87c43f35547ac82289babe3b16210e44903515d5d7030e6f41b82 not found: ID does not exist" containerID="0e0bf3538cf87c43f35547ac82289babe3b16210e44903515d5d7030e6f41b82"
Jul 10 18:07:37.790095 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:37.790059    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e0bf3538cf87c43f35547ac82289babe3b16210e44903515d5d7030e6f41b82"} err="failed to get container status \"0e0bf3538cf87c43f35547ac82289babe3b16210e44903515d5d7030e6f41b82\": rpc error: code = NotFound desc = could not find container \"0e0bf3538cf87c43f35547ac82289babe3b16210e44903515d5d7030e6f41b82\": container with ID starting with 0e0bf3538cf87c43f35547ac82289babe3b16210e44903515d5d7030e6f41b82 not found: ID does not exist"
Jul 10 18:07:37.800153 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:37.800114    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7xn5t"]
Jul 10 18:07:37.801998 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:37.801967    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7xn5t"]
Jul 10 18:07:38.012779 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:38.012741    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5041d5c3-dcb8-4151-9e7b-035479abccc1" path="/var/lib/kubelet/pods/5041d5c3-dcb8-4151-9e7b-035479abccc1/volumes"
Jul 10 18:07:44.021447 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:44.021404    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-449kc"
Jul 10 18:07:44.021947 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:44.021507    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-449kc"
Jul 10 18:07:44.045704 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:44.045674    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-449kc"
Jul 10 18:07:44.834896 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:44.834856    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-449kc"
Jul 10 18:07:48.011323 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:48.011268    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:48.111362 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:48.111323    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:59.162333 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:59.162264    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:59.262276 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:59.262237    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:07:59.317773 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:07:59.317716    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:02.158604 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:02.158567    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:04.731691 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:04.731656    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm4jr"]
Jul 10 18:08:04.732083 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:04.731957    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5041d5c3-dcb8-4151-9e7b-035479abccc1" containerName="registry-server"
Jul 10 18:08:04.732083 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:04.731972    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5041d5c3-dcb8-4151-9e7b-035479abccc1" containerName="registry-server"
Jul 10 18:08:04.732083 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:04.732031    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5041d5c3-dcb8-4151-9e7b-035479abccc1" containerName="registry-server"
Jul 10 18:08:04.735926 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:04.735903    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm4jr"
Jul 10 18:08:04.738147 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:04.738119    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 10 18:08:04.738147 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:04.738134    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xgbgb\""
Jul 10 18:08:04.743976 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:04.743942    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm4jr"]
Jul 10 18:08:04.842521 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:04.842487    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmfzg\" (UniqueName: \"kubernetes.io/projected/534015d0-bfee-465c-9634-611f2b2eca9d-kube-api-access-rmfzg\") pod \"dns-operator-controller-manager-864dd78c4c-dm4jr\" (UID: \"534015d0-bfee-465c-9634-611f2b2eca9d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm4jr"
Jul 10 18:08:04.942992 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:04.942951    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmfzg\" (UniqueName: \"kubernetes.io/projected/534015d0-bfee-465c-9634-611f2b2eca9d-kube-api-access-rmfzg\") pod \"dns-operator-controller-manager-864dd78c4c-dm4jr\" (UID: \"534015d0-bfee-465c-9634-611f2b2eca9d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm4jr"
Jul 10 18:08:04.952896 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:04.952857    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmfzg\" (UniqueName: \"kubernetes.io/projected/534015d0-bfee-465c-9634-611f2b2eca9d-kube-api-access-rmfzg\") pod \"dns-operator-controller-manager-864dd78c4c-dm4jr\" (UID: \"534015d0-bfee-465c-9634-611f2b2eca9d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm4jr"
Jul 10 18:08:05.047057 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:05.047001    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm4jr"
Jul 10 18:08:05.190517 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:05.190483    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm4jr"]
Jul 10 18:08:05.194326 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:08:05.194273    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod534015d0_bfee_465c_9634_611f2b2eca9d.slice/crio-5b347fd1851d210c3fe5f99299baa7c38c650be47f1dfd7301c1f1547c5c8cfc WatchSource:0}: Error finding container 5b347fd1851d210c3fe5f99299baa7c38c650be47f1dfd7301c1f1547c5c8cfc: Status 404 returned error can't find the container with id 5b347fd1851d210c3fe5f99299baa7c38c650be47f1dfd7301c1f1547c5c8cfc
Jul 10 18:08:05.877221 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:05.877173    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:05.906094 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:05.906057    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm4jr" event={"ID":"534015d0-bfee-465c-9634-611f2b2eca9d","Type":"ContainerStarted","Data":"5b347fd1851d210c3fe5f99299baa7c38c650be47f1dfd7301c1f1547c5c8cfc"}
Jul 10 18:08:07.751806 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:07.751778    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 10 18:08:07.917090 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:07.917047    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm4jr" event={"ID":"534015d0-bfee-465c-9634-611f2b2eca9d","Type":"ContainerStarted","Data":"086543ad814216488e52c495b8d6d83f2f6c6a656784fa4f1f7ec70d62984703"}
Jul 10 18:08:07.917265 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:07.917117    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm4jr"
Jul 10 18:08:07.938178 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:07.938119    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm4jr" podStartSLOduration=1.385243492 podStartE2EDuration="3.938096711s" totalImagesPullingTime="2.552853219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:07.937145688 +0000 UTC m=+480.615413284" watchObservedRunningTime="2026-07-10 18:08:07.938096711 +0000 UTC m=+480.616364289"
Jul 10 18:08:08.811572 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:08.811534    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:10.132980 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:10.132937    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"]
Jul 10 18:08:10.136255 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:10.136231    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:10.141684 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:10.141643    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="9050dfb1-1708-4288-b1aa-45f8c83a51c3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:10.141839 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:10.141777    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kuadrant-operator-controller-manager-dockercfg-x4xtj\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x4xtj\"" type="*v1.Secret"
Jul 10 18:08:10.177748 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:10.177711    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"]
Jul 10 18:08:10.256817 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:10.256767    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:10.290984 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:10.290945    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9050dfb1-1708-4288-b1aa-45f8c83a51c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\" (UID: \"9050dfb1-1708-4288-b1aa-45f8c83a51c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:10.291169 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:10.291006    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjxmt\" (UniqueName: \"kubernetes.io/projected/9050dfb1-1708-4288-b1aa-45f8c83a51c3-kube-api-access-xjxmt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\" (UID: \"9050dfb1-1708-4288-b1aa-45f8c83a51c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:10.391568 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:10.391448    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9050dfb1-1708-4288-b1aa-45f8c83a51c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\" (UID: \"9050dfb1-1708-4288-b1aa-45f8c83a51c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:10.391568 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:10.391527    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjxmt\" (UniqueName: \"kubernetes.io/projected/9050dfb1-1708-4288-b1aa-45f8c83a51c3-kube-api-access-xjxmt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\" (UID: \"9050dfb1-1708-4288-b1aa-45f8c83a51c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:10.391852 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:10.391829    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9050dfb1-1708-4288-b1aa-45f8c83a51c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\" (UID: \"9050dfb1-1708-4288-b1aa-45f8c83a51c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:10.410608 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:10.410577    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjxmt\" (UniqueName: \"kubernetes.io/projected/9050dfb1-1708-4288-b1aa-45f8c83a51c3-kube-api-access-xjxmt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\" (UID: \"9050dfb1-1708-4288-b1aa-45f8c83a51c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:10.506547 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:10.506511    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:11.097890 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:11.097856    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:11.447982 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:11.447880    2569 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq" secret="" err="failed to sync secret cache: timed out waiting for the condition"
Jul 10 18:08:11.447982 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:11.447970    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:11.592707 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:11.592673    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"]
Jul 10 18:08:11.597430 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:08:11.597397    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9050dfb1_1708_4288_b1aa_45f8c83a51c3.slice/crio-c56a1de46ba010d7106c2495d73450cf19609828c90f62c48bb471e8e4706861 WatchSource:0}: Error finding container c56a1de46ba010d7106c2495d73450cf19609828c90f62c48bb471e8e4706861: Status 404 returned error can't find the container with id c56a1de46ba010d7106c2495d73450cf19609828c90f62c48bb471e8e4706861
Jul 10 18:08:11.661049 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:11.661021    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x4xtj\""
Jul 10 18:08:11.933644 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:11.933607    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq" event={"ID":"9050dfb1-1708-4288-b1aa-45f8c83a51c3","Type":"ContainerStarted","Data":"c56a1de46ba010d7106c2495d73450cf19609828c90f62c48bb471e8e4706861"}
Jul 10 18:08:13.510585 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:13.510541    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pjws8"]
Jul 10 18:08:13.513725 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:13.513701    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pjws8"
Jul 10 18:08:13.516040 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:13.516017    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qlg8g\""
Jul 10 18:08:13.524264 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:13.524225    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pjws8"]
Jul 10 18:08:13.549653 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:13.549609    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:13.615957 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:13.615914    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff2dc\" (UniqueName: \"kubernetes.io/projected/832b1102-8da8-4d9d-8d84-cc29a35928f7-kube-api-access-ff2dc\") pod \"authorino-operator-75cc8d5cb7-pjws8\" (UID: \"832b1102-8da8-4d9d-8d84-cc29a35928f7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pjws8"
Jul 10 18:08:13.716587 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:13.716545    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff2dc\" (UniqueName: \"kubernetes.io/projected/832b1102-8da8-4d9d-8d84-cc29a35928f7-kube-api-access-ff2dc\") pod \"authorino-operator-75cc8d5cb7-pjws8\" (UID: \"832b1102-8da8-4d9d-8d84-cc29a35928f7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pjws8"
Jul 10 18:08:13.726010 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:13.725967    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff2dc\" (UniqueName: \"kubernetes.io/projected/832b1102-8da8-4d9d-8d84-cc29a35928f7-kube-api-access-ff2dc\") pod \"authorino-operator-75cc8d5cb7-pjws8\" (UID: \"832b1102-8da8-4d9d-8d84-cc29a35928f7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pjws8"
Jul 10 18:08:13.825391 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:13.825258    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pjws8"
Jul 10 18:08:13.987568 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:13.987523    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pjws8"]
Jul 10 18:08:13.990960 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:08:13.990927    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod832b1102_8da8_4d9d_8d84_cc29a35928f7.slice/crio-8b4579065f81ae25e58020698ecadd7d11d5f843de4e9d4e4f59e116380bdb29 WatchSource:0}: Error finding container 8b4579065f81ae25e58020698ecadd7d11d5f843de4e9d4e4f59e116380bdb29: Status 404 returned error can't find the container with id 8b4579065f81ae25e58020698ecadd7d11d5f843de4e9d4e4f59e116380bdb29
Jul 10 18:08:14.500991 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:14.500945    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:14.950827 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:14.950694    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pjws8" event={"ID":"832b1102-8da8-4d9d-8d84-cc29a35928f7","Type":"ContainerStarted","Data":"8b4579065f81ae25e58020698ecadd7d11d5f843de4e9d4e4f59e116380bdb29"}
Jul 10 18:08:16.332509 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:16.332465    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"]
Jul 10 18:08:16.336125 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:16.336098    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"
Jul 10 18:08:16.338689 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:16.338657    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fdvsx\""
Jul 10 18:08:16.339056 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:16.339032    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzsnw\" (UniqueName: \"kubernetes.io/projected/50308a8b-c40d-4928-aa9e-894c573f4b17-kube-api-access-vzsnw\") pod \"limitador-operator-controller-manager-859d7b78bd-nh6hx\" (UID: \"50308a8b-c40d-4928-aa9e-894c573f4b17\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"
Jul 10 18:08:16.345723 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:16.345645    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"]
Jul 10 18:08:16.348709 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:16.348539    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:16.439791 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:16.439734    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzsnw\" (UniqueName: \"kubernetes.io/projected/50308a8b-c40d-4928-aa9e-894c573f4b17-kube-api-access-vzsnw\") pod \"limitador-operator-controller-manager-859d7b78bd-nh6hx\" (UID: \"50308a8b-c40d-4928-aa9e-894c573f4b17\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"
Jul 10 18:08:16.448851 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:16.448810    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzsnw\" (UniqueName: \"kubernetes.io/projected/50308a8b-c40d-4928-aa9e-894c573f4b17-kube-api-access-vzsnw\") pod \"limitador-operator-controller-manager-859d7b78bd-nh6hx\" (UID: \"50308a8b-c40d-4928-aa9e-894c573f4b17\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"
Jul 10 18:08:16.649790 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:16.649686    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"
Jul 10 18:08:16.815201 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:16.815176    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"]
Jul 10 18:08:16.963056 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:16.962958    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pjws8" event={"ID":"832b1102-8da8-4d9d-8d84-cc29a35928f7","Type":"ContainerStarted","Data":"1a009d9c50a81a8abdbccc5bbebc66dee8eb406a0675204d0a042b4001eed835"}
Jul 10 18:08:16.963230 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:16.963082    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pjws8"
Jul 10 18:08:16.980999 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:16.980937    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pjws8" podStartSLOduration=1.472508107 podStartE2EDuration="3.980915237s" totalImagesPullingTime="2.50840713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:16.97864464 +0000 UTC m=+489.656912246" watchObservedRunningTime="2026-07-10 18:08:16.980915237 +0000 UTC m=+489.659182815"
Jul 10 18:08:17.923049 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:17.923009    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:17.984686 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:08:17.984644    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50308a8b_c40d_4928_aa9e_894c573f4b17.slice/crio-bf71a69b5fda797f1b1920a5f5d9a5cf3d74e4a40a4003cc8bb55c6858e1e527 WatchSource:0}: Error finding container bf71a69b5fda797f1b1920a5f5d9a5cf3d74e4a40a4003cc8bb55c6858e1e527: Status 404 returned error can't find the container with id bf71a69b5fda797f1b1920a5f5d9a5cf3d74e4a40a4003cc8bb55c6858e1e527
Jul 10 18:08:18.024038 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:18.023996    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:18.924103 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:18.924075    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm4jr"
Jul 10 18:08:18.976778 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:18.976743    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq" event={"ID":"9050dfb1-1708-4288-b1aa-45f8c83a51c3","Type":"ContainerStarted","Data":"36f5ca83352ab210053a4d35de6046cb2d5fe105a215d8de47e222ac621ff6a1"}
Jul 10 18:08:18.976959 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:18.976878    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:18.978619 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:18.978577    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx" event={"ID":"50308a8b-c40d-4928-aa9e-894c573f4b17","Type":"ContainerStarted","Data":"bf71a69b5fda797f1b1920a5f5d9a5cf3d74e4a40a4003cc8bb55c6858e1e527"}
Jul 10 18:08:18.993922 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:18.993840    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq" podStartSLOduration=2.54529848 podStartE2EDuration="8.993815451s" totalImagesPullingTime="6.448516971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:18.992759348 +0000 UTC m=+491.671026951" watchObservedRunningTime="2026-07-10 18:08:18.993815451 +0000 UTC m=+491.672083032"
Jul 10 18:08:19.986690 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:19.986645    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx" event={"ID":"50308a8b-c40d-4928-aa9e-894c573f4b17","Type":"ContainerStarted","Data":"0b1dc2ca5987f9bb51c7f9300930d78f0353088f3c243641bf0f067d28a4c746"}
Jul 10 18:08:20.991341 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:20.991293    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"
Jul 10 18:08:21.073352 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:21.073287    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:21.307276 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:21.307237    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:21.509068 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:21.509031    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:21.609426 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:21.609303    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:27.971490 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:27.971449    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pjws8"
Jul 10 18:08:27.989530 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:27.989474    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx" podStartSLOduration=10.08975785 podStartE2EDuration="11.989456526s" totalImagesPullingTime="1.899698676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:20.0014702 +0000 UTC m=+492.679737798" watchObservedRunningTime="2026-07-10 18:08:27.989456526 +0000 UTC m=+500.667724103"
Jul 10 18:08:29.989746 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:29.989707    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:30.795897 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:30.795862    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:30.892323 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:30.892283    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:31.353103 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.353065    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"]
Jul 10 18:08:31.356463 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.356440    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:31.369431 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.369398    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"]
Jul 10 18:08:31.449362 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.449320    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m5ts\" (UniqueName: \"kubernetes.io/projected/a95d8591-9703-4083-b5d6-8b6aedea689f-kube-api-access-7m5ts\") pod \"kuadrant-operator-controller-manager-55467d9f7-zvkfz\" (UID: \"a95d8591-9703-4083-b5d6-8b6aedea689f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:31.449555 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.449384    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a95d8591-9703-4083-b5d6-8b6aedea689f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zvkfz\" (UID: \"a95d8591-9703-4083-b5d6-8b6aedea689f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:31.550266 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.550217    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a95d8591-9703-4083-b5d6-8b6aedea689f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zvkfz\" (UID: \"a95d8591-9703-4083-b5d6-8b6aedea689f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:31.550483 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.550340    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m5ts\" (UniqueName: \"kubernetes.io/projected/a95d8591-9703-4083-b5d6-8b6aedea689f-kube-api-access-7m5ts\") pod \"kuadrant-operator-controller-manager-55467d9f7-zvkfz\" (UID: \"a95d8591-9703-4083-b5d6-8b6aedea689f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:31.550698 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.550677    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a95d8591-9703-4083-b5d6-8b6aedea689f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zvkfz\" (UID: \"a95d8591-9703-4083-b5d6-8b6aedea689f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:31.558125 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.558100    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m5ts\" (UniqueName: \"kubernetes.io/projected/a95d8591-9703-4083-b5d6-8b6aedea689f-kube-api-access-7m5ts\") pod \"kuadrant-operator-controller-manager-55467d9f7-zvkfz\" (UID: \"a95d8591-9703-4083-b5d6-8b6aedea689f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:31.667488 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.667393    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:31.674628 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.674599    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"]
Jul 10 18:08:31.680561 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.680520    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"]
Jul 10 18:08:31.688429 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.688396    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"]
Jul 10 18:08:31.688644 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.688611    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq" podUID="9050dfb1-1708-4288-b1aa-45f8c83a51c3" containerName="manager" containerID="cri-o://36f5ca83352ab210053a4d35de6046cb2d5fe105a215d8de47e222ac621ff6a1" gracePeriod=2
Jul 10 18:08:31.698836 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.698808    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"]
Jul 10 18:08:31.702674 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.702645    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"
Jul 10 18:08:31.703424 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.703392    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"]
Jul 10 18:08:31.708377 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:31.708334    2569 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9050dfb1-1708-4288-b1aa-45f8c83a51c3\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\": pods \"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:31.710421 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:31.710382    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="9050dfb1-1708-4288-b1aa-45f8c83a51c3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:31.710723 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.710703    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"]
Jul 10 18:08:31.711061 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.711046    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9050dfb1-1708-4288-b1aa-45f8c83a51c3" containerName="manager"
Jul 10 18:08:31.711132 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.711065    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9050dfb1-1708-4288-b1aa-45f8c83a51c3" containerName="manager"
Jul 10 18:08:31.711132 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.711124    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9050dfb1-1708-4288-b1aa-45f8c83a51c3" containerName="manager"
Jul 10 18:08:31.714128 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.714105    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"]
Jul 10 18:08:31.714271 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.714229    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"
Jul 10 18:08:31.714447 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.714420    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx" podUID="50308a8b-c40d-4928-aa9e-894c573f4b17" containerName="manager" containerID="cri-o://0b1dc2ca5987f9bb51c7f9300930d78f0353088f3c243641bf0f067d28a4c746" gracePeriod=2
Jul 10 18:08:31.716239 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.716218    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"
Jul 10 18:08:31.719838 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.719810    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"]
Jul 10 18:08:31.721588 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.721559    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"]
Jul 10 18:08:31.728931 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.728894    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"]
Jul 10 18:08:31.740723 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:31.740684    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nh6hx\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="50308a8b-c40d-4928-aa9e-894c573f4b17" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"
Jul 10 18:08:31.742105 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.742076    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsh2h"]
Jul 10 18:08:31.742413 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.742400    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50308a8b-c40d-4928-aa9e-894c573f4b17" containerName="manager"
Jul 10 18:08:31.742453 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.742416    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="50308a8b-c40d-4928-aa9e-894c573f4b17" containerName="manager"
Jul 10 18:08:31.742502 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.742478    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="50308a8b-c40d-4928-aa9e-894c573f4b17" containerName="manager"
Jul 10 18:08:31.742821 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:31.742783    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="9050dfb1-1708-4288-b1aa-45f8c83a51c3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:31.750363 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.745681    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsh2h"
Jul 10 18:08:31.751904 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.751865    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d22b357-bbf5-43a4-837c-31e1afd7bb5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4gkbk\" (UID: \"4d22b357-bbf5-43a4-837c-31e1afd7bb5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"
Jul 10 18:08:31.752066 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.751921    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s62x9\" (UniqueName: \"kubernetes.io/projected/4d22b357-bbf5-43a4-837c-31e1afd7bb5a-kube-api-access-s62x9\") pod \"kuadrant-operator-controller-manager-55467d9f7-4gkbk\" (UID: \"4d22b357-bbf5-43a4-837c-31e1afd7bb5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"
Jul 10 18:08:31.752149 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.752096    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/334b8461-9df6-4844-bbaa-e63ad5fc4c7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6cjmb\" (UID: \"334b8461-9df6-4844-bbaa-e63ad5fc4c7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"
Jul 10 18:08:31.752331 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.752288    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bshs4\" (UniqueName: \"kubernetes.io/projected/334b8461-9df6-4844-bbaa-e63ad5fc4c7f-kube-api-access-bshs4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6cjmb\" (UID: \"334b8461-9df6-4844-bbaa-e63ad5fc4c7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"
Jul 10 18:08:31.755143 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.755111    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsh2h"]
Jul 10 18:08:31.769225 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:31.769186    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nh6hx\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="50308a8b-c40d-4928-aa9e-894c573f4b17" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"
Jul 10 18:08:31.785784 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:31.785738    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="9050dfb1-1708-4288-b1aa-45f8c83a51c3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:31.853765 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.853716    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bshs4\" (UniqueName: \"kubernetes.io/projected/334b8461-9df6-4844-bbaa-e63ad5fc4c7f-kube-api-access-bshs4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6cjmb\" (UID: \"334b8461-9df6-4844-bbaa-e63ad5fc4c7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"
Jul 10 18:08:31.853938 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.853797    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78pwd\" (UniqueName: \"kubernetes.io/projected/b8c517f7-4cc1-4a0b-b40e-4e312811611a-kube-api-access-78pwd\") pod \"limitador-operator-controller-manager-859d7b78bd-rsh2h\" (UID: \"b8c517f7-4cc1-4a0b-b40e-4e312811611a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsh2h"
Jul 10 18:08:31.853938 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.853858    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d22b357-bbf5-43a4-837c-31e1afd7bb5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4gkbk\" (UID: \"4d22b357-bbf5-43a4-837c-31e1afd7bb5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"
Jul 10 18:08:31.853938 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.853885    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s62x9\" (UniqueName: \"kubernetes.io/projected/4d22b357-bbf5-43a4-837c-31e1afd7bb5a-kube-api-access-s62x9\") pod \"kuadrant-operator-controller-manager-55467d9f7-4gkbk\" (UID: \"4d22b357-bbf5-43a4-837c-31e1afd7bb5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"
Jul 10 18:08:31.853938 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.853921    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/334b8461-9df6-4844-bbaa-e63ad5fc4c7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6cjmb\" (UID: \"334b8461-9df6-4844-bbaa-e63ad5fc4c7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"
Jul 10 18:08:31.854541 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.854518    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/334b8461-9df6-4844-bbaa-e63ad5fc4c7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6cjmb\" (UID: \"334b8461-9df6-4844-bbaa-e63ad5fc4c7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"
Jul 10 18:08:31.854732 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.854707    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d22b357-bbf5-43a4-837c-31e1afd7bb5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4gkbk\" (UID: \"4d22b357-bbf5-43a4-837c-31e1afd7bb5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"
Jul 10 18:08:31.866339 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.866294    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s62x9\" (UniqueName: \"kubernetes.io/projected/4d22b357-bbf5-43a4-837c-31e1afd7bb5a-kube-api-access-s62x9\") pod \"kuadrant-operator-controller-manager-55467d9f7-4gkbk\" (UID: \"4d22b357-bbf5-43a4-837c-31e1afd7bb5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"
Jul 10 18:08:31.866489 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.866452    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bshs4\" (UniqueName: \"kubernetes.io/projected/334b8461-9df6-4844-bbaa-e63ad5fc4c7f-kube-api-access-bshs4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6cjmb\" (UID: \"334b8461-9df6-4844-bbaa-e63ad5fc4c7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"
Jul 10 18:08:31.950441 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.950404    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:31.952619 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:31.952583    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nh6hx\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="50308a8b-c40d-4928-aa9e-894c573f4b17" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"
Jul 10 18:08:31.954590 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:31.954553    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="9050dfb1-1708-4288-b1aa-45f8c83a51c3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:31.954797 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.954780    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78pwd\" (UniqueName: \"kubernetes.io/projected/b8c517f7-4cc1-4a0b-b40e-4e312811611a-kube-api-access-78pwd\") pod \"limitador-operator-controller-manager-859d7b78bd-rsh2h\" (UID: \"b8c517f7-4cc1-4a0b-b40e-4e312811611a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsh2h"
Jul 10 18:08:31.965158 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.965130    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"
Jul 10 18:08:31.967297 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:31.967267    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nh6hx\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="50308a8b-c40d-4928-aa9e-894c573f4b17" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"
Jul 10 18:08:31.969074 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:31.969049    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78pwd\" (UniqueName: \"kubernetes.io/projected/b8c517f7-4cc1-4a0b-b40e-4e312811611a-kube-api-access-78pwd\") pod \"limitador-operator-controller-manager-859d7b78bd-rsh2h\" (UID: \"b8c517f7-4cc1-4a0b-b40e-4e312811611a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsh2h"
Jul 10 18:08:31.969378 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:31.969352    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7x9bq\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="9050dfb1-1708-4288-b1aa-45f8c83a51c3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:32.039103 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.039071    2569 generic.go:356] "Generic (PLEG): container finished" podID="50308a8b-c40d-4928-aa9e-894c573f4b17" containerID="0b1dc2ca5987f9bb51c7f9300930d78f0353088f3c243641bf0f067d28a4c746" exitCode=0
Jul 10 18:08:32.039277 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.039114    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nh6hx"
Jul 10 18:08:32.039277 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.039166    2569 scope.go:117] "RemoveContainer" containerID="0b1dc2ca5987f9bb51c7f9300930d78f0353088f3c243641bf0f067d28a4c746"
Jul 10 18:08:32.040642 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.040616    2569 generic.go:356] "Generic (PLEG): container finished" podID="9050dfb1-1708-4288-b1aa-45f8c83a51c3" containerID="36f5ca83352ab210053a4d35de6046cb2d5fe105a215d8de47e222ac621ff6a1" exitCode=0
Jul 10 18:08:32.040774 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.040663    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7x9bq"
Jul 10 18:08:32.048063 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.048043    2569 scope.go:117] "RemoveContainer" containerID="0b1dc2ca5987f9bb51c7f9300930d78f0353088f3c243641bf0f067d28a4c746"
Jul 10 18:08:32.048352 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:32.048333    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b1dc2ca5987f9bb51c7f9300930d78f0353088f3c243641bf0f067d28a4c746\": container with ID starting with 0b1dc2ca5987f9bb51c7f9300930d78f0353088f3c243641bf0f067d28a4c746 not found: ID does not exist" containerID="0b1dc2ca5987f9bb51c7f9300930d78f0353088f3c243641bf0f067d28a4c746"
Jul 10 18:08:32.048411 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.048360    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b1dc2ca5987f9bb51c7f9300930d78f0353088f3c243641bf0f067d28a4c746"} err="failed to get container status \"0b1dc2ca5987f9bb51c7f9300930d78f0353088f3c243641bf0f067d28a4c746\": rpc error: code = NotFound desc = could not find container \"0b1dc2ca5987f9bb51c7f9300930d78f0353088f3c243641bf0f067d28a4c746\": container with ID starting with 0b1dc2ca5987f9bb51c7f9300930d78f0353088f3c243641bf0f067d28a4c746 not found: ID does not exist"
Jul 10 18:08:32.048411 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.048379    2569 scope.go:117] "RemoveContainer" containerID="36f5ca83352ab210053a4d35de6046cb2d5fe105a215d8de47e222ac621ff6a1"
Jul 10 18:08:32.055683 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.055655    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9050dfb1-1708-4288-b1aa-45f8c83a51c3-extensions-socket-volume\") pod \"9050dfb1-1708-4288-b1aa-45f8c83a51c3\" (UID: \"9050dfb1-1708-4288-b1aa-45f8c83a51c3\") "
Jul 10 18:08:32.055825 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.055702    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjxmt\" (UniqueName: \"kubernetes.io/projected/9050dfb1-1708-4288-b1aa-45f8c83a51c3-kube-api-access-xjxmt\") pod \"9050dfb1-1708-4288-b1aa-45f8c83a51c3\" (UID: \"9050dfb1-1708-4288-b1aa-45f8c83a51c3\") "
Jul 10 18:08:32.055825 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.055727    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzsnw\" (UniqueName: \"kubernetes.io/projected/50308a8b-c40d-4928-aa9e-894c573f4b17-kube-api-access-vzsnw\") pod \"50308a8b-c40d-4928-aa9e-894c573f4b17\" (UID: \"50308a8b-c40d-4928-aa9e-894c573f4b17\") "
Jul 10 18:08:32.056199 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.056173    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9050dfb1-1708-4288-b1aa-45f8c83a51c3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9050dfb1-1708-4288-b1aa-45f8c83a51c3" (UID: "9050dfb1-1708-4288-b1aa-45f8c83a51c3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:08:32.056806 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.056789    2569 scope.go:117] "RemoveContainer" containerID="36f5ca83352ab210053a4d35de6046cb2d5fe105a215d8de47e222ac621ff6a1"
Jul 10 18:08:32.057170 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:32.057148    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36f5ca83352ab210053a4d35de6046cb2d5fe105a215d8de47e222ac621ff6a1\": container with ID starting with 36f5ca83352ab210053a4d35de6046cb2d5fe105a215d8de47e222ac621ff6a1 not found: ID does not exist" containerID="36f5ca83352ab210053a4d35de6046cb2d5fe105a215d8de47e222ac621ff6a1"
Jul 10 18:08:32.057244 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.057176    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36f5ca83352ab210053a4d35de6046cb2d5fe105a215d8de47e222ac621ff6a1"} err="failed to get container status \"36f5ca83352ab210053a4d35de6046cb2d5fe105a215d8de47e222ac621ff6a1\": rpc error: code = NotFound desc = could not find container \"36f5ca83352ab210053a4d35de6046cb2d5fe105a215d8de47e222ac621ff6a1\": container with ID starting with 36f5ca83352ab210053a4d35de6046cb2d5fe105a215d8de47e222ac621ff6a1 not found: ID does not exist"
Jul 10 18:08:32.057928 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.057907    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9050dfb1-1708-4288-b1aa-45f8c83a51c3-kube-api-access-xjxmt" (OuterVolumeSpecName: "kube-api-access-xjxmt") pod "9050dfb1-1708-4288-b1aa-45f8c83a51c3" (UID: "9050dfb1-1708-4288-b1aa-45f8c83a51c3"). InnerVolumeSpecName "kube-api-access-xjxmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:08:32.058000 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.057959    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50308a8b-c40d-4928-aa9e-894c573f4b17-kube-api-access-vzsnw" (OuterVolumeSpecName: "kube-api-access-vzsnw") pod "50308a8b-c40d-4928-aa9e-894c573f4b17" (UID: "50308a8b-c40d-4928-aa9e-894c573f4b17"). InnerVolumeSpecName "kube-api-access-vzsnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:08:32.133921 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.133880    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"
Jul 10 18:08:32.142271 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.142229    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"
Jul 10 18:08:32.149983 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.149602    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsh2h"
Jul 10 18:08:32.157066 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.157037    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9050dfb1-1708-4288-b1aa-45f8c83a51c3-extensions-socket-volume\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:08:32.157066 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.157064    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjxmt\" (UniqueName: \"kubernetes.io/projected/9050dfb1-1708-4288-b1aa-45f8c83a51c3-kube-api-access-xjxmt\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:08:32.157275 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.157075    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzsnw\" (UniqueName: \"kubernetes.io/projected/50308a8b-c40d-4928-aa9e-894c573f4b17-kube-api-access-vzsnw\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:08:32.238110 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.238055    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:32.304781 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.304683    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"]
Jul 10 18:08:32.309871 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:08:32.309819    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d22b357_bbf5_43a4_837c_31e1afd7bb5a.slice/crio-6844549c6851999d119282a32c5d2878400014a4548f8519657b6c2642d52ad4 WatchSource:0}: Error finding container 6844549c6851999d119282a32c5d2878400014a4548f8519657b6c2642d52ad4: Status 404 returned error can't find the container with id 6844549c6851999d119282a32c5d2878400014a4548f8519657b6c2642d52ad4
Jul 10 18:08:32.327405 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.327376    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"]
Jul 10 18:08:32.330920 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:08:32.330892    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334b8461_9df6_4844_bbaa_e63ad5fc4c7f.slice/crio-f08b302b0ec3fd74dd3cc3640622a5acd1c8d5ce6f17034583d73b9bd0b61471 WatchSource:0}: Error finding container f08b302b0ec3fd74dd3cc3640622a5acd1c8d5ce6f17034583d73b9bd0b61471: Status 404 returned error can't find the container with id f08b302b0ec3fd74dd3cc3640622a5acd1c8d5ce6f17034583d73b9bd0b61471
Jul 10 18:08:32.340167 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:32.340138    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsh2h"]
Jul 10 18:08:32.345911 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:08:32.345877    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c517f7_4cc1_4a0b_b40e_4e312811611a.slice/crio-71791285e1fb6a52788f8e39d3c68a0a1ab63213a3534b8fde5fa92da78433f4 WatchSource:0}: Error finding container 71791285e1fb6a52788f8e39d3c68a0a1ab63213a3534b8fde5fa92da78433f4: Status 404 returned error can't find the container with id 71791285e1fb6a52788f8e39d3c68a0a1ab63213a3534b8fde5fa92da78433f4
Jul 10 18:08:33.051863 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.051827    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsh2h" event={"ID":"b8c517f7-4cc1-4a0b-b40e-4e312811611a","Type":"ContainerStarted","Data":"42e1208c42b3408ea50ab26a0ee691b9d8da558b4e60b231260fbec53c360bb7"}
Jul 10 18:08:33.052355 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.051881    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsh2h" event={"ID":"b8c517f7-4cc1-4a0b-b40e-4e312811611a","Type":"ContainerStarted","Data":"71791285e1fb6a52788f8e39d3c68a0a1ab63213a3534b8fde5fa92da78433f4"}
Jul 10 18:08:33.052355 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.051924    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsh2h"
Jul 10 18:08:33.053600 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.053564    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb" event={"ID":"334b8461-9df6-4844-bbaa-e63ad5fc4c7f","Type":"ContainerStarted","Data":"938a00a60c6b0989603d12b0b8b5985343a442d37ff7f7d8408555674fb74500"}
Jul 10 18:08:33.053708 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.053621    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb" event={"ID":"334b8461-9df6-4844-bbaa-e63ad5fc4c7f","Type":"ContainerStarted","Data":"f08b302b0ec3fd74dd3cc3640622a5acd1c8d5ce6f17034583d73b9bd0b61471"}
Jul 10 18:08:33.053708 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.053667    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"
Jul 10 18:08:33.055233 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.055204    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk" event={"ID":"4d22b357-bbf5-43a4-837c-31e1afd7bb5a","Type":"ContainerStarted","Data":"d095c8b8987c29242aa42bc2c1379dce5194b9153713c1e24d982619dafbfbef"}
Jul 10 18:08:33.055350 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.055251    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk" event={"ID":"4d22b357-bbf5-43a4-837c-31e1afd7bb5a","Type":"ContainerStarted","Data":"6844549c6851999d119282a32c5d2878400014a4548f8519657b6c2642d52ad4"}
Jul 10 18:08:33.055350 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.055272    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"
Jul 10 18:08:33.071559 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.071508    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsh2h" podStartSLOduration=2.071491555 podStartE2EDuration="2.071491555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:33.071138445 +0000 UTC m=+505.749406047" watchObservedRunningTime="2026-07-10 18:08:33.071491555 +0000 UTC m=+505.749759110"
Jul 10 18:08:33.090077 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.090019    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk" podStartSLOduration=2.089999273 podStartE2EDuration="2.089999273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:33.088910585 +0000 UTC m=+505.767178163" watchObservedRunningTime="2026-07-10 18:08:33.089999273 +0000 UTC m=+505.768266850"
Jul 10 18:08:33.108771 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.108709    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb" podStartSLOduration=2.108689303 podStartE2EDuration="2.108689303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:33.107716488 +0000 UTC m=+505.785984066" watchObservedRunningTime="2026-07-10 18:08:33.108689303 +0000 UTC m=+505.786956904"
Jul 10 18:08:33.729969 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.729933    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:33.830497 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:33.830467    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:34.014089 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:34.014056    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50308a8b-c40d-4928-aa9e-894c573f4b17" path="/var/lib/kubelet/pods/50308a8b-c40d-4928-aa9e-894c573f4b17/volumes"
Jul 10 18:08:34.014450 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:34.014437    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9050dfb1-1708-4288-b1aa-45f8c83a51c3" path="/var/lib/kubelet/pods/9050dfb1-1708-4288-b1aa-45f8c83a51c3/volumes"
Jul 10 18:08:34.211973 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:34.211938    2569 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-zvkfz_kuadrant-system_a95d8591-9703-4083-b5d6-8b6aedea689f_0(8cd8bec811f1a5cecbdc3cbe6a34457816e52f2939992f2e95efe477db9cd714): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-zvkfz to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 10 18:08:34.212247 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:34.212001    2569 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-zvkfz_kuadrant-system_a95d8591-9703-4083-b5d6-8b6aedea689f_0(8cd8bec811f1a5cecbdc3cbe6a34457816e52f2939992f2e95efe477db9cd714): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-zvkfz to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:35.065434 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:35.065400    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:35.073845 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:35.073809    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:35.076035 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:35.076006    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zvkfz\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="a95d8591-9703-4083-b5d6-8b6aedea689f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:35.181614 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:35.181570    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m5ts\" (UniqueName: \"kubernetes.io/projected/a95d8591-9703-4083-b5d6-8b6aedea689f-kube-api-access-7m5ts\") pod \"a95d8591-9703-4083-b5d6-8b6aedea689f\" (UID: \"a95d8591-9703-4083-b5d6-8b6aedea689f\") "
Jul 10 18:08:35.181792 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:35.181633    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a95d8591-9703-4083-b5d6-8b6aedea689f-extensions-socket-volume\") pod \"a95d8591-9703-4083-b5d6-8b6aedea689f\" (UID: \"a95d8591-9703-4083-b5d6-8b6aedea689f\") "
Jul 10 18:08:35.181901 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:35.181873    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95d8591-9703-4083-b5d6-8b6aedea689f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a95d8591-9703-4083-b5d6-8b6aedea689f" (UID: "a95d8591-9703-4083-b5d6-8b6aedea689f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:08:35.183853 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:35.183821    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a95d8591-9703-4083-b5d6-8b6aedea689f-kube-api-access-7m5ts" (OuterVolumeSpecName: "kube-api-access-7m5ts") pod "a95d8591-9703-4083-b5d6-8b6aedea689f" (UID: "a95d8591-9703-4083-b5d6-8b6aedea689f"). InnerVolumeSpecName "kube-api-access-7m5ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:08:35.282696 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:35.282657    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m5ts\" (UniqueName: \"kubernetes.io/projected/a95d8591-9703-4083-b5d6-8b6aedea689f-kube-api-access-7m5ts\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:08:35.282696 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:35.282688    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a95d8591-9703-4083-b5d6-8b6aedea689f-extensions-socket-volume\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:08:36.014370 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:36.014331    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a95d8591-9703-4083-b5d6-8b6aedea689f" path="/var/lib/kubelet/pods/a95d8591-9703-4083-b5d6-8b6aedea689f/volumes"
Jul 10 18:08:36.070570 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:36.070534    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:36.075056 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:36.075016    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zvkfz\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="a95d8591-9703-4083-b5d6-8b6aedea689f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:36.269800 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:36.269712    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:36.388615 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:36.388575    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:36.484606 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:36.484566    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:38.011965 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:38.011928    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zvkfz\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="a95d8591-9703-4083-b5d6-8b6aedea689f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvkfz"
Jul 10 18:08:40.158121 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:40.158083    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:40.272810 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:40.272773    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:41.068244 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:41.068206    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:44.063636 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.063594    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"
Jul 10 18:08:44.064062 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.063668    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"
Jul 10 18:08:44.064062 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.063701    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsh2h"
Jul 10 18:08:44.149520 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.149473    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"]
Jul 10 18:08:44.149728 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.149700    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb" podUID="334b8461-9df6-4844-bbaa-e63ad5fc4c7f" containerName="manager" containerID="cri-o://938a00a60c6b0989603d12b0b8b5985343a442d37ff7f7d8408555674fb74500" gracePeriod=10
Jul 10 18:08:44.409198 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.409167    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"
Jul 10 18:08:44.452436 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.452408    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bshs4\" (UniqueName: \"kubernetes.io/projected/334b8461-9df6-4844-bbaa-e63ad5fc4c7f-kube-api-access-bshs4\") pod \"334b8461-9df6-4844-bbaa-e63ad5fc4c7f\" (UID: \"334b8461-9df6-4844-bbaa-e63ad5fc4c7f\") "
Jul 10 18:08:44.452581 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.452513    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/334b8461-9df6-4844-bbaa-e63ad5fc4c7f-extensions-socket-volume\") pod \"334b8461-9df6-4844-bbaa-e63ad5fc4c7f\" (UID: \"334b8461-9df6-4844-bbaa-e63ad5fc4c7f\") "
Jul 10 18:08:44.452887 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.452859    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/334b8461-9df6-4844-bbaa-e63ad5fc4c7f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "334b8461-9df6-4844-bbaa-e63ad5fc4c7f" (UID: "334b8461-9df6-4844-bbaa-e63ad5fc4c7f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:08:44.454569 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.454530    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/334b8461-9df6-4844-bbaa-e63ad5fc4c7f-kube-api-access-bshs4" (OuterVolumeSpecName: "kube-api-access-bshs4") pod "334b8461-9df6-4844-bbaa-e63ad5fc4c7f" (UID: "334b8461-9df6-4844-bbaa-e63ad5fc4c7f"). InnerVolumeSpecName "kube-api-access-bshs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:08:44.475634 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.475595    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"]
Jul 10 18:08:44.475934 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.475921    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="334b8461-9df6-4844-bbaa-e63ad5fc4c7f" containerName="manager"
Jul 10 18:08:44.475981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.475935    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="334b8461-9df6-4844-bbaa-e63ad5fc4c7f" containerName="manager"
Jul 10 18:08:44.476016 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.476003    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="334b8461-9df6-4844-bbaa-e63ad5fc4c7f" containerName="manager"
Jul 10 18:08:44.479796 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.479770    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"
Jul 10 18:08:44.493234 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.493202    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"]
Jul 10 18:08:44.553566 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.553525    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvl59\" (UniqueName: \"kubernetes.io/projected/f16ab1a9-0844-4452-9908-48adfc0378d2-kube-api-access-rvl59\") pod \"kuadrant-operator-controller-manager-86878c769f-7tmz9\" (UID: \"f16ab1a9-0844-4452-9908-48adfc0378d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"
Jul 10 18:08:44.553765 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.553573    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f16ab1a9-0844-4452-9908-48adfc0378d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7tmz9\" (UID: \"f16ab1a9-0844-4452-9908-48adfc0378d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"
Jul 10 18:08:44.553765 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.553638    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/334b8461-9df6-4844-bbaa-e63ad5fc4c7f-extensions-socket-volume\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:08:44.553765 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.553649    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bshs4\" (UniqueName: \"kubernetes.io/projected/334b8461-9df6-4844-bbaa-e63ad5fc4c7f-kube-api-access-bshs4\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:08:44.654984 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.654879    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvl59\" (UniqueName: \"kubernetes.io/projected/f16ab1a9-0844-4452-9908-48adfc0378d2-kube-api-access-rvl59\") pod \"kuadrant-operator-controller-manager-86878c769f-7tmz9\" (UID: \"f16ab1a9-0844-4452-9908-48adfc0378d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"
Jul 10 18:08:44.655146 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.655013    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f16ab1a9-0844-4452-9908-48adfc0378d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7tmz9\" (UID: \"f16ab1a9-0844-4452-9908-48adfc0378d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"
Jul 10 18:08:44.655385 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.655368    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f16ab1a9-0844-4452-9908-48adfc0378d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7tmz9\" (UID: \"f16ab1a9-0844-4452-9908-48adfc0378d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"
Jul 10 18:08:44.672724 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.672688    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvl59\" (UniqueName: \"kubernetes.io/projected/f16ab1a9-0844-4452-9908-48adfc0378d2-kube-api-access-rvl59\") pod \"kuadrant-operator-controller-manager-86878c769f-7tmz9\" (UID: \"f16ab1a9-0844-4452-9908-48adfc0378d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"
Jul 10 18:08:44.790356 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.790299    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"
Jul 10 18:08:44.937526 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:44.937499    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"]
Jul 10 18:08:44.940195 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:08:44.940169    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16ab1a9_0844_4452_9908_48adfc0378d2.slice/crio-45473795270ee6688c0b46b486ea13acdad683fa6f0d5d0c6c88e1ed4b16f29e WatchSource:0}: Error finding container 45473795270ee6688c0b46b486ea13acdad683fa6f0d5d0c6c88e1ed4b16f29e: Status 404 returned error can't find the container with id 45473795270ee6688c0b46b486ea13acdad683fa6f0d5d0c6c88e1ed4b16f29e
Jul 10 18:08:45.118045 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:45.118011    2569 generic.go:356] "Generic (PLEG): container finished" podID="334b8461-9df6-4844-bbaa-e63ad5fc4c7f" containerID="938a00a60c6b0989603d12b0b8b5985343a442d37ff7f7d8408555674fb74500" exitCode=0
Jul 10 18:08:45.118561 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:45.118055    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"
Jul 10 18:08:45.118561 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:45.118101    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb" event={"ID":"334b8461-9df6-4844-bbaa-e63ad5fc4c7f","Type":"ContainerDied","Data":"938a00a60c6b0989603d12b0b8b5985343a442d37ff7f7d8408555674fb74500"}
Jul 10 18:08:45.118561 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:45.118162    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb" event={"ID":"334b8461-9df6-4844-bbaa-e63ad5fc4c7f","Type":"ContainerDied","Data":"f08b302b0ec3fd74dd3cc3640622a5acd1c8d5ce6f17034583d73b9bd0b61471"}
Jul 10 18:08:45.118561 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:45.118195    2569 scope.go:117] "RemoveContainer" containerID="938a00a60c6b0989603d12b0b8b5985343a442d37ff7f7d8408555674fb74500"
Jul 10 18:08:45.120065 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:45.120023    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9" event={"ID":"f16ab1a9-0844-4452-9908-48adfc0378d2","Type":"ContainerStarted","Data":"19cd11527d67a841fb9d0f62ca535c9fbf4c21432b0d0b775b18683f5155d867"}
Jul 10 18:08:45.120275 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:45.120081    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9" event={"ID":"f16ab1a9-0844-4452-9908-48adfc0378d2","Type":"ContainerStarted","Data":"45473795270ee6688c0b46b486ea13acdad683fa6f0d5d0c6c88e1ed4b16f29e"}
Jul 10 18:08:45.120275 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:45.120128    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"
Jul 10 18:08:45.127763 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:45.127736    2569 scope.go:117] "RemoveContainer" containerID="938a00a60c6b0989603d12b0b8b5985343a442d37ff7f7d8408555674fb74500"
Jul 10 18:08:45.128134 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:45.128110    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"938a00a60c6b0989603d12b0b8b5985343a442d37ff7f7d8408555674fb74500\": container with ID starting with 938a00a60c6b0989603d12b0b8b5985343a442d37ff7f7d8408555674fb74500 not found: ID does not exist" containerID="938a00a60c6b0989603d12b0b8b5985343a442d37ff7f7d8408555674fb74500"
Jul 10 18:08:45.128235 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:45.128141    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"938a00a60c6b0989603d12b0b8b5985343a442d37ff7f7d8408555674fb74500"} err="failed to get container status \"938a00a60c6b0989603d12b0b8b5985343a442d37ff7f7d8408555674fb74500\": rpc error: code = NotFound desc = could not find container \"938a00a60c6b0989603d12b0b8b5985343a442d37ff7f7d8408555674fb74500\": container with ID starting with 938a00a60c6b0989603d12b0b8b5985343a442d37ff7f7d8408555674fb74500 not found: ID does not exist"
Jul 10 18:08:45.152754 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:45.152702    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9" podStartSLOduration=1.152682762 podStartE2EDuration="1.152682762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:08:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:08:45.149905777 +0000 UTC m=+517.828173381" watchObservedRunningTime="2026-07-10 18:08:45.152682762 +0000 UTC m=+517.830950339"
Jul 10 18:08:45.167777 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:45.167738    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"]
Jul 10 18:08:45.172879 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:45.172848    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6cjmb"]
Jul 10 18:08:46.016458 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:46.014434    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="334b8461-9df6-4844-bbaa-e63ad5fc4c7f" path="/var/lib/kubelet/pods/334b8461-9df6-4844-bbaa-e63ad5fc4c7f/volumes"
Jul 10 18:08:49.709507 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:49.709471    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:49.811023 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:49.810976    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:50.320939 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:50.320901    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:50.417179 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:50.417140    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:54.161197 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:54.161155    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:54.247247 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:54.247210    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:08:56.127865 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:56.127836    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"
Jul 10 18:08:56.189957 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:56.189914    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"]
Jul 10 18:08:56.190160 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:56.190133    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk" podUID="4d22b357-bbf5-43a4-837c-31e1afd7bb5a" containerName="manager" containerID="cri-o://d095c8b8987c29242aa42bc2c1379dce5194b9153713c1e24d982619dafbfbef" gracePeriod=10
Jul 10 18:08:56.451494 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:56.451460    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"
Jul 10 18:08:56.554366 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:56.554324    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d22b357-bbf5-43a4-837c-31e1afd7bb5a-extensions-socket-volume\") pod \"4d22b357-bbf5-43a4-837c-31e1afd7bb5a\" (UID: \"4d22b357-bbf5-43a4-837c-31e1afd7bb5a\") "
Jul 10 18:08:56.554366 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:56.554374    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s62x9\" (UniqueName: \"kubernetes.io/projected/4d22b357-bbf5-43a4-837c-31e1afd7bb5a-kube-api-access-s62x9\") pod \"4d22b357-bbf5-43a4-837c-31e1afd7bb5a\" (UID: \"4d22b357-bbf5-43a4-837c-31e1afd7bb5a\") "
Jul 10 18:08:56.554743 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:56.554711    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d22b357-bbf5-43a4-837c-31e1afd7bb5a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4d22b357-bbf5-43a4-837c-31e1afd7bb5a" (UID: "4d22b357-bbf5-43a4-837c-31e1afd7bb5a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:08:56.556593 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:56.556557    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d22b357-bbf5-43a4-837c-31e1afd7bb5a-kube-api-access-s62x9" (OuterVolumeSpecName: "kube-api-access-s62x9") pod "4d22b357-bbf5-43a4-837c-31e1afd7bb5a" (UID: "4d22b357-bbf5-43a4-837c-31e1afd7bb5a"). InnerVolumeSpecName "kube-api-access-s62x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:08:56.654979 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:56.654940    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d22b357-bbf5-43a4-837c-31e1afd7bb5a-extensions-socket-volume\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:08:56.654979 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:56.654977    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s62x9\" (UniqueName: \"kubernetes.io/projected/4d22b357-bbf5-43a4-837c-31e1afd7bb5a-kube-api-access-s62x9\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:08:57.179981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:57.179943    2569 generic.go:356] "Generic (PLEG): container finished" podID="4d22b357-bbf5-43a4-837c-31e1afd7bb5a" containerID="d095c8b8987c29242aa42bc2c1379dce5194b9153713c1e24d982619dafbfbef" exitCode=0
Jul 10 18:08:57.180428 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:57.180007    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"
Jul 10 18:08:57.180428 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:57.180021    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk" event={"ID":"4d22b357-bbf5-43a4-837c-31e1afd7bb5a","Type":"ContainerDied","Data":"d095c8b8987c29242aa42bc2c1379dce5194b9153713c1e24d982619dafbfbef"}
Jul 10 18:08:57.180428 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:57.180072    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk" event={"ID":"4d22b357-bbf5-43a4-837c-31e1afd7bb5a","Type":"ContainerDied","Data":"6844549c6851999d119282a32c5d2878400014a4548f8519657b6c2642d52ad4"}
Jul 10 18:08:57.180428 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:57.180093    2569 scope.go:117] "RemoveContainer" containerID="d095c8b8987c29242aa42bc2c1379dce5194b9153713c1e24d982619dafbfbef"
Jul 10 18:08:57.190398 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:57.190371    2569 scope.go:117] "RemoveContainer" containerID="d095c8b8987c29242aa42bc2c1379dce5194b9153713c1e24d982619dafbfbef"
Jul 10 18:08:57.190708 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:08:57.190687    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d095c8b8987c29242aa42bc2c1379dce5194b9153713c1e24d982619dafbfbef\": container with ID starting with d095c8b8987c29242aa42bc2c1379dce5194b9153713c1e24d982619dafbfbef not found: ID does not exist" containerID="d095c8b8987c29242aa42bc2c1379dce5194b9153713c1e24d982619dafbfbef"
Jul 10 18:08:57.190823 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:57.190718    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d095c8b8987c29242aa42bc2c1379dce5194b9153713c1e24d982619dafbfbef"} err="failed to get container status \"d095c8b8987c29242aa42bc2c1379dce5194b9153713c1e24d982619dafbfbef\": rpc error: code = NotFound desc = could not find container \"d095c8b8987c29242aa42bc2c1379dce5194b9153713c1e24d982619dafbfbef\": container with ID starting with d095c8b8987c29242aa42bc2c1379dce5194b9153713c1e24d982619dafbfbef not found: ID does not exist"
Jul 10 18:08:57.220013 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:57.219981    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"]
Jul 10 18:08:57.235285 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:57.235242    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4gkbk"]
Jul 10 18:08:58.020057 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:08:58.020008    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d22b357-bbf5-43a4-837c-31e1afd7bb5a" path="/var/lib/kubelet/pods/4d22b357-bbf5-43a4-837c-31e1afd7bb5a/volumes"
Jul 10 18:09:00.601801 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:00.601698    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:00.689237 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:00.689192    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:01.134027 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:01.133989    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:01.188685 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:01.188652    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:13.493767 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.493727    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z27xb"]
Jul 10 18:09:13.494183 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.494077    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d22b357-bbf5-43a4-837c-31e1afd7bb5a" containerName="manager"
Jul 10 18:09:13.494183 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.494089    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d22b357-bbf5-43a4-837c-31e1afd7bb5a" containerName="manager"
Jul 10 18:09:13.494183 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.494140    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d22b357-bbf5-43a4-837c-31e1afd7bb5a" containerName="manager"
Jul 10 18:09:13.498817 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.498789    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb"
Jul 10 18:09:13.501288 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.501250    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:13.501567 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.501550    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 18:09:13.501755 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.501735    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fcbzs\""
Jul 10 18:09:13.508053 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.508025    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z27xb"]
Jul 10 18:09:13.595714 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.595681    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z27xb"]
Jul 10 18:09:13.595995 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.595967    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74htb\" (UniqueName: \"kubernetes.io/projected/db0cfa05-af4b-4137-bb7c-60986972b20f-kube-api-access-74htb\") pod \"limitador-limitador-64c94fd64f-z27xb\" (UID: \"db0cfa05-af4b-4137-bb7c-60986972b20f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb"
Jul 10 18:09:13.596066 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.596052    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/db0cfa05-af4b-4137-bb7c-60986972b20f-config-file\") pod \"limitador-limitador-64c94fd64f-z27xb\" (UID: \"db0cfa05-af4b-4137-bb7c-60986972b20f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb"
Jul 10 18:09:13.600005 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.599976    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:13.696857 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.696821    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/db0cfa05-af4b-4137-bb7c-60986972b20f-config-file\") pod \"limitador-limitador-64c94fd64f-z27xb\" (UID: \"db0cfa05-af4b-4137-bb7c-60986972b20f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb"
Jul 10 18:09:13.697080 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.697009    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74htb\" (UniqueName: \"kubernetes.io/projected/db0cfa05-af4b-4137-bb7c-60986972b20f-kube-api-access-74htb\") pod \"limitador-limitador-64c94fd64f-z27xb\" (UID: \"db0cfa05-af4b-4137-bb7c-60986972b20f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb"
Jul 10 18:09:13.697632 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.697609    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/db0cfa05-af4b-4137-bb7c-60986972b20f-config-file\") pod \"limitador-limitador-64c94fd64f-z27xb\" (UID: \"db0cfa05-af4b-4137-bb7c-60986972b20f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb"
Jul 10 18:09:13.697860 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.697833    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:13.705786 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.705757    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74htb\" (UniqueName: \"kubernetes.io/projected/db0cfa05-af4b-4137-bb7c-60986972b20f-kube-api-access-74htb\") pod \"limitador-limitador-64c94fd64f-z27xb\" (UID: \"db0cfa05-af4b-4137-bb7c-60986972b20f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb"
Jul 10 18:09:13.811410 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.811363    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb"
Jul 10 18:09:13.957755 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:13.957716    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z27xb"]
Jul 10 18:09:13.961098 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:09:13.961061    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0cfa05_af4b_4137_bb7c_60986972b20f.slice/crio-274e8affe20f9b21cffcfde6bf3cc6ea66a9566b27d2fb1c2a4d59c055ffddf3 WatchSource:0}: Error finding container 274e8affe20f9b21cffcfde6bf3cc6ea66a9566b27d2fb1c2a4d59c055ffddf3: Status 404 returned error can't find the container with id 274e8affe20f9b21cffcfde6bf3cc6ea66a9566b27d2fb1c2a4d59c055ffddf3
Jul 10 18:09:14.261895 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.261828    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb" event={"ID":"db0cfa05-af4b-4137-bb7c-60986972b20f","Type":"ContainerStarted","Data":"274e8affe20f9b21cffcfde6bf3cc6ea66a9566b27d2fb1c2a4d59c055ffddf3"}
Jul 10 18:09:14.308440 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.308400    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-slbmb"]
Jul 10 18:09:14.313061 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.313026    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-slbmb"
Jul 10 18:09:14.315782 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.315753    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hp22f\""
Jul 10 18:09:14.320582 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.320549    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-slbmb"]
Jul 10 18:09:14.359501 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.359455    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:14.403002 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.402958    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dfqq\" (UniqueName: \"kubernetes.io/projected/d165eb4c-11f4-42bb-92d0-566762710335-kube-api-access-4dfqq\") pod \"authorino-58cd955675-slbmb\" (UID: \"d165eb4c-11f4-42bb-92d0-566762710335\") " pod="kuadrant-system/authorino-58cd955675-slbmb"
Jul 10 18:09:14.461961 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.461927    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:14.503728 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.503690    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dfqq\" (UniqueName: \"kubernetes.io/projected/d165eb4c-11f4-42bb-92d0-566762710335-kube-api-access-4dfqq\") pod \"authorino-58cd955675-slbmb\" (UID: \"d165eb4c-11f4-42bb-92d0-566762710335\") " pod="kuadrant-system/authorino-58cd955675-slbmb"
Jul 10 18:09:14.513350 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.513235    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dfqq\" (UniqueName: \"kubernetes.io/projected/d165eb4c-11f4-42bb-92d0-566762710335-kube-api-access-4dfqq\") pod \"authorino-58cd955675-slbmb\" (UID: \"d165eb4c-11f4-42bb-92d0-566762710335\") " pod="kuadrant-system/authorino-58cd955675-slbmb"
Jul 10 18:09:14.611824 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.611787    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-6krcl"]
Jul 10 18:09:14.615167 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.615134    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6krcl"
Jul 10 18:09:14.623716 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.623689    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6krcl"]
Jul 10 18:09:14.626089 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.626063    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-slbmb"
Jul 10 18:09:14.705903 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.705870    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss9km\" (UniqueName: \"kubernetes.io/projected/054acdd4-8959-461c-945a-ed51c6003619-kube-api-access-ss9km\") pod \"authorino-75d556bd77-6krcl\" (UID: \"054acdd4-8959-461c-945a-ed51c6003619\") " pod="kuadrant-system/authorino-75d556bd77-6krcl"
Jul 10 18:09:14.769984 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.769925    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-slbmb"]
Jul 10 18:09:14.772557 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:09:14.772529    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd165eb4c_11f4_42bb_92d0_566762710335.slice/crio-19c788c2462ea53303900201dc32b01bc3435f0c33e763bd3f1e4d4f34dbc1da WatchSource:0}: Error finding container 19c788c2462ea53303900201dc32b01bc3435f0c33e763bd3f1e4d4f34dbc1da: Status 404 returned error can't find the container with id 19c788c2462ea53303900201dc32b01bc3435f0c33e763bd3f1e4d4f34dbc1da
Jul 10 18:09:14.806809 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.806771    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9km\" (UniqueName: \"kubernetes.io/projected/054acdd4-8959-461c-945a-ed51c6003619-kube-api-access-ss9km\") pod \"authorino-75d556bd77-6krcl\" (UID: \"054acdd4-8959-461c-945a-ed51c6003619\") " pod="kuadrant-system/authorino-75d556bd77-6krcl"
Jul 10 18:09:14.815558 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.815528    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss9km\" (UniqueName: \"kubernetes.io/projected/054acdd4-8959-461c-945a-ed51c6003619-kube-api-access-ss9km\") pod \"authorino-75d556bd77-6krcl\" (UID: \"054acdd4-8959-461c-945a-ed51c6003619\") " pod="kuadrant-system/authorino-75d556bd77-6krcl"
Jul 10 18:09:14.926160 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:14.926118    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6krcl"
Jul 10 18:09:15.113473 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:15.113437    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6krcl"]
Jul 10 18:09:15.116196 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:09:15.116133    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod054acdd4_8959_461c_945a_ed51c6003619.slice/crio-e8c761b84b6823b10e66e66b2cea41b8ad2b22b118bdfdb0e5426d50db583101 WatchSource:0}: Error finding container e8c761b84b6823b10e66e66b2cea41b8ad2b22b118bdfdb0e5426d50db583101: Status 404 returned error can't find the container with id e8c761b84b6823b10e66e66b2cea41b8ad2b22b118bdfdb0e5426d50db583101
Jul 10 18:09:15.285362 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:15.285295    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-slbmb" event={"ID":"d165eb4c-11f4-42bb-92d0-566762710335","Type":"ContainerStarted","Data":"19c788c2462ea53303900201dc32b01bc3435f0c33e763bd3f1e4d4f34dbc1da"}
Jul 10 18:09:15.287237 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:15.287115    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6krcl" event={"ID":"054acdd4-8959-461c-945a-ed51c6003619","Type":"ContainerStarted","Data":"e8c761b84b6823b10e66e66b2cea41b8ad2b22b118bdfdb0e5426d50db583101"}
Jul 10 18:09:18.309301 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:18.309260    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb" event={"ID":"db0cfa05-af4b-4137-bb7c-60986972b20f","Type":"ContainerStarted","Data":"f3a876f107a9a61afd32d419f6349eba5301437e48044d7dd13a8f945a25f78a"}
Jul 10 18:09:18.309792 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:18.309378    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb"
Jul 10 18:09:20.320080 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:20.320038    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-slbmb" event={"ID":"d165eb4c-11f4-42bb-92d0-566762710335","Type":"ContainerStarted","Data":"35c7fa828551e580379e97603dcf9951ab2047939b2f7160f40d79a364714b40"}
Jul 10 18:09:20.321620 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:20.321594    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6krcl" event={"ID":"054acdd4-8959-461c-945a-ed51c6003619","Type":"ContainerStarted","Data":"5970beef5e846e25a5785fbfd679ba9eb5a965c733e131802744cc4323cda309"}
Jul 10 18:09:20.341858 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:20.341803    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-slbmb" podStartSLOduration=1.492852782 podStartE2EDuration="6.341784353s" totalImagesPullingTime="4.848931571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:09:20.340299247 +0000 UTC m=+553.018566845" watchObservedRunningTime="2026-07-10 18:09:20.341784353 +0000 UTC m=+553.020051931"
Jul 10 18:09:20.342010 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:20.341993    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb" podStartSLOduration=4.000621423 podStartE2EDuration="7.341987485s" totalImagesPullingTime="3.341366062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:09:18.334084114 +0000 UTC m=+551.012351708" watchObservedRunningTime="2026-07-10 18:09:20.341987485 +0000 UTC m=+553.020255067"
Jul 10 18:09:20.359459 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:20.359393    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-6krcl" podStartSLOduration=1.842782589 podStartE2EDuration="6.359368692s" totalImagesPullingTime="4.516586103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:09:20.358368731 +0000 UTC m=+553.036636335" watchObservedRunningTime="2026-07-10 18:09:20.359368692 +0000 UTC m=+553.037636274"
Jul 10 18:09:20.390965 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:20.390929    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-slbmb"]
Jul 10 18:09:22.331580 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:22.331523    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-slbmb" podUID="d165eb4c-11f4-42bb-92d0-566762710335" containerName="authorino" containerID="cri-o://35c7fa828551e580379e97603dcf9951ab2047939b2f7160f40d79a364714b40" gracePeriod=30
Jul 10 18:09:22.602235 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:22.602204    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-slbmb"
Jul 10 18:09:22.774733 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:22.774697    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dfqq\" (UniqueName: \"kubernetes.io/projected/d165eb4c-11f4-42bb-92d0-566762710335-kube-api-access-4dfqq\") pod \"d165eb4c-11f4-42bb-92d0-566762710335\" (UID: \"d165eb4c-11f4-42bb-92d0-566762710335\") "
Jul 10 18:09:22.776856 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:22.776825    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d165eb4c-11f4-42bb-92d0-566762710335-kube-api-access-4dfqq" (OuterVolumeSpecName: "kube-api-access-4dfqq") pod "d165eb4c-11f4-42bb-92d0-566762710335" (UID: "d165eb4c-11f4-42bb-92d0-566762710335"). InnerVolumeSpecName "kube-api-access-4dfqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:09:22.875496 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:22.875404    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dfqq\" (UniqueName: \"kubernetes.io/projected/d165eb4c-11f4-42bb-92d0-566762710335-kube-api-access-4dfqq\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:09:23.336573 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:23.336532    2569 generic.go:356] "Generic (PLEG): container finished" podID="d165eb4c-11f4-42bb-92d0-566762710335" containerID="35c7fa828551e580379e97603dcf9951ab2047939b2f7160f40d79a364714b40" exitCode=0
Jul 10 18:09:23.336573 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:23.336577    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-slbmb"
Jul 10 18:09:23.337046 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:23.336603    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-slbmb" event={"ID":"d165eb4c-11f4-42bb-92d0-566762710335","Type":"ContainerDied","Data":"35c7fa828551e580379e97603dcf9951ab2047939b2f7160f40d79a364714b40"}
Jul 10 18:09:23.337046 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:23.336642    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-slbmb" event={"ID":"d165eb4c-11f4-42bb-92d0-566762710335","Type":"ContainerDied","Data":"19c788c2462ea53303900201dc32b01bc3435f0c33e763bd3f1e4d4f34dbc1da"}
Jul 10 18:09:23.337046 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:23.336663    2569 scope.go:117] "RemoveContainer" containerID="35c7fa828551e580379e97603dcf9951ab2047939b2f7160f40d79a364714b40"
Jul 10 18:09:23.347513 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:23.347492    2569 scope.go:117] "RemoveContainer" containerID="35c7fa828551e580379e97603dcf9951ab2047939b2f7160f40d79a364714b40"
Jul 10 18:09:23.347860 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:09:23.347841    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35c7fa828551e580379e97603dcf9951ab2047939b2f7160f40d79a364714b40\": container with ID starting with 35c7fa828551e580379e97603dcf9951ab2047939b2f7160f40d79a364714b40 not found: ID does not exist" containerID="35c7fa828551e580379e97603dcf9951ab2047939b2f7160f40d79a364714b40"
Jul 10 18:09:23.347925 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:23.347870    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35c7fa828551e580379e97603dcf9951ab2047939b2f7160f40d79a364714b40"} err="failed to get container status \"35c7fa828551e580379e97603dcf9951ab2047939b2f7160f40d79a364714b40\": rpc error: code = NotFound desc = could not find container \"35c7fa828551e580379e97603dcf9951ab2047939b2f7160f40d79a364714b40\": container with ID starting with 35c7fa828551e580379e97603dcf9951ab2047939b2f7160f40d79a364714b40 not found: ID does not exist"
Jul 10 18:09:23.369993 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:23.369954    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-slbmb"]
Jul 10 18:09:23.381187 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:23.381153    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-slbmb"]
Jul 10 18:09:24.014061 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:24.014015    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d165eb4c-11f4-42bb-92d0-566762710335" path="/var/lib/kubelet/pods/d165eb4c-11f4-42bb-92d0-566762710335/volumes"
Jul 10 18:09:29.315723 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:29.315687    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb"
Jul 10 18:09:29.432491 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:29.432448    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z27xb"]
Jul 10 18:09:29.432676 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:29.432648    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb" podUID="db0cfa05-af4b-4137-bb7c-60986972b20f" containerName="limitador" containerID="cri-o://f3a876f107a9a61afd32d419f6349eba5301437e48044d7dd13a8f945a25f78a" gracePeriod=30
Jul 10 18:09:29.988703 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:29.988671    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb"
Jul 10 18:09:30.027944 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.027906    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74htb\" (UniqueName: \"kubernetes.io/projected/db0cfa05-af4b-4137-bb7c-60986972b20f-kube-api-access-74htb\") pod \"db0cfa05-af4b-4137-bb7c-60986972b20f\" (UID: \"db0cfa05-af4b-4137-bb7c-60986972b20f\") "
Jul 10 18:09:30.028181 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.027971    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/db0cfa05-af4b-4137-bb7c-60986972b20f-config-file\") pod \"db0cfa05-af4b-4137-bb7c-60986972b20f\" (UID: \"db0cfa05-af4b-4137-bb7c-60986972b20f\") "
Jul 10 18:09:30.028430 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.028401    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db0cfa05-af4b-4137-bb7c-60986972b20f-config-file" (OuterVolumeSpecName: "config-file") pod "db0cfa05-af4b-4137-bb7c-60986972b20f" (UID: "db0cfa05-af4b-4137-bb7c-60986972b20f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:09:30.030263 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.030233    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db0cfa05-af4b-4137-bb7c-60986972b20f-kube-api-access-74htb" (OuterVolumeSpecName: "kube-api-access-74htb") pod "db0cfa05-af4b-4137-bb7c-60986972b20f" (UID: "db0cfa05-af4b-4137-bb7c-60986972b20f"). InnerVolumeSpecName "kube-api-access-74htb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:09:30.128665 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.128629    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74htb\" (UniqueName: \"kubernetes.io/projected/db0cfa05-af4b-4137-bb7c-60986972b20f-kube-api-access-74htb\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:09:30.128665 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.128662    2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/db0cfa05-af4b-4137-bb7c-60986972b20f-config-file\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:09:30.369829 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.369732    2569 generic.go:356] "Generic (PLEG): container finished" podID="db0cfa05-af4b-4137-bb7c-60986972b20f" containerID="f3a876f107a9a61afd32d419f6349eba5301437e48044d7dd13a8f945a25f78a" exitCode=0
Jul 10 18:09:30.369829 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.369778    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb"
Jul 10 18:09:30.369829 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.369816    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb" event={"ID":"db0cfa05-af4b-4137-bb7c-60986972b20f","Type":"ContainerDied","Data":"f3a876f107a9a61afd32d419f6349eba5301437e48044d7dd13a8f945a25f78a"}
Jul 10 18:09:30.370404 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.369870    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z27xb" event={"ID":"db0cfa05-af4b-4137-bb7c-60986972b20f","Type":"ContainerDied","Data":"274e8affe20f9b21cffcfde6bf3cc6ea66a9566b27d2fb1c2a4d59c055ffddf3"}
Jul 10 18:09:30.370404 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.369894    2569 scope.go:117] "RemoveContainer" containerID="f3a876f107a9a61afd32d419f6349eba5301437e48044d7dd13a8f945a25f78a"
Jul 10 18:09:30.378714 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.378695    2569 scope.go:117] "RemoveContainer" containerID="f3a876f107a9a61afd32d419f6349eba5301437e48044d7dd13a8f945a25f78a"
Jul 10 18:09:30.379061 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:09:30.379039    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3a876f107a9a61afd32d419f6349eba5301437e48044d7dd13a8f945a25f78a\": container with ID starting with f3a876f107a9a61afd32d419f6349eba5301437e48044d7dd13a8f945a25f78a not found: ID does not exist" containerID="f3a876f107a9a61afd32d419f6349eba5301437e48044d7dd13a8f945a25f78a"
Jul 10 18:09:30.379120 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.379068    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a876f107a9a61afd32d419f6349eba5301437e48044d7dd13a8f945a25f78a"} err="failed to get container status \"f3a876f107a9a61afd32d419f6349eba5301437e48044d7dd13a8f945a25f78a\": rpc error: code = NotFound desc = could not find container \"f3a876f107a9a61afd32d419f6349eba5301437e48044d7dd13a8f945a25f78a\": container with ID starting with f3a876f107a9a61afd32d419f6349eba5301437e48044d7dd13a8f945a25f78a not found: ID does not exist"
Jul 10 18:09:30.391634 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.391600    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z27xb"]
Jul 10 18:09:30.395364 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:30.395332    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z27xb"]
Jul 10 18:09:32.014037 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:32.013999    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db0cfa05-af4b-4137-bb7c-60986972b20f" path="/var/lib/kubelet/pods/db0cfa05-af4b-4137-bb7c-60986972b20f/volumes"
Jul 10 18:09:33.913183 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:33.913141    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:34.009654 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.009618    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:34.357160 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.357121    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl"]
Jul 10 18:09:34.357458 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.357446    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db0cfa05-af4b-4137-bb7c-60986972b20f" containerName="limitador"
Jul 10 18:09:34.357507 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.357460    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="db0cfa05-af4b-4137-bb7c-60986972b20f" containerName="limitador"
Jul 10 18:09:34.357507 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.357475    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d165eb4c-11f4-42bb-92d0-566762710335" containerName="authorino"
Jul 10 18:09:34.357507 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.357481    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d165eb4c-11f4-42bb-92d0-566762710335" containerName="authorino"
Jul 10 18:09:34.357610 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.357541    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d165eb4c-11f4-42bb-92d0-566762710335" containerName="authorino"
Jul 10 18:09:34.357610 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.357551    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="db0cfa05-af4b-4137-bb7c-60986972b20f" containerName="limitador"
Jul 10 18:09:34.360597 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.360573    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl"
Jul 10 18:09:34.364014 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.363988    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 10 18:09:34.364154 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.364049    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 18:09:34.364343 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.364326    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-9brfj\""
Jul 10 18:09:34.364421 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.364359    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 18:09:34.369667 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.369639    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl"]
Jul 10 18:09:34.386713 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.386679    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:34.459258 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.459218    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/eb98e350-d73d-4fdc-90ac-eea22ac3a67f-data\") pod \"postgres-69fb4594cf-r6dwl\" (UID: \"eb98e350-d73d-4fdc-90ac-eea22ac3a67f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl"
Jul 10 18:09:34.459482 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.459392    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4x8p\" (UniqueName: \"kubernetes.io/projected/eb98e350-d73d-4fdc-90ac-eea22ac3a67f-kube-api-access-s4x8p\") pod \"postgres-69fb4594cf-r6dwl\" (UID: \"eb98e350-d73d-4fdc-90ac-eea22ac3a67f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl"
Jul 10 18:09:34.560001 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.559953    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4x8p\" (UniqueName: \"kubernetes.io/projected/eb98e350-d73d-4fdc-90ac-eea22ac3a67f-kube-api-access-s4x8p\") pod \"postgres-69fb4594cf-r6dwl\" (UID: \"eb98e350-d73d-4fdc-90ac-eea22ac3a67f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl"
Jul 10 18:09:34.560178 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.560015    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/eb98e350-d73d-4fdc-90ac-eea22ac3a67f-data\") pod \"postgres-69fb4594cf-r6dwl\" (UID: \"eb98e350-d73d-4fdc-90ac-eea22ac3a67f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl"
Jul 10 18:09:34.560420 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.560400    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/eb98e350-d73d-4fdc-90ac-eea22ac3a67f-data\") pod \"postgres-69fb4594cf-r6dwl\" (UID: \"eb98e350-d73d-4fdc-90ac-eea22ac3a67f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl"
Jul 10 18:09:34.570623 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.570598    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4x8p\" (UniqueName: \"kubernetes.io/projected/eb98e350-d73d-4fdc-90ac-eea22ac3a67f-kube-api-access-s4x8p\") pod \"postgres-69fb4594cf-r6dwl\" (UID: \"eb98e350-d73d-4fdc-90ac-eea22ac3a67f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl"
Jul 10 18:09:34.672889 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.672784    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl"
Jul 10 18:09:34.814926 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:34.814899    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl"]
Jul 10 18:09:34.818362 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:09:34.818302    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb98e350_d73d_4fdc_90ac_eea22ac3a67f.slice/crio-bfcaef9555efbf971b89e34bde012e5e596a55f78d870e520a23266553118046 WatchSource:0}: Error finding container bfcaef9555efbf971b89e34bde012e5e596a55f78d870e520a23266553118046: Status 404 returned error can't find the container with id bfcaef9555efbf971b89e34bde012e5e596a55f78d870e520a23266553118046
Jul 10 18:09:35.395024 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:35.394991    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl" event={"ID":"eb98e350-d73d-4fdc-90ac-eea22ac3a67f","Type":"ContainerStarted","Data":"bfcaef9555efbf971b89e34bde012e5e596a55f78d870e520a23266553118046"}
Jul 10 18:09:40.425687 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:40.425587    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl" event={"ID":"eb98e350-d73d-4fdc-90ac-eea22ac3a67f","Type":"ContainerStarted","Data":"7193afabd280c14bf72c1db6c34377d23c32f62f9c9d44caf26a64d92216066d"}
Jul 10 18:09:40.426055 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:40.425697    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl"
Jul 10 18:09:40.449971 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:40.449910    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl" podStartSLOduration=1.244628098 podStartE2EDuration="6.449893488s" totalImagesPullingTime="5.20526539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:09:40.448433638 +0000 UTC m=+573.126701238" watchObservedRunningTime="2026-07-10 18:09:40.449893488 +0000 UTC m=+573.128161139"
Jul 10 18:09:46.463243 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:46.463211    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r6dwl"
Jul 10 18:09:46.838246 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:46.838206    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:47.091245 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.091140    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4vmt4"]
Jul 10 18:09:47.099343 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.099295    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4vmt4"
Jul 10 18:09:47.114106 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.114070    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4vmt4"]
Jul 10 18:09:47.152066 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.152023    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssfs2\" (UniqueName: \"kubernetes.io/projected/45b19861-0aa4-471b-88e3-42985184967a-kube-api-access-ssfs2\") pod \"authorino-5d4b67c446-4vmt4\" (UID: \"45b19861-0aa4-471b-88e3-42985184967a\") " pod="kuadrant-system/authorino-5d4b67c446-4vmt4"
Jul 10 18:09:47.253177 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.253138    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssfs2\" (UniqueName: \"kubernetes.io/projected/45b19861-0aa4-471b-88e3-42985184967a-kube-api-access-ssfs2\") pod \"authorino-5d4b67c446-4vmt4\" (UID: \"45b19861-0aa4-471b-88e3-42985184967a\") " pod="kuadrant-system/authorino-5d4b67c446-4vmt4"
Jul 10 18:09:47.266640 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.266600    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:47.278218 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.278178    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssfs2\" (UniqueName: \"kubernetes.io/projected/45b19861-0aa4-471b-88e3-42985184967a-kube-api-access-ssfs2\") pod \"authorino-5d4b67c446-4vmt4\" (UID: \"45b19861-0aa4-471b-88e3-42985184967a\") " pod="kuadrant-system/authorino-5d4b67c446-4vmt4"
Jul 10 18:09:47.390902 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.390800    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4vmt4"]
Jul 10 18:09:47.391062 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.391050    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4vmt4"
Jul 10 18:09:47.549627 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.549488    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4vmt4"]
Jul 10 18:09:47.552540 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:09:47.552510    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45b19861_0aa4_471b_88e3_42985184967a.slice/crio-3cbf8a13c78b1c0e679cc32f6d23128d5e99ce94bea99980355a8aba16a24a84 WatchSource:0}: Error finding container 3cbf8a13c78b1c0e679cc32f6d23128d5e99ce94bea99980355a8aba16a24a84: Status 404 returned error can't find the container with id 3cbf8a13c78b1c0e679cc32f6d23128d5e99ce94bea99980355a8aba16a24a84
Jul 10 18:09:47.849238 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.849098    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d68ffdc86-82zvn"]
Jul 10 18:09:47.854461 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.854429    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d68ffdc86-82zvn"
Jul 10 18:09:47.857201 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.857174    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35d0b561-500a-4540-9f23-97acebe71ecc-tls-cert\") pod \"authorino-d68ffdc86-82zvn\" (UID: \"35d0b561-500a-4540-9f23-97acebe71ecc\") " pod="kuadrant-system/authorino-d68ffdc86-82zvn"
Jul 10 18:09:47.857397 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.857206    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxm2n\" (UniqueName: \"kubernetes.io/projected/35d0b561-500a-4540-9f23-97acebe71ecc-kube-api-access-vxm2n\") pod \"authorino-d68ffdc86-82zvn\" (UID: \"35d0b561-500a-4540-9f23-97acebe71ecc\") " pod="kuadrant-system/authorino-d68ffdc86-82zvn"
Jul 10 18:09:47.857596 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.857564    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 10 18:09:47.873362 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.873322    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d68ffdc86-82zvn"]
Jul 10 18:09:47.957682 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.957650    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35d0b561-500a-4540-9f23-97acebe71ecc-tls-cert\") pod \"authorino-d68ffdc86-82zvn\" (UID: \"35d0b561-500a-4540-9f23-97acebe71ecc\") " pod="kuadrant-system/authorino-d68ffdc86-82zvn"
Jul 10 18:09:47.957877 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.957684    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxm2n\" (UniqueName: \"kubernetes.io/projected/35d0b561-500a-4540-9f23-97acebe71ecc-kube-api-access-vxm2n\") pod \"authorino-d68ffdc86-82zvn\" (UID: \"35d0b561-500a-4540-9f23-97acebe71ecc\") " pod="kuadrant-system/authorino-d68ffdc86-82zvn"
Jul 10 18:09:47.960337 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.960297    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35d0b561-500a-4540-9f23-97acebe71ecc-tls-cert\") pod \"authorino-d68ffdc86-82zvn\" (UID: \"35d0b561-500a-4540-9f23-97acebe71ecc\") " pod="kuadrant-system/authorino-d68ffdc86-82zvn"
Jul 10 18:09:47.968771 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:47.968738    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxm2n\" (UniqueName: \"kubernetes.io/projected/35d0b561-500a-4540-9f23-97acebe71ecc-kube-api-access-vxm2n\") pod \"authorino-d68ffdc86-82zvn\" (UID: \"35d0b561-500a-4540-9f23-97acebe71ecc\") " pod="kuadrant-system/authorino-d68ffdc86-82zvn"
Jul 10 18:09:48.164156 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:48.164069    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d68ffdc86-82zvn"
Jul 10 18:09:48.317395 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:48.317365    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d68ffdc86-82zvn"]
Jul 10 18:09:48.320057 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:09:48.320024    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35d0b561_500a_4540_9f23_97acebe71ecc.slice/crio-a5f9ce3480aca9fe8d7f2e932ceef4ea4bba568a19e82b364274c24c8a741646 WatchSource:0}: Error finding container a5f9ce3480aca9fe8d7f2e932ceef4ea4bba568a19e82b364274c24c8a741646: Status 404 returned error can't find the container with id a5f9ce3480aca9fe8d7f2e932ceef4ea4bba568a19e82b364274c24c8a741646
Jul 10 18:09:48.466616 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:48.466522    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4vmt4" event={"ID":"45b19861-0aa4-471b-88e3-42985184967a","Type":"ContainerStarted","Data":"ca2b413e2197672af7937ddc6d6328b116791a9380a1cc8372794724a8cdf283"}
Jul 10 18:09:48.466616 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:48.466556    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-4vmt4" podUID="45b19861-0aa4-471b-88e3-42985184967a" containerName="authorino" containerID="cri-o://ca2b413e2197672af7937ddc6d6328b116791a9380a1cc8372794724a8cdf283" gracePeriod=30
Jul 10 18:09:48.466616 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:48.466576    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4vmt4" event={"ID":"45b19861-0aa4-471b-88e3-42985184967a","Type":"ContainerStarted","Data":"3cbf8a13c78b1c0e679cc32f6d23128d5e99ce94bea99980355a8aba16a24a84"}
Jul 10 18:09:48.467812 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:48.467779    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d68ffdc86-82zvn" event={"ID":"35d0b561-500a-4540-9f23-97acebe71ecc","Type":"ContainerStarted","Data":"a5f9ce3480aca9fe8d7f2e932ceef4ea4bba568a19e82b364274c24c8a741646"}
Jul 10 18:09:48.506247 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:48.506186    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-4vmt4" podStartSLOduration=1.099408965 podStartE2EDuration="1.506165309s" totalImagesPullingTime="406.756344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:09:48.505286773 +0000 UTC m=+581.183554380" watchObservedRunningTime="2026-07-10 18:09:48.506165309 +0000 UTC m=+581.184432888"
Jul 10 18:09:48.723394 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:48.723331    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4vmt4"
Jul 10 18:09:48.762169 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:48.762062    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssfs2\" (UniqueName: \"kubernetes.io/projected/45b19861-0aa4-471b-88e3-42985184967a-kube-api-access-ssfs2\") pod \"45b19861-0aa4-471b-88e3-42985184967a\" (UID: \"45b19861-0aa4-471b-88e3-42985184967a\") "
Jul 10 18:09:48.764549 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:48.764511    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45b19861-0aa4-471b-88e3-42985184967a-kube-api-access-ssfs2" (OuterVolumeSpecName: "kube-api-access-ssfs2") pod "45b19861-0aa4-471b-88e3-42985184967a" (UID: "45b19861-0aa4-471b-88e3-42985184967a"). InnerVolumeSpecName "kube-api-access-ssfs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:09:48.863424 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:48.863388    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssfs2\" (UniqueName: \"kubernetes.io/projected/45b19861-0aa4-471b-88e3-42985184967a-kube-api-access-ssfs2\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:09:49.473399 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.473360    2569 generic.go:356] "Generic (PLEG): container finished" podID="45b19861-0aa4-471b-88e3-42985184967a" containerID="ca2b413e2197672af7937ddc6d6328b116791a9380a1cc8372794724a8cdf283" exitCode=0
Jul 10 18:09:49.473600 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.473421    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4vmt4"
Jul 10 18:09:49.473600 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.473446    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4vmt4" event={"ID":"45b19861-0aa4-471b-88e3-42985184967a","Type":"ContainerDied","Data":"ca2b413e2197672af7937ddc6d6328b116791a9380a1cc8372794724a8cdf283"}
Jul 10 18:09:49.473600 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.473491    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4vmt4" event={"ID":"45b19861-0aa4-471b-88e3-42985184967a","Type":"ContainerDied","Data":"3cbf8a13c78b1c0e679cc32f6d23128d5e99ce94bea99980355a8aba16a24a84"}
Jul 10 18:09:49.473600 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.473513    2569 scope.go:117] "RemoveContainer" containerID="ca2b413e2197672af7937ddc6d6328b116791a9380a1cc8372794724a8cdf283"
Jul 10 18:09:49.475240 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.475209    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d68ffdc86-82zvn" event={"ID":"35d0b561-500a-4540-9f23-97acebe71ecc","Type":"ContainerStarted","Data":"a8a41402aac2d6ec2bfba92876fff6570522d80eb8c1df3ec74a2b252ebe104d"}
Jul 10 18:09:49.482690 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.482671    2569 scope.go:117] "RemoveContainer" containerID="ca2b413e2197672af7937ddc6d6328b116791a9380a1cc8372794724a8cdf283"
Jul 10 18:09:49.483021 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:09:49.483001    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca2b413e2197672af7937ddc6d6328b116791a9380a1cc8372794724a8cdf283\": container with ID starting with ca2b413e2197672af7937ddc6d6328b116791a9380a1cc8372794724a8cdf283 not found: ID does not exist" containerID="ca2b413e2197672af7937ddc6d6328b116791a9380a1cc8372794724a8cdf283"
Jul 10 18:09:49.483067 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.483031    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2b413e2197672af7937ddc6d6328b116791a9380a1cc8372794724a8cdf283"} err="failed to get container status \"ca2b413e2197672af7937ddc6d6328b116791a9380a1cc8372794724a8cdf283\": rpc error: code = NotFound desc = could not find container \"ca2b413e2197672af7937ddc6d6328b116791a9380a1cc8372794724a8cdf283\": container with ID starting with ca2b413e2197672af7937ddc6d6328b116791a9380a1cc8372794724a8cdf283 not found: ID does not exist"
Jul 10 18:09:49.513563 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.513504    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d68ffdc86-82zvn" podStartSLOduration=2.099100688 podStartE2EDuration="2.513489198s" totalImagesPullingTime="414.38851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:09:49.513267462 +0000 UTC m=+582.191535065" watchObservedRunningTime="2026-07-10 18:09:49.513489198 +0000 UTC m=+582.191756846"
Jul 10 18:09:49.547204 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.547109    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4vmt4"]
Jul 10 18:09:49.555506 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.555473    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4vmt4"]
Jul 10 18:09:49.571837 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.571805    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6krcl"]
Jul 10 18:09:49.572036 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.572010    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-6krcl" podUID="054acdd4-8959-461c-945a-ed51c6003619" containerName="authorino" containerID="cri-o://5970beef5e846e25a5785fbfd679ba9eb5a965c733e131802744cc4323cda309" gracePeriod=30
Jul 10 18:09:49.834279 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.834250    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6krcl"
Jul 10 18:09:49.869789 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.869753    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss9km\" (UniqueName: \"kubernetes.io/projected/054acdd4-8959-461c-945a-ed51c6003619-kube-api-access-ss9km\") pod \"054acdd4-8959-461c-945a-ed51c6003619\" (UID: \"054acdd4-8959-461c-945a-ed51c6003619\") "
Jul 10 18:09:49.872294 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.872258    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/054acdd4-8959-461c-945a-ed51c6003619-kube-api-access-ss9km" (OuterVolumeSpecName: "kube-api-access-ss9km") pod "054acdd4-8959-461c-945a-ed51c6003619" (UID: "054acdd4-8959-461c-945a-ed51c6003619"). InnerVolumeSpecName "kube-api-access-ss9km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:09:49.970835 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:49.970796    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss9km\" (UniqueName: \"kubernetes.io/projected/054acdd4-8959-461c-945a-ed51c6003619-kube-api-access-ss9km\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:09:50.014024 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:50.013989    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45b19861-0aa4-471b-88e3-42985184967a" path="/var/lib/kubelet/pods/45b19861-0aa4-471b-88e3-42985184967a/volumes"
Jul 10 18:09:50.482290 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:50.482254    2569 generic.go:356] "Generic (PLEG): container finished" podID="054acdd4-8959-461c-945a-ed51c6003619" containerID="5970beef5e846e25a5785fbfd679ba9eb5a965c733e131802744cc4323cda309" exitCode=0
Jul 10 18:09:50.482510 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:50.482295    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6krcl"
Jul 10 18:09:50.482510 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:50.482339    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6krcl" event={"ID":"054acdd4-8959-461c-945a-ed51c6003619","Type":"ContainerDied","Data":"5970beef5e846e25a5785fbfd679ba9eb5a965c733e131802744cc4323cda309"}
Jul 10 18:09:50.482510 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:50.482376    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6krcl" event={"ID":"054acdd4-8959-461c-945a-ed51c6003619","Type":"ContainerDied","Data":"e8c761b84b6823b10e66e66b2cea41b8ad2b22b118bdfdb0e5426d50db583101"}
Jul 10 18:09:50.482510 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:50.482394    2569 scope.go:117] "RemoveContainer" containerID="5970beef5e846e25a5785fbfd679ba9eb5a965c733e131802744cc4323cda309"
Jul 10 18:09:50.491051 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:50.491030    2569 scope.go:117] "RemoveContainer" containerID="5970beef5e846e25a5785fbfd679ba9eb5a965c733e131802744cc4323cda309"
Jul 10 18:09:50.491417 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:09:50.491392    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5970beef5e846e25a5785fbfd679ba9eb5a965c733e131802744cc4323cda309\": container with ID starting with 5970beef5e846e25a5785fbfd679ba9eb5a965c733e131802744cc4323cda309 not found: ID does not exist" containerID="5970beef5e846e25a5785fbfd679ba9eb5a965c733e131802744cc4323cda309"
Jul 10 18:09:50.491512 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:50.491426    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5970beef5e846e25a5785fbfd679ba9eb5a965c733e131802744cc4323cda309"} err="failed to get container status \"5970beef5e846e25a5785fbfd679ba9eb5a965c733e131802744cc4323cda309\": rpc error: code = NotFound desc = could not find container \"5970beef5e846e25a5785fbfd679ba9eb5a965c733e131802744cc4323cda309\": container with ID starting with 5970beef5e846e25a5785fbfd679ba9eb5a965c733e131802744cc4323cda309 not found: ID does not exist"
Jul 10 18:09:50.510943 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:50.510906    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6krcl"]
Jul 10 18:09:50.522279 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:50.522245    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6krcl"]
Jul 10 18:09:52.013361 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:52.013305    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="054acdd4-8959-461c-945a-ed51c6003619" path="/var/lib/kubelet/pods/054acdd4-8959-461c-945a-ed51c6003619/volumes"
Jul 10 18:09:54.130207 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.130169    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85b98f7f96-qs92l"]
Jul 10 18:09:54.130672 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.130529    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b19861-0aa4-471b-88e3-42985184967a" containerName="authorino"
Jul 10 18:09:54.130672 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.130541    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b19861-0aa4-471b-88e3-42985184967a" containerName="authorino"
Jul 10 18:09:54.130672 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.130550    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054acdd4-8959-461c-945a-ed51c6003619" containerName="authorino"
Jul 10 18:09:54.130672 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.130556    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="054acdd4-8959-461c-945a-ed51c6003619" containerName="authorino"
Jul 10 18:09:54.130672 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.130607    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="054acdd4-8959-461c-945a-ed51c6003619" containerName="authorino"
Jul 10 18:09:54.130672 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.130615    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="45b19861-0aa4-471b-88e3-42985184967a" containerName="authorino"
Jul 10 18:09:54.135083 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.135035    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:54.135478 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.135459    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85b98f7f96-qs92l"
Jul 10 18:09:54.138025 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.137997    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5qk84\""
Jul 10 18:09:54.138025 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.138018    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 18:09:54.138211 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.138044    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 18:09:54.144415 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.144380    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85b98f7f96-qs92l"]
Jul 10 18:09:54.204415 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.204369    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e643244-36d1-49a6-957c-37f5853e3254-webhook-cert\") pod \"maas-controller-85b98f7f96-qs92l\" (UID: \"1e643244-36d1-49a6-957c-37f5853e3254\") " pod="opendatahub/maas-controller-85b98f7f96-qs92l"
Jul 10 18:09:54.204573 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.204431    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqs6g\" (UniqueName: \"kubernetes.io/projected/1e643244-36d1-49a6-957c-37f5853e3254-kube-api-access-bqs6g\") pod \"maas-controller-85b98f7f96-qs92l\" (UID: \"1e643244-36d1-49a6-957c-37f5853e3254\") " pod="opendatahub/maas-controller-85b98f7f96-qs92l"
Jul 10 18:09:54.215749 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.215711    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:54.304836 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.304796    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqs6g\" (UniqueName: \"kubernetes.io/projected/1e643244-36d1-49a6-957c-37f5853e3254-kube-api-access-bqs6g\") pod \"maas-controller-85b98f7f96-qs92l\" (UID: \"1e643244-36d1-49a6-957c-37f5853e3254\") " pod="opendatahub/maas-controller-85b98f7f96-qs92l"
Jul 10 18:09:54.305015 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.304982    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e643244-36d1-49a6-957c-37f5853e3254-webhook-cert\") pod \"maas-controller-85b98f7f96-qs92l\" (UID: \"1e643244-36d1-49a6-957c-37f5853e3254\") " pod="opendatahub/maas-controller-85b98f7f96-qs92l"
Jul 10 18:09:54.305114 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:09:54.305097    2569 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 10 18:09:54.305168 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:09:54.305158    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e643244-36d1-49a6-957c-37f5853e3254-webhook-cert podName:1e643244-36d1-49a6-957c-37f5853e3254 nodeName:}" failed. No retries permitted until 2026-07-10 18:09:54.805140845 +0000 UTC m=+587.483408404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1e643244-36d1-49a6-957c-37f5853e3254-webhook-cert") pod "maas-controller-85b98f7f96-qs92l" (UID: "1e643244-36d1-49a6-957c-37f5853e3254") : secret "maas-controller-webhook-cert" not found
Jul 10 18:09:54.313339 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.313258    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:54.316877 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.316849    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c8d7c5fbd-9crjf"]
Jul 10 18:09:54.319026 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.319000    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8d7c5fbd-9crjf"
Jul 10 18:09:54.319342 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.319293    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqs6g\" (UniqueName: \"kubernetes.io/projected/1e643244-36d1-49a6-957c-37f5853e3254-kube-api-access-bqs6g\") pod \"maas-controller-85b98f7f96-qs92l\" (UID: \"1e643244-36d1-49a6-957c-37f5853e3254\") " pod="opendatahub/maas-controller-85b98f7f96-qs92l"
Jul 10 18:09:54.329269 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.329237    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c8d7c5fbd-9crjf"]
Jul 10 18:09:54.392066 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.391972    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:54.406097 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.406062    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmstv\" (UniqueName: \"kubernetes.io/projected/5f774de3-f483-4643-8fa8-ea0526cd0c62-kube-api-access-jmstv\") pod \"maas-controller-c8d7c5fbd-9crjf\" (UID: \"5f774de3-f483-4643-8fa8-ea0526cd0c62\") " pod="opendatahub/maas-controller-c8d7c5fbd-9crjf"
Jul 10 18:09:54.406270 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.406154    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f774de3-f483-4643-8fa8-ea0526cd0c62-webhook-cert\") pod \"maas-controller-c8d7c5fbd-9crjf\" (UID: \"5f774de3-f483-4643-8fa8-ea0526cd0c62\") " pod="opendatahub/maas-controller-c8d7c5fbd-9crjf"
Jul 10 18:09:54.506591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.506550    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f774de3-f483-4643-8fa8-ea0526cd0c62-webhook-cert\") pod \"maas-controller-c8d7c5fbd-9crjf\" (UID: \"5f774de3-f483-4643-8fa8-ea0526cd0c62\") " pod="opendatahub/maas-controller-c8d7c5fbd-9crjf"
Jul 10 18:09:54.506806 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.506608    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmstv\" (UniqueName: \"kubernetes.io/projected/5f774de3-f483-4643-8fa8-ea0526cd0c62-kube-api-access-jmstv\") pod \"maas-controller-c8d7c5fbd-9crjf\" (UID: \"5f774de3-f483-4643-8fa8-ea0526cd0c62\") " pod="opendatahub/maas-controller-c8d7c5fbd-9crjf"
Jul 10 18:09:54.509270 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.509236    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f774de3-f483-4643-8fa8-ea0526cd0c62-webhook-cert\") pod \"maas-controller-c8d7c5fbd-9crjf\" (UID: \"5f774de3-f483-4643-8fa8-ea0526cd0c62\") " pod="opendatahub/maas-controller-c8d7c5fbd-9crjf"
Jul 10 18:09:54.515015 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.514989    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmstv\" (UniqueName: \"kubernetes.io/projected/5f774de3-f483-4643-8fa8-ea0526cd0c62-kube-api-access-jmstv\") pod \"maas-controller-c8d7c5fbd-9crjf\" (UID: \"5f774de3-f483-4643-8fa8-ea0526cd0c62\") " pod="opendatahub/maas-controller-c8d7c5fbd-9crjf"
Jul 10 18:09:54.637831 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.637784    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8d7c5fbd-9crjf"
Jul 10 18:09:54.785918 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.785874    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c8d7c5fbd-9crjf"]
Jul 10 18:09:54.786411 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:09:54.786385    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f774de3_f483_4643_8fa8_ea0526cd0c62.slice/crio-d4adf0aea21a35cbe1579ba3f5e50ceda558dfea2902ca214f74160367a2c80b WatchSource:0}: Error finding container d4adf0aea21a35cbe1579ba3f5e50ceda558dfea2902ca214f74160367a2c80b: Status 404 returned error can't find the container with id d4adf0aea21a35cbe1579ba3f5e50ceda558dfea2902ca214f74160367a2c80b
Jul 10 18:09:54.809223 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.809181    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e643244-36d1-49a6-957c-37f5853e3254-webhook-cert\") pod \"maas-controller-85b98f7f96-qs92l\" (UID: \"1e643244-36d1-49a6-957c-37f5853e3254\") " pod="opendatahub/maas-controller-85b98f7f96-qs92l"
Jul 10 18:09:54.811772 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:54.811747    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e643244-36d1-49a6-957c-37f5853e3254-webhook-cert\") pod \"maas-controller-85b98f7f96-qs92l\" (UID: \"1e643244-36d1-49a6-957c-37f5853e3254\") " pod="opendatahub/maas-controller-85b98f7f96-qs92l"
Jul 10 18:09:55.050044 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:55.049998    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85b98f7f96-qs92l"
Jul 10 18:09:55.192840 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:55.192812    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85b98f7f96-qs92l"]
Jul 10 18:09:55.195034 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:09:55.195000    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e643244_36d1_49a6_957c_37f5853e3254.slice/crio-18e864ee37a5bc72a2ce94f47e2c24ac83607070176b53ab3df5b5c71e6e6fc9 WatchSource:0}: Error finding container 18e864ee37a5bc72a2ce94f47e2c24ac83607070176b53ab3df5b5c71e6e6fc9: Status 404 returned error can't find the container with id 18e864ee37a5bc72a2ce94f47e2c24ac83607070176b53ab3df5b5c71e6e6fc9
Jul 10 18:09:55.508301 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:55.508241    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8d7c5fbd-9crjf" event={"ID":"5f774de3-f483-4643-8fa8-ea0526cd0c62","Type":"ContainerStarted","Data":"d4adf0aea21a35cbe1579ba3f5e50ceda558dfea2902ca214f74160367a2c80b"}
Jul 10 18:09:55.509729 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:55.509696    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85b98f7f96-qs92l" event={"ID":"1e643244-36d1-49a6-957c-37f5853e3254","Type":"ContainerStarted","Data":"18e864ee37a5bc72a2ce94f47e2c24ac83607070176b53ab3df5b5c71e6e6fc9"}
Jul 10 18:09:57.723772 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:57.723555    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:57.825660 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:57.825624    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:58.531003 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:58.530965    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8d7c5fbd-9crjf" event={"ID":"5f774de3-f483-4643-8fa8-ea0526cd0c62","Type":"ContainerStarted","Data":"5807a360056011cdaa2a5df85f373e610ba31636c69988f0f4357e8859b30180"}
Jul 10 18:09:58.531245 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:58.531033    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c8d7c5fbd-9crjf"
Jul 10 18:09:58.532766 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:58.532736    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85b98f7f96-qs92l" event={"ID":"1e643244-36d1-49a6-957c-37f5853e3254","Type":"ContainerStarted","Data":"737cc371327857d60c84f673a1d9affc0dca4b1894856a8d3b297da232ac6fe6"}
Jul 10 18:09:58.532935 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:58.532816    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85b98f7f96-qs92l"
Jul 10 18:09:58.574846 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:58.574789    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c8d7c5fbd-9crjf" podStartSLOduration=1.868358492 podStartE2EDuration="4.574773768s" totalImagesPullingTime="2.706415276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:09:58.573644243 +0000 UTC m=+591.251911823" watchObservedRunningTime="2026-07-10 18:09:58.574773768 +0000 UTC m=+591.253041400"
Jul 10 18:09:58.604090 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:58.604049    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:09:58.611744 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:58.611693    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85b98f7f96-qs92l" podStartSLOduration=2.30293074 podStartE2EDuration="4.611668546s" totalImagesPullingTime="2.308737806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:09:58.609320852 +0000 UTC m=+591.287588425" watchObservedRunningTime="2026-07-10 18:09:58.611668546 +0000 UTC m=+591.289936124"
Jul 10 18:09:59.923875 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:09:59.923832    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:07.788978 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:07.788943    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:10:07.792556 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:07.792532    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:10:09.544134 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:09.544096    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c8d7c5fbd-9crjf"
Jul 10 18:10:09.544666 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:09.544178    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85b98f7f96-qs92l"
Jul 10 18:10:09.632002 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:09.631971    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85b98f7f96-qs92l"]
Jul 10 18:10:09.632208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:09.632166    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85b98f7f96-qs92l" podUID="1e643244-36d1-49a6-957c-37f5853e3254" containerName="manager" containerID="cri-o://737cc371327857d60c84f673a1d9affc0dca4b1894856a8d3b297da232ac6fe6" gracePeriod=30
Jul 10 18:10:09.951774 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:09.951734    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85b98f7f96-qs92l"
Jul 10 18:10:10.034049 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.034012    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e643244-36d1-49a6-957c-37f5853e3254-webhook-cert\") pod \"1e643244-36d1-49a6-957c-37f5853e3254\" (UID: \"1e643244-36d1-49a6-957c-37f5853e3254\") "
Jul 10 18:10:10.034223 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.034091    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqs6g\" (UniqueName: \"kubernetes.io/projected/1e643244-36d1-49a6-957c-37f5853e3254-kube-api-access-bqs6g\") pod \"1e643244-36d1-49a6-957c-37f5853e3254\" (UID: \"1e643244-36d1-49a6-957c-37f5853e3254\") "
Jul 10 18:10:10.036447 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.036403    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e643244-36d1-49a6-957c-37f5853e3254-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1e643244-36d1-49a6-957c-37f5853e3254" (UID: "1e643244-36d1-49a6-957c-37f5853e3254"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:10:10.036618 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.036447    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e643244-36d1-49a6-957c-37f5853e3254-kube-api-access-bqs6g" (OuterVolumeSpecName: "kube-api-access-bqs6g") pod "1e643244-36d1-49a6-957c-37f5853e3254" (UID: "1e643244-36d1-49a6-957c-37f5853e3254"). InnerVolumeSpecName "kube-api-access-bqs6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:10:10.135626 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.135539    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e643244-36d1-49a6-957c-37f5853e3254-webhook-cert\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:10:10.135626 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.135572    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqs6g\" (UniqueName: \"kubernetes.io/projected/1e643244-36d1-49a6-957c-37f5853e3254-kube-api-access-bqs6g\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:10:10.590929 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.590890    2569 generic.go:356] "Generic (PLEG): container finished" podID="1e643244-36d1-49a6-957c-37f5853e3254" containerID="737cc371327857d60c84f673a1d9affc0dca4b1894856a8d3b297da232ac6fe6" exitCode=0
Jul 10 18:10:10.591449 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.590949    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85b98f7f96-qs92l"
Jul 10 18:10:10.591449 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.590974    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85b98f7f96-qs92l" event={"ID":"1e643244-36d1-49a6-957c-37f5853e3254","Type":"ContainerDied","Data":"737cc371327857d60c84f673a1d9affc0dca4b1894856a8d3b297da232ac6fe6"}
Jul 10 18:10:10.591449 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.591072    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85b98f7f96-qs92l" event={"ID":"1e643244-36d1-49a6-957c-37f5853e3254","Type":"ContainerDied","Data":"18e864ee37a5bc72a2ce94f47e2c24ac83607070176b53ab3df5b5c71e6e6fc9"}
Jul 10 18:10:10.591449 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.591110    2569 scope.go:117] "RemoveContainer" containerID="737cc371327857d60c84f673a1d9affc0dca4b1894856a8d3b297da232ac6fe6"
Jul 10 18:10:10.600614 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.600588    2569 scope.go:117] "RemoveContainer" containerID="737cc371327857d60c84f673a1d9affc0dca4b1894856a8d3b297da232ac6fe6"
Jul 10 18:10:10.601005 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:10:10.600985    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"737cc371327857d60c84f673a1d9affc0dca4b1894856a8d3b297da232ac6fe6\": container with ID starting with 737cc371327857d60c84f673a1d9affc0dca4b1894856a8d3b297da232ac6fe6 not found: ID does not exist" containerID="737cc371327857d60c84f673a1d9affc0dca4b1894856a8d3b297da232ac6fe6"
Jul 10 18:10:10.601070 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.601017    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737cc371327857d60c84f673a1d9affc0dca4b1894856a8d3b297da232ac6fe6"} err="failed to get container status \"737cc371327857d60c84f673a1d9affc0dca4b1894856a8d3b297da232ac6fe6\": rpc error: code = NotFound desc = could not find container \"737cc371327857d60c84f673a1d9affc0dca4b1894856a8d3b297da232ac6fe6\": container with ID starting with 737cc371327857d60c84f673a1d9affc0dca4b1894856a8d3b297da232ac6fe6 not found: ID does not exist"
Jul 10 18:10:10.614251 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.614212    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85b98f7f96-qs92l"]
Jul 10 18:10:10.617866 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:10.617835    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85b98f7f96-qs92l"]
Jul 10 18:10:12.013941 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:12.013907    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e643244-36d1-49a6-957c-37f5853e3254" path="/var/lib/kubelet/pods/1e643244-36d1-49a6-957c-37f5853e3254/volumes"
Jul 10 18:10:24.071565 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:24.071514    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:25.425601 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:25.425558    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:28.780641 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:28.780597    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:29.393589 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.393557    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:29.448363 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.448302    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"]
Jul 10 18:10:29.449271 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.449244    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e643244-36d1-49a6-957c-37f5853e3254" containerName="manager"
Jul 10 18:10:29.449448 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.449436    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e643244-36d1-49a6-957c-37f5853e3254" containerName="manager"
Jul 10 18:10:29.449717 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.449703    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e643244-36d1-49a6-957c-37f5853e3254" containerName="manager"
Jul 10 18:10:29.455045 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.455011    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"
Jul 10 18:10:29.458543 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.458517    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 10 18:10:29.470098 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.470065    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"]
Jul 10 18:10:29.556784 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.556751    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:29.598828 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.598789    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5-openshift-service-ca\") pod \"maas-api-868ff7b6d7-8j54n\" (UID: \"7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5\") " pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"
Jul 10 18:10:29.599007 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.598845    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k5tk\" (UniqueName: \"kubernetes.io/projected/7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5-kube-api-access-6k5tk\") pod \"maas-api-868ff7b6d7-8j54n\" (UID: \"7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5\") " pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"
Jul 10 18:10:29.599007 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.598923    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5-maas-api-tls\") pod \"maas-api-868ff7b6d7-8j54n\" (UID: \"7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5\") " pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"
Jul 10 18:10:29.699565 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.699481    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k5tk\" (UniqueName: \"kubernetes.io/projected/7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5-kube-api-access-6k5tk\") pod \"maas-api-868ff7b6d7-8j54n\" (UID: \"7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5\") " pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"
Jul 10 18:10:29.699565 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.699541    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5-maas-api-tls\") pod \"maas-api-868ff7b6d7-8j54n\" (UID: \"7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5\") " pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"
Jul 10 18:10:29.699798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.699570    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5-openshift-service-ca\") pod \"maas-api-868ff7b6d7-8j54n\" (UID: \"7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5\") " pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"
Jul 10 18:10:29.700157 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.700136    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5-openshift-service-ca\") pod \"maas-api-868ff7b6d7-8j54n\" (UID: \"7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5\") " pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"
Jul 10 18:10:29.702181 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.702156    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5-maas-api-tls\") pod \"maas-api-868ff7b6d7-8j54n\" (UID: \"7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5\") " pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"
Jul 10 18:10:29.709604 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.709568    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k5tk\" (UniqueName: \"kubernetes.io/projected/7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5-kube-api-access-6k5tk\") pod \"maas-api-868ff7b6d7-8j54n\" (UID: \"7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5\") " pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"
Jul 10 18:10:29.766369 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.766304    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"
Jul 10 18:10:29.932049 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.931868    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"]
Jul 10 18:10:29.935065 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:10:29.935031    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f61eaf5_6a19_470c_a7d8_e6d4bb5dd4a5.slice/crio-6eb8d9f933486bba54f06ce157c9df68b67230d7afad809e7396934cf1de5552 WatchSource:0}: Error finding container 6eb8d9f933486bba54f06ce157c9df68b67230d7afad809e7396934cf1de5552: Status 404 returned error can't find the container with id 6eb8d9f933486bba54f06ce157c9df68b67230d7afad809e7396934cf1de5552
Jul 10 18:10:29.975281 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:29.975185    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:30.065537 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.065499    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:30.175358 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.175304    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nv7pm"]
Jul 10 18:10:30.178594 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.178571    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nv7pm"
Jul 10 18:10:30.181652 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.181621    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7pn98\""
Jul 10 18:10:30.181842 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.181821    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 10 18:10:30.192270 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.192237    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nv7pm"]
Jul 10 18:10:30.225483 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.225393    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-5scwn"]
Jul 10 18:10:30.227997 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.227977    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-5scwn"
Jul 10 18:10:30.246323 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.246275    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-5scwn"]
Jul 10 18:10:30.304525 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.304477    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04f3e571-5fa9-4b35-b0b1-77c56b6735fe-plugins-config-volume\") pod \"payload-processing-58f86c7798-5scwn\" (UID: \"04f3e571-5fa9-4b35-b0b1-77c56b6735fe\") " pod="openshift-ingress/payload-processing-58f86c7798-5scwn"
Jul 10 18:10:30.304757 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.304557    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28088079-664d-4206-9136-2cf28525f281-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nv7pm\" (UID: \"28088079-664d-4206-9136-2cf28525f281\") " pod="openshift-ingress/payload-pre-processing-7964457696-nv7pm"
Jul 10 18:10:30.304757 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.304651    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7h94\" (UniqueName: \"kubernetes.io/projected/04f3e571-5fa9-4b35-b0b1-77c56b6735fe-kube-api-access-q7h94\") pod \"payload-processing-58f86c7798-5scwn\" (UID: \"04f3e571-5fa9-4b35-b0b1-77c56b6735fe\") " pod="openshift-ingress/payload-processing-58f86c7798-5scwn"
Jul 10 18:10:30.304757 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.304694    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgqwh\" (UniqueName: \"kubernetes.io/projected/28088079-664d-4206-9136-2cf28525f281-kube-api-access-cgqwh\") pod \"payload-pre-processing-7964457696-nv7pm\" (UID: \"28088079-664d-4206-9136-2cf28525f281\") " pod="openshift-ingress/payload-pre-processing-7964457696-nv7pm"
Jul 10 18:10:30.405290 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.405250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7h94\" (UniqueName: \"kubernetes.io/projected/04f3e571-5fa9-4b35-b0b1-77c56b6735fe-kube-api-access-q7h94\") pod \"payload-processing-58f86c7798-5scwn\" (UID: \"04f3e571-5fa9-4b35-b0b1-77c56b6735fe\") " pod="openshift-ingress/payload-processing-58f86c7798-5scwn"
Jul 10 18:10:30.405544 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.405302    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgqwh\" (UniqueName: \"kubernetes.io/projected/28088079-664d-4206-9136-2cf28525f281-kube-api-access-cgqwh\") pod \"payload-pre-processing-7964457696-nv7pm\" (UID: \"28088079-664d-4206-9136-2cf28525f281\") " pod="openshift-ingress/payload-pre-processing-7964457696-nv7pm"
Jul 10 18:10:30.405544 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.405368    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04f3e571-5fa9-4b35-b0b1-77c56b6735fe-plugins-config-volume\") pod \"payload-processing-58f86c7798-5scwn\" (UID: \"04f3e571-5fa9-4b35-b0b1-77c56b6735fe\") " pod="openshift-ingress/payload-processing-58f86c7798-5scwn"
Jul 10 18:10:30.405544 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.405408    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28088079-664d-4206-9136-2cf28525f281-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nv7pm\" (UID: \"28088079-664d-4206-9136-2cf28525f281\") " pod="openshift-ingress/payload-pre-processing-7964457696-nv7pm"
Jul 10 18:10:30.406184 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.406158    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28088079-664d-4206-9136-2cf28525f281-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nv7pm\" (UID: \"28088079-664d-4206-9136-2cf28525f281\") " pod="openshift-ingress/payload-pre-processing-7964457696-nv7pm"
Jul 10 18:10:30.406491 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.406472    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04f3e571-5fa9-4b35-b0b1-77c56b6735fe-plugins-config-volume\") pod \"payload-processing-58f86c7798-5scwn\" (UID: \"04f3e571-5fa9-4b35-b0b1-77c56b6735fe\") " pod="openshift-ingress/payload-processing-58f86c7798-5scwn"
Jul 10 18:10:30.416437 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.416407    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgqwh\" (UniqueName: \"kubernetes.io/projected/28088079-664d-4206-9136-2cf28525f281-kube-api-access-cgqwh\") pod \"payload-pre-processing-7964457696-nv7pm\" (UID: \"28088079-664d-4206-9136-2cf28525f281\") " pod="openshift-ingress/payload-pre-processing-7964457696-nv7pm"
Jul 10 18:10:30.416437 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.416421    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7h94\" (UniqueName: \"kubernetes.io/projected/04f3e571-5fa9-4b35-b0b1-77c56b6735fe-kube-api-access-q7h94\") pod \"payload-processing-58f86c7798-5scwn\" (UID: \"04f3e571-5fa9-4b35-b0b1-77c56b6735fe\") " pod="openshift-ingress/payload-processing-58f86c7798-5scwn"
Jul 10 18:10:30.490820 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.490716    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nv7pm"
Jul 10 18:10:30.539633 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.539591    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-5scwn"
Jul 10 18:10:30.651996 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.651965    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nv7pm"]
Jul 10 18:10:30.654379 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:10:30.654224    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28088079_664d_4206_9136_2cf28525f281.slice/crio-1ef137672e89315e3cb739688824f4e2538565b71c369f4788cb455a220c6a50 WatchSource:0}: Error finding container 1ef137672e89315e3cb739688824f4e2538565b71c369f4788cb455a220c6a50: Status 404 returned error can't find the container with id 1ef137672e89315e3cb739688824f4e2538565b71c369f4788cb455a220c6a50
Jul 10 18:10:30.683763 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.683711    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n" event={"ID":"7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5","Type":"ContainerStarted","Data":"6eb8d9f933486bba54f06ce157c9df68b67230d7afad809e7396934cf1de5552"}
Jul 10 18:10:30.685269 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.685236    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nv7pm" event={"ID":"28088079-664d-4206-9136-2cf28525f281","Type":"ContainerStarted","Data":"1ef137672e89315e3cb739688824f4e2538565b71c369f4788cb455a220c6a50"}
Jul 10 18:10:30.709283 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:30.709220    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-5scwn"]
Jul 10 18:10:30.711859 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:10:30.711822    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f3e571_5fa9_4b35_b0b1_77c56b6735fe.slice/crio-0218d8cefb7b9a978ac26ef58b17b946c1020e776ec9d340f931c47c1c25a20c WatchSource:0}: Error finding container 0218d8cefb7b9a978ac26ef58b17b946c1020e776ec9d340f931c47c1c25a20c: Status 404 returned error can't find the container with id 0218d8cefb7b9a978ac26ef58b17b946c1020e776ec9d340f931c47c1c25a20c
Jul 10 18:10:31.695987 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:31.695944    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-5scwn" event={"ID":"04f3e571-5fa9-4b35-b0b1-77c56b6735fe","Type":"ContainerStarted","Data":"0218d8cefb7b9a978ac26ef58b17b946c1020e776ec9d340f931c47c1c25a20c"}
Jul 10 18:10:32.704224 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:32.704185    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n" event={"ID":"7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5","Type":"ContainerStarted","Data":"f04ffeb8bd104a72bc3ed4b72b8dbf6e5a676653e34f5dbda0703c2aab7e069c"}
Jul 10 18:10:32.704709 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:32.704333    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"
Jul 10 18:10:32.705914 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:32.705885    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-5scwn" event={"ID":"04f3e571-5fa9-4b35-b0b1-77c56b6735fe","Type":"ContainerStarted","Data":"62f017df769ff29ec2aa71c8f6efd82faa9a82b2cbcf5ffe2a32c83dc7fef977"}
Jul 10 18:10:32.706049 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:32.705944    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-5scwn"
Jul 10 18:10:32.707449 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:32.707425    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nv7pm" event={"ID":"28088079-664d-4206-9136-2cf28525f281","Type":"ContainerStarted","Data":"fd18215bd161d2d0b73dfb83ebc214961c3a146c54356d99db8d751a56193f2f"}
Jul 10 18:10:32.707597 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:32.707542    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-nv7pm"
Jul 10 18:10:32.738824 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:32.738759    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n" podStartSLOduration=1.498365002 podStartE2EDuration="3.738735373s" totalImagesPullingTime="2.240370371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:10:32.738072996 +0000 UTC m=+625.416340615" watchObservedRunningTime="2026-07-10 18:10:32.738735373 +0000 UTC m=+625.417002951"
Jul 10 18:10:32.796651 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:32.796585    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-nv7pm" podStartSLOduration=1.213570756 podStartE2EDuration="2.79656079s" totalImagesPullingTime="1.582990034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:10:32.763399604 +0000 UTC m=+625.441667199" watchObservedRunningTime="2026-07-10 18:10:32.79656079 +0000 UTC m=+625.474828372"
Jul 10 18:10:32.797950 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:32.797908    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-5scwn" podStartSLOduration=1.274096726 podStartE2EDuration="2.797895557s" totalImagesPullingTime="1.523798831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:10:32.79562912 +0000 UTC m=+625.473896721" watchObservedRunningTime="2026-07-10 18:10:32.797895557 +0000 UTC m=+625.476163138"
Jul 10 18:10:38.718621 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:38.718588    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-868ff7b6d7-8j54n"
Jul 10 18:10:39.750160 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:39.750119    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:39.851886 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:39.851842    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:43.715130 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:43.715094    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-5scwn"
Jul 10 18:10:43.715692 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:43.715188    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-nv7pm"
Jul 10 18:10:46.731171 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.731124    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"]
Jul 10 18:10:46.735344 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.735301    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.737706 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.737675    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 18:10:46.738612 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.738584    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n65md\""
Jul 10 18:10:46.738739 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.738656    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 10 18:10:46.738799 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.738733    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 18:10:46.745305 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.745269    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"]
Jul 10 18:10:46.765605 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.765553    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:46.850259 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.850205    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rfnv\" (UniqueName: \"kubernetes.io/projected/fe4f1302-da52-44c6-a3fe-845d52ea21c6-kube-api-access-2rfnv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.850259 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.850262    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe4f1302-da52-44c6-a3fe-845d52ea21c6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.850546 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.850386    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe4f1302-da52-44c6-a3fe-845d52ea21c6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.850546 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.850424    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe4f1302-da52-44c6-a3fe-845d52ea21c6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.850546 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.850450    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe4f1302-da52-44c6-a3fe-845d52ea21c6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.850546 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.850503    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe4f1302-da52-44c6-a3fe-845d52ea21c6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.951965 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.951923    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe4f1302-da52-44c6-a3fe-845d52ea21c6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.951965 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.951974    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe4f1302-da52-44c6-a3fe-845d52ea21c6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.952232 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.951994    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe4f1302-da52-44c6-a3fe-845d52ea21c6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.952232 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.952013    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe4f1302-da52-44c6-a3fe-845d52ea21c6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.952232 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.952066    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rfnv\" (UniqueName: \"kubernetes.io/projected/fe4f1302-da52-44c6-a3fe-845d52ea21c6-kube-api-access-2rfnv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.952232 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.952088    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe4f1302-da52-44c6-a3fe-845d52ea21c6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.952545 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.952402    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe4f1302-da52-44c6-a3fe-845d52ea21c6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.952545 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.952442    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe4f1302-da52-44c6-a3fe-845d52ea21c6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.952545 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.952514    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe4f1302-da52-44c6-a3fe-845d52ea21c6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.954519 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.954489    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe4f1302-da52-44c6-a3fe-845d52ea21c6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.954781 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.954763    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe4f1302-da52-44c6-a3fe-845d52ea21c6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:46.960869 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:46.960837    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rfnv\" (UniqueName: \"kubernetes.io/projected/fe4f1302-da52-44c6-a3fe-845d52ea21c6-kube-api-access-2rfnv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42\" (UID: \"fe4f1302-da52-44c6-a3fe-845d52ea21c6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:47.047281 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:47.047243    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:47.199151 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:47.199122    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"]
Jul 10 18:10:47.203975 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:10:47.203924    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4f1302_da52_44c6_a3fe_845d52ea21c6.slice/crio-e447bfa106ca5d86eb3f2a569d54855a2446420c875affaa9547485dbcae9422 WatchSource:0}: Error finding container e447bfa106ca5d86eb3f2a569d54855a2446420c875affaa9547485dbcae9422: Status 404 returned error can't find the container with id e447bfa106ca5d86eb3f2a569d54855a2446420c875affaa9547485dbcae9422
Jul 10 18:10:47.792546 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:47.790141    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42" event={"ID":"fe4f1302-da52-44c6-a3fe-845d52ea21c6","Type":"ContainerStarted","Data":"e447bfa106ca5d86eb3f2a569d54855a2446420c875affaa9547485dbcae9422"}
Jul 10 18:10:48.796985 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:48.796938    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42" event={"ID":"fe4f1302-da52-44c6-a3fe-845d52ea21c6","Type":"ContainerStarted","Data":"fcd2f1f4aeeb3485869b476433befbbcc5c4eaaac669ad36e913dd7ca2da7bb9"}
Jul 10 18:10:48.832181 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:48.832127    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42" podStartSLOduration=1.579960141 podStartE2EDuration="2.832110718s" totalImagesPullingTime="1.252150577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:10:48.831096756 +0000 UTC m=+641.509364335" watchObservedRunningTime="2026-07-10 18:10:48.832110718 +0000 UTC m=+641.510378337"
Jul 10 18:10:55.689515 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:55.689466    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:10:57.047708 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:57.047664    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:57.048164 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:57.047762    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:57.060764 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:57.060729    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:10:57.852567 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:10:57.852536    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42"
Jul 10 18:11:01.773070 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:01.773031    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:08.930283 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:08.930238    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:27.367926 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.367886    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"]
Jul 10 18:11:27.374443 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.374417    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.378545 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.378521    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 10 18:11:27.410002 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.409957    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"]
Jul 10 18:11:27.432283 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.432242    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:27.452047 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.452005    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.452245 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.452071    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.452245 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.452105    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.452245 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.452129    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.452245 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.452144    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.452245 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.452166    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdghf\" (UniqueName: \"kubernetes.io/projected/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-kube-api-access-qdghf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.553105 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.553064    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.553354 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.553125    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.553354 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.553153    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.553354 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.553177    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.553354 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.553194    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.553354 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.553210    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdghf\" (UniqueName: \"kubernetes.io/projected/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-kube-api-access-qdghf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.553639 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.553594    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.553702 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.553637    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.553702 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.553680    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.555727 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.555698    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.555835 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.555802    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.562876 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.562844    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdghf\" (UniqueName: \"kubernetes.io/projected/f3fd9324-72b9-4414-9a32-19f0cc6d2f85-kube-api-access-qdghf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-frhg5\" (UID: \"f3fd9324-72b9-4414-9a32-19f0cc6d2f85\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.686882 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.686785    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:27.839558 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.839513    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"]
Jul 10 18:11:27.846288 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:11:27.846248    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3fd9324_72b9_4414_9a32_19f0cc6d2f85.slice/crio-7e4729b81e6cf236eff70967f41fbe3d5691ec571bda99ab353e078b66e32603 WatchSource:0}: Error finding container 7e4729b81e6cf236eff70967f41fbe3d5691ec571bda99ab353e078b66e32603: Status 404 returned error can't find the container with id 7e4729b81e6cf236eff70967f41fbe3d5691ec571bda99ab353e078b66e32603
Jul 10 18:11:27.847797 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.847776    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:11:27.986286 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:27.986188    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5" event={"ID":"f3fd9324-72b9-4414-9a32-19f0cc6d2f85","Type":"ContainerStarted","Data":"7e4729b81e6cf236eff70967f41fbe3d5691ec571bda99ab353e078b66e32603"}
Jul 10 18:11:28.289335 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:28.289274    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:28.391454 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:28.391421    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:11:28.993415 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:28.993378    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5" event={"ID":"f3fd9324-72b9-4414-9a32-19f0cc6d2f85","Type":"ContainerStarted","Data":"c533c4fc760c5cfe5b7148c51647b61582e6003501fa447f055993c01c786ec1"}
Jul 10 18:11:29.028608 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:29.028550    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5" podStartSLOduration=1.8154077800000001 podStartE2EDuration="2.028529358s" totalImagesPullingTime="213.121578ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:11:29.027856247 +0000 UTC m=+681.706123829" watchObservedRunningTime="2026-07-10 18:11:29.028529358 +0000 UTC m=+681.706796946"
Jul 10 18:11:37.687228 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:37.687188    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:37.687728 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:37.687257    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:37.700247 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:37.700210    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:38.044583 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:38.044549    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-frhg5"
Jul 10 18:11:40.405518 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:11:40.405477    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:51.302318 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:51.302268    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68f46547f5-n68k5"]
Jul 10 18:12:51.305612 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:51.305579    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68f46547f5-n68k5"
Jul 10 18:12:51.325941 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:51.325902    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68f46547f5-n68k5"]
Jul 10 18:12:51.364903 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:51.364858    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cprn4\" (UniqueName: \"kubernetes.io/projected/b2729097-18ab-4ee5-97a9-1c3fc774a3a6-kube-api-access-cprn4\") pod \"authorino-68f46547f5-n68k5\" (UID: \"b2729097-18ab-4ee5-97a9-1c3fc774a3a6\") " pod="kuadrant-system/authorino-68f46547f5-n68k5"
Jul 10 18:12:51.364903 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:51.364910    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b2729097-18ab-4ee5-97a9-1c3fc774a3a6-tls-cert\") pod \"authorino-68f46547f5-n68k5\" (UID: \"b2729097-18ab-4ee5-97a9-1c3fc774a3a6\") " pod="kuadrant-system/authorino-68f46547f5-n68k5"
Jul 10 18:12:51.465569 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:51.465527    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cprn4\" (UniqueName: \"kubernetes.io/projected/b2729097-18ab-4ee5-97a9-1c3fc774a3a6-kube-api-access-cprn4\") pod \"authorino-68f46547f5-n68k5\" (UID: \"b2729097-18ab-4ee5-97a9-1c3fc774a3a6\") " pod="kuadrant-system/authorino-68f46547f5-n68k5"
Jul 10 18:12:51.465768 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:51.465589    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b2729097-18ab-4ee5-97a9-1c3fc774a3a6-tls-cert\") pod \"authorino-68f46547f5-n68k5\" (UID: \"b2729097-18ab-4ee5-97a9-1c3fc774a3a6\") " pod="kuadrant-system/authorino-68f46547f5-n68k5"
Jul 10 18:12:51.468228 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:51.468199    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b2729097-18ab-4ee5-97a9-1c3fc774a3a6-tls-cert\") pod \"authorino-68f46547f5-n68k5\" (UID: \"b2729097-18ab-4ee5-97a9-1c3fc774a3a6\") " pod="kuadrant-system/authorino-68f46547f5-n68k5"
Jul 10 18:12:51.475882 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:51.475855    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cprn4\" (UniqueName: \"kubernetes.io/projected/b2729097-18ab-4ee5-97a9-1c3fc774a3a6-kube-api-access-cprn4\") pod \"authorino-68f46547f5-n68k5\" (UID: \"b2729097-18ab-4ee5-97a9-1c3fc774a3a6\") " pod="kuadrant-system/authorino-68f46547f5-n68k5"
Jul 10 18:12:51.616565 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:51.616465    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68f46547f5-n68k5"
Jul 10 18:12:51.745437 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:51.745398    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:51.777796 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:51.777761    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68f46547f5-n68k5"]
Jul 10 18:12:51.781998 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:12:51.781959    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2729097_18ab_4ee5_97a9_1c3fc774a3a6.slice/crio-4170493b1738b7c507a49793d1d49b4799bad6e15ccd01434d1561183875fcdd WatchSource:0}: Error finding container 4170493b1738b7c507a49793d1d49b4799bad6e15ccd01434d1561183875fcdd: Status 404 returned error can't find the container with id 4170493b1738b7c507a49793d1d49b4799bad6e15ccd01434d1561183875fcdd
Jul 10 18:12:51.869505 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:51.868644    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:52.386734 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.386684    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68f46547f5-n68k5" event={"ID":"b2729097-18ab-4ee5-97a9-1c3fc774a3a6","Type":"ContainerStarted","Data":"e8bc0b5d921115dde6b3b9a5d0d570c8e7b7c2fe951a02ee309bcd3247bca49f"}
Jul 10 18:12:52.387165 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.386749    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68f46547f5-n68k5" event={"ID":"b2729097-18ab-4ee5-97a9-1c3fc774a3a6","Type":"ContainerStarted","Data":"4170493b1738b7c507a49793d1d49b4799bad6e15ccd01434d1561183875fcdd"}
Jul 10 18:12:52.410928 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.410862    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68f46547f5-n68k5" podStartSLOduration=1.024568013 podStartE2EDuration="1.410840224s" totalImagesPullingTime="386.272211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:12:52.408253952 +0000 UTC m=+765.086521562" watchObservedRunningTime="2026-07-10 18:12:52.410840224 +0000 UTC m=+765.089107802"
Jul 10 18:12:52.441999 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.441895    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d68ffdc86-82zvn"]
Jul 10 18:12:52.442185 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.442131    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-d68ffdc86-82zvn" podUID="35d0b561-500a-4540-9f23-97acebe71ecc" containerName="authorino" containerID="cri-o://a8a41402aac2d6ec2bfba92876fff6570522d80eb8c1df3ec74a2b252ebe104d" gracePeriod=30
Jul 10 18:12:52.713423 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.713386    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d68ffdc86-82zvn"
Jul 10 18:12:52.776924 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.776888    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxm2n\" (UniqueName: \"kubernetes.io/projected/35d0b561-500a-4540-9f23-97acebe71ecc-kube-api-access-vxm2n\") pod \"35d0b561-500a-4540-9f23-97acebe71ecc\" (UID: \"35d0b561-500a-4540-9f23-97acebe71ecc\") "
Jul 10 18:12:52.777108 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.776991    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35d0b561-500a-4540-9f23-97acebe71ecc-tls-cert\") pod \"35d0b561-500a-4540-9f23-97acebe71ecc\" (UID: \"35d0b561-500a-4540-9f23-97acebe71ecc\") "
Jul 10 18:12:52.779431 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.779377    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35d0b561-500a-4540-9f23-97acebe71ecc-kube-api-access-vxm2n" (OuterVolumeSpecName: "kube-api-access-vxm2n") pod "35d0b561-500a-4540-9f23-97acebe71ecc" (UID: "35d0b561-500a-4540-9f23-97acebe71ecc"). InnerVolumeSpecName "kube-api-access-vxm2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:12:52.791002 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.790959    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35d0b561-500a-4540-9f23-97acebe71ecc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "35d0b561-500a-4540-9f23-97acebe71ecc" (UID: "35d0b561-500a-4540-9f23-97acebe71ecc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:12:52.810929 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.810896    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:52.878519 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.878477    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxm2n\" (UniqueName: \"kubernetes.io/projected/35d0b561-500a-4540-9f23-97acebe71ecc-kube-api-access-vxm2n\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:12:52.878519 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.878508    2569 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35d0b561-500a-4540-9f23-97acebe71ecc-tls-cert\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:12:52.904674 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:52.904639    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:12:53.393546 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:53.393511    2569 generic.go:356] "Generic (PLEG): container finished" podID="35d0b561-500a-4540-9f23-97acebe71ecc" containerID="a8a41402aac2d6ec2bfba92876fff6570522d80eb8c1df3ec74a2b252ebe104d" exitCode=0
Jul 10 18:12:53.394045 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:53.393578    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d68ffdc86-82zvn"
Jul 10 18:12:53.394045 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:53.393592    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d68ffdc86-82zvn" event={"ID":"35d0b561-500a-4540-9f23-97acebe71ecc","Type":"ContainerDied","Data":"a8a41402aac2d6ec2bfba92876fff6570522d80eb8c1df3ec74a2b252ebe104d"}
Jul 10 18:12:53.394045 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:53.393647    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d68ffdc86-82zvn" event={"ID":"35d0b561-500a-4540-9f23-97acebe71ecc","Type":"ContainerDied","Data":"a5f9ce3480aca9fe8d7f2e932ceef4ea4bba568a19e82b364274c24c8a741646"}
Jul 10 18:12:53.394045 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:53.393666    2569 scope.go:117] "RemoveContainer" containerID="a8a41402aac2d6ec2bfba92876fff6570522d80eb8c1df3ec74a2b252ebe104d"
Jul 10 18:12:53.403558 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:53.403529    2569 scope.go:117] "RemoveContainer" containerID="a8a41402aac2d6ec2bfba92876fff6570522d80eb8c1df3ec74a2b252ebe104d"
Jul 10 18:12:53.403930 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:12:53.403902    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8a41402aac2d6ec2bfba92876fff6570522d80eb8c1df3ec74a2b252ebe104d\": container with ID starting with a8a41402aac2d6ec2bfba92876fff6570522d80eb8c1df3ec74a2b252ebe104d not found: ID does not exist" containerID="a8a41402aac2d6ec2bfba92876fff6570522d80eb8c1df3ec74a2b252ebe104d"
Jul 10 18:12:53.404025 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:53.403946    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8a41402aac2d6ec2bfba92876fff6570522d80eb8c1df3ec74a2b252ebe104d"} err="failed to get container status \"a8a41402aac2d6ec2bfba92876fff6570522d80eb8c1df3ec74a2b252ebe104d\": rpc error: code = NotFound desc = could not find container \"a8a41402aac2d6ec2bfba92876fff6570522d80eb8c1df3ec74a2b252ebe104d\": container with ID starting with a8a41402aac2d6ec2bfba92876fff6570522d80eb8c1df3ec74a2b252ebe104d not found: ID does not exist"
Jul 10 18:12:53.425593 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:53.425558    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d68ffdc86-82zvn"]
Jul 10 18:12:53.438327 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:53.438282    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d68ffdc86-82zvn"]
Jul 10 18:12:54.015658 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:12:54.015615    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35d0b561-500a-4540-9f23-97acebe71ecc" path="/var/lib/kubelet/pods/35d0b561-500a-4540-9f23-97acebe71ecc/volumes"
Jul 10 18:13:55.258712 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:13:55.258674    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:13:55.319870 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:13:55.319797    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:02.783193 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:02.783149    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:02.888996 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:02.888958    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c8d7c5fbd-9crjf"]
Jul 10 18:14:02.889244 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:02.889204    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c8d7c5fbd-9crjf" podUID="5f774de3-f483-4643-8fa8-ea0526cd0c62" containerName="manager" containerID="cri-o://5807a360056011cdaa2a5df85f373e610ba31636c69988f0f4357e8859b30180" gracePeriod=30
Jul 10 18:14:03.145064 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.145031    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8d7c5fbd-9crjf"
Jul 10 18:14:03.226894 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.226859    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f774de3-f483-4643-8fa8-ea0526cd0c62-webhook-cert\") pod \"5f774de3-f483-4643-8fa8-ea0526cd0c62\" (UID: \"5f774de3-f483-4643-8fa8-ea0526cd0c62\") "
Jul 10 18:14:03.227105 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.226914    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmstv\" (UniqueName: \"kubernetes.io/projected/5f774de3-f483-4643-8fa8-ea0526cd0c62-kube-api-access-jmstv\") pod \"5f774de3-f483-4643-8fa8-ea0526cd0c62\" (UID: \"5f774de3-f483-4643-8fa8-ea0526cd0c62\") "
Jul 10 18:14:03.229138 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.229097    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f774de3-f483-4643-8fa8-ea0526cd0c62-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5f774de3-f483-4643-8fa8-ea0526cd0c62" (UID: "5f774de3-f483-4643-8fa8-ea0526cd0c62"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:14:03.229282 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.229152    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f774de3-f483-4643-8fa8-ea0526cd0c62-kube-api-access-jmstv" (OuterVolumeSpecName: "kube-api-access-jmstv") pod "5f774de3-f483-4643-8fa8-ea0526cd0c62" (UID: "5f774de3-f483-4643-8fa8-ea0526cd0c62"). InnerVolumeSpecName "kube-api-access-jmstv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:14:03.327582 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.327464    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f774de3-f483-4643-8fa8-ea0526cd0c62-webhook-cert\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:14:03.327582 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.327515    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmstv\" (UniqueName: \"kubernetes.io/projected/5f774de3-f483-4643-8fa8-ea0526cd0c62-kube-api-access-jmstv\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:14:03.736829 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.736726    2569 generic.go:356] "Generic (PLEG): container finished" podID="5f774de3-f483-4643-8fa8-ea0526cd0c62" containerID="5807a360056011cdaa2a5df85f373e610ba31636c69988f0f4357e8859b30180" exitCode=0
Jul 10 18:14:03.736829 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.736779    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8d7c5fbd-9crjf"
Jul 10 18:14:03.736829 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.736808    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8d7c5fbd-9crjf" event={"ID":"5f774de3-f483-4643-8fa8-ea0526cd0c62","Type":"ContainerDied","Data":"5807a360056011cdaa2a5df85f373e610ba31636c69988f0f4357e8859b30180"}
Jul 10 18:14:03.737111 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.736865    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8d7c5fbd-9crjf" event={"ID":"5f774de3-f483-4643-8fa8-ea0526cd0c62","Type":"ContainerDied","Data":"d4adf0aea21a35cbe1579ba3f5e50ceda558dfea2902ca214f74160367a2c80b"}
Jul 10 18:14:03.737111 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.736888    2569 scope.go:117] "RemoveContainer" containerID="5807a360056011cdaa2a5df85f373e610ba31636c69988f0f4357e8859b30180"
Jul 10 18:14:03.746258 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.746229    2569 scope.go:117] "RemoveContainer" containerID="5807a360056011cdaa2a5df85f373e610ba31636c69988f0f4357e8859b30180"
Jul 10 18:14:03.746594 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:14:03.746576    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5807a360056011cdaa2a5df85f373e610ba31636c69988f0f4357e8859b30180\": container with ID starting with 5807a360056011cdaa2a5df85f373e610ba31636c69988f0f4357e8859b30180 not found: ID does not exist" containerID="5807a360056011cdaa2a5df85f373e610ba31636c69988f0f4357e8859b30180"
Jul 10 18:14:03.746656 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.746603    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5807a360056011cdaa2a5df85f373e610ba31636c69988f0f4357e8859b30180"} err="failed to get container status \"5807a360056011cdaa2a5df85f373e610ba31636c69988f0f4357e8859b30180\": rpc error: code = NotFound desc = could not find container \"5807a360056011cdaa2a5df85f373e610ba31636c69988f0f4357e8859b30180\": container with ID starting with 5807a360056011cdaa2a5df85f373e610ba31636c69988f0f4357e8859b30180 not found: ID does not exist"
Jul 10 18:14:03.757704 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.757667    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c8d7c5fbd-9crjf"]
Jul 10 18:14:03.761701 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:03.761669    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c8d7c5fbd-9crjf"]
Jul 10 18:14:04.013918 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.013875    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f774de3-f483-4643-8fa8-ea0526cd0c62" path="/var/lib/kubelet/pods/5f774de3-f483-4643-8fa8-ea0526cd0c62/volumes"
Jul 10 18:14:04.410664 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.410573    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:04.524060 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.519626    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c8d7c5fbd-4r8g7"]
Jul 10 18:14:04.524060 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.520429    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35d0b561-500a-4540-9f23-97acebe71ecc" containerName="authorino"
Jul 10 18:14:04.524060 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.520447    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="35d0b561-500a-4540-9f23-97acebe71ecc" containerName="authorino"
Jul 10 18:14:04.524060 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.520499    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f774de3-f483-4643-8fa8-ea0526cd0c62" containerName="manager"
Jul 10 18:14:04.524060 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.520508    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f774de3-f483-4643-8fa8-ea0526cd0c62" containerName="manager"
Jul 10 18:14:04.524060 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.520664    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f774de3-f483-4643-8fa8-ea0526cd0c62" containerName="manager"
Jul 10 18:14:04.524060 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.520687    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="35d0b561-500a-4540-9f23-97acebe71ecc" containerName="authorino"
Jul 10 18:14:04.525250 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.525223    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8d7c5fbd-4r8g7"
Jul 10 18:14:04.528742 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.528713    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 18:14:04.528928 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.528875    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5qk84\""
Jul 10 18:14:04.529007 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.528985    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 18:14:04.531170 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.531141    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c8d7c5fbd-4r8g7"]
Jul 10 18:14:04.536122 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.536088    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd665518-ebbc-433c-bc64-c95875a32c5e-webhook-cert\") pod \"maas-controller-c8d7c5fbd-4r8g7\" (UID: \"fd665518-ebbc-433c-bc64-c95875a32c5e\") " pod="opendatahub/maas-controller-c8d7c5fbd-4r8g7"
Jul 10 18:14:04.536266 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.536202    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r652q\" (UniqueName: \"kubernetes.io/projected/fd665518-ebbc-433c-bc64-c95875a32c5e-kube-api-access-r652q\") pod \"maas-controller-c8d7c5fbd-4r8g7\" (UID: \"fd665518-ebbc-433c-bc64-c95875a32c5e\") " pod="opendatahub/maas-controller-c8d7c5fbd-4r8g7"
Jul 10 18:14:04.636666 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.636624    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r652q\" (UniqueName: \"kubernetes.io/projected/fd665518-ebbc-433c-bc64-c95875a32c5e-kube-api-access-r652q\") pod \"maas-controller-c8d7c5fbd-4r8g7\" (UID: \"fd665518-ebbc-433c-bc64-c95875a32c5e\") " pod="opendatahub/maas-controller-c8d7c5fbd-4r8g7"
Jul 10 18:14:04.636836 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.636699    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd665518-ebbc-433c-bc64-c95875a32c5e-webhook-cert\") pod \"maas-controller-c8d7c5fbd-4r8g7\" (UID: \"fd665518-ebbc-433c-bc64-c95875a32c5e\") " pod="opendatahub/maas-controller-c8d7c5fbd-4r8g7"
Jul 10 18:14:04.639271 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.639246    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd665518-ebbc-433c-bc64-c95875a32c5e-webhook-cert\") pod \"maas-controller-c8d7c5fbd-4r8g7\" (UID: \"fd665518-ebbc-433c-bc64-c95875a32c5e\") " pod="opendatahub/maas-controller-c8d7c5fbd-4r8g7"
Jul 10 18:14:04.645725 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.645693    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r652q\" (UniqueName: \"kubernetes.io/projected/fd665518-ebbc-433c-bc64-c95875a32c5e-kube-api-access-r652q\") pod \"maas-controller-c8d7c5fbd-4r8g7\" (UID: \"fd665518-ebbc-433c-bc64-c95875a32c5e\") " pod="opendatahub/maas-controller-c8d7c5fbd-4r8g7"
Jul 10 18:14:04.838207 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.838169    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c8d7c5fbd-4r8g7"
Jul 10 18:14:04.986610 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:04.986561    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c8d7c5fbd-4r8g7"]
Jul 10 18:14:04.991874 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:14:04.991842    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd665518_ebbc_433c_bc64_c95875a32c5e.slice/crio-99baee0ace9c5e7b4e0e46a35d2094337647e58bafef4f0438cdfd2b3986722d WatchSource:0}: Error finding container 99baee0ace9c5e7b4e0e46a35d2094337647e58bafef4f0438cdfd2b3986722d: Status 404 returned error can't find the container with id 99baee0ace9c5e7b4e0e46a35d2094337647e58bafef4f0438cdfd2b3986722d
Jul 10 18:14:05.749962 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:05.749918    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8d7c5fbd-4r8g7" event={"ID":"fd665518-ebbc-433c-bc64-c95875a32c5e","Type":"ContainerStarted","Data":"2bd125cb948277ab6be90f30547278f103bd087a064b7fd5f051341758d1ce56"}
Jul 10 18:14:05.750454 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:05.749980    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c8d7c5fbd-4r8g7" event={"ID":"fd665518-ebbc-433c-bc64-c95875a32c5e","Type":"ContainerStarted","Data":"99baee0ace9c5e7b4e0e46a35d2094337647e58bafef4f0438cdfd2b3986722d"}
Jul 10 18:14:05.750454 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:05.750014    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c8d7c5fbd-4r8g7"
Jul 10 18:14:05.775290 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:05.775227    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c8d7c5fbd-4r8g7" podStartSLOduration=1.180111537 podStartE2EDuration="1.775207994s" totalImagesPullingTime="595.096457ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:14:05.773218263 +0000 UTC m=+838.451485860" watchObservedRunningTime="2026-07-10 18:14:05.775207994 +0000 UTC m=+838.453475571"
Jul 10 18:14:16.761622 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:16.761577    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c8d7c5fbd-4r8g7"
Jul 10 18:14:46.962843 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:46.962802    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:47.062878 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:47.062840    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:47.169408 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:47.169370    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:52.932883 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:52.932838    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:53.037379 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:53.037330    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:53.134011 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:53.133973    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:53.279036 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:53.278998    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:59.113796 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:59.113706    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:14:59.213597 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:14:59.213539    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:15:00.147805 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:00.147764    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5"]
Jul 10 18:15:00.151573 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:00.151545    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5"
Jul 10 18:15:00.154031 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:00.154006    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vkbgh\""
Jul 10 18:15:00.159301 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:00.159260    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5"]
Jul 10 18:15:00.227856 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:00.227813    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdbpn\" (UniqueName: \"kubernetes.io/projected/bbaf6d87-b290-483d-890b-78664b558b15-kube-api-access-jdbpn\") pod \"maas-api-key-cleanup-29728455-tfmv5\" (UID: \"bbaf6d87-b290-483d-890b-78664b558b15\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5"
Jul 10 18:15:00.328418 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:00.328379    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdbpn\" (UniqueName: \"kubernetes.io/projected/bbaf6d87-b290-483d-890b-78664b558b15-kube-api-access-jdbpn\") pod \"maas-api-key-cleanup-29728455-tfmv5\" (UID: \"bbaf6d87-b290-483d-890b-78664b558b15\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5"
Jul 10 18:15:00.336707 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:00.336666    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdbpn\" (UniqueName: \"kubernetes.io/projected/bbaf6d87-b290-483d-890b-78664b558b15-kube-api-access-jdbpn\") pod \"maas-api-key-cleanup-29728455-tfmv5\" (UID: \"bbaf6d87-b290-483d-890b-78664b558b15\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5"
Jul 10 18:15:00.464101 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:00.464002    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5"
Jul 10 18:15:00.604301 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:00.604275    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5"]
Jul 10 18:15:00.607134 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:15:00.607104    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbaf6d87_b290_483d_890b_78664b558b15.slice/crio-f13afa4aa5700dbf56fb59910d9c1490512bf9e2f32f3dc8ee8d5d4244be8424 WatchSource:0}: Error finding container f13afa4aa5700dbf56fb59910d9c1490512bf9e2f32f3dc8ee8d5d4244be8424: Status 404 returned error can't find the container with id f13afa4aa5700dbf56fb59910d9c1490512bf9e2f32f3dc8ee8d5d4244be8424
Jul 10 18:15:01.016943 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:01.016901    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5" event={"ID":"bbaf6d87-b290-483d-890b-78664b558b15","Type":"ContainerStarted","Data":"f13afa4aa5700dbf56fb59910d9c1490512bf9e2f32f3dc8ee8d5d4244be8424"}
Jul 10 18:15:04.034513 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:04.034467    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5" event={"ID":"bbaf6d87-b290-483d-890b-78664b558b15","Type":"ContainerStarted","Data":"91c2766b8c6089a99bd492f5ffb9316cf1c9a697e3326b7415a718e688c788de"}
Jul 10 18:15:04.054723 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:04.053331    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5" podStartSLOduration=1.542488742 podStartE2EDuration="4.053286388s" totalImagesPullingTime="2.510797646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:15:04.049715711 +0000 UTC m=+896.727983288" watchObservedRunningTime="2026-07-10 18:15:04.053286388 +0000 UTC m=+896.731553966"
Jul 10 18:15:07.818584 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:07.818553    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:15:07.821027 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:07.821004    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:15:20.674283 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:15:20.674247    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:16:00.015084 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:00.015046    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5"]
Jul 10 18:16:00.015669 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:00.015250    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5" podUID="bbaf6d87-b290-483d-890b-78664b558b15" containerName="cleanup" containerID="cri-o://91c2766b8c6089a99bd492f5ffb9316cf1c9a697e3326b7415a718e688c788de" gracePeriod=30
Jul 10 18:16:02.138846 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:02.138793    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:16:12.042602 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:12.042561    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:16:30.219175 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:30.219138    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5"
Jul 10 18:16:30.326517 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:30.326422    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdbpn\" (UniqueName: \"kubernetes.io/projected/bbaf6d87-b290-483d-890b-78664b558b15-kube-api-access-jdbpn\") pod \"bbaf6d87-b290-483d-890b-78664b558b15\" (UID: \"bbaf6d87-b290-483d-890b-78664b558b15\") "
Jul 10 18:16:30.328737 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:30.328702    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbaf6d87-b290-483d-890b-78664b558b15-kube-api-access-jdbpn" (OuterVolumeSpecName: "kube-api-access-jdbpn") pod "bbaf6d87-b290-483d-890b-78664b558b15" (UID: "bbaf6d87-b290-483d-890b-78664b558b15"). InnerVolumeSpecName "kube-api-access-jdbpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:16:30.426990 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:30.426954    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdbpn\" (UniqueName: \"kubernetes.io/projected/bbaf6d87-b290-483d-890b-78664b558b15-kube-api-access-jdbpn\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:16:30.473144 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:30.473102    2569 generic.go:356] "Generic (PLEG): container finished" podID="bbaf6d87-b290-483d-890b-78664b558b15" containerID="91c2766b8c6089a99bd492f5ffb9316cf1c9a697e3326b7415a718e688c788de" exitCode=137
Jul 10 18:16:30.473471 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:30.473173    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5"
Jul 10 18:16:30.473471 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:30.473195    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5" event={"ID":"bbaf6d87-b290-483d-890b-78664b558b15","Type":"ContainerDied","Data":"91c2766b8c6089a99bd492f5ffb9316cf1c9a697e3326b7415a718e688c788de"}
Jul 10 18:16:30.473471 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:30.473282    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5" event={"ID":"bbaf6d87-b290-483d-890b-78664b558b15","Type":"ContainerDied","Data":"f13afa4aa5700dbf56fb59910d9c1490512bf9e2f32f3dc8ee8d5d4244be8424"}
Jul 10 18:16:30.473471 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:30.473325    2569 scope.go:117] "RemoveContainer" containerID="91c2766b8c6089a99bd492f5ffb9316cf1c9a697e3326b7415a718e688c788de"
Jul 10 18:16:30.482731 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:30.482704    2569 scope.go:117] "RemoveContainer" containerID="91c2766b8c6089a99bd492f5ffb9316cf1c9a697e3326b7415a718e688c788de"
Jul 10 18:16:30.483081 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:16:30.483061    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91c2766b8c6089a99bd492f5ffb9316cf1c9a697e3326b7415a718e688c788de\": container with ID starting with 91c2766b8c6089a99bd492f5ffb9316cf1c9a697e3326b7415a718e688c788de not found: ID does not exist" containerID="91c2766b8c6089a99bd492f5ffb9316cf1c9a697e3326b7415a718e688c788de"
Jul 10 18:16:30.483165 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:30.483089    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91c2766b8c6089a99bd492f5ffb9316cf1c9a697e3326b7415a718e688c788de"} err="failed to get container status \"91c2766b8c6089a99bd492f5ffb9316cf1c9a697e3326b7415a718e688c788de\": rpc error: code = NotFound desc = could not find container \"91c2766b8c6089a99bd492f5ffb9316cf1c9a697e3326b7415a718e688c788de\": container with ID starting with 91c2766b8c6089a99bd492f5ffb9316cf1c9a697e3326b7415a718e688c788de not found: ID does not exist"
Jul 10 18:16:30.496734 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:30.496695    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5"]
Jul 10 18:16:30.500029 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:30.499987    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728455-tfmv5"]
Jul 10 18:16:32.014438 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:16:32.014406    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbaf6d87-b290-483d-890b-78664b558b15" path="/var/lib/kubelet/pods/bbaf6d87-b290-483d-890b-78664b558b15/volumes"
Jul 10 18:18:57.763724 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:18:57.763690    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"]
Jul 10 18:18:57.764327 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:18:57.763902    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9" podUID="f16ab1a9-0844-4452-9908-48adfc0378d2" containerName="manager" containerID="cri-o://19cd11527d67a841fb9d0f62ca535c9fbf4c21432b0d0b775b18683f5155d867" gracePeriod=10
Jul 10 18:19:01.231832 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:01.231798    2569 generic.go:356] "Generic (PLEG): container finished" podID="f16ab1a9-0844-4452-9908-48adfc0378d2" containerID="19cd11527d67a841fb9d0f62ca535c9fbf4c21432b0d0b775b18683f5155d867" exitCode=0
Jul 10 18:19:01.232208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:01.231870    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9" event={"ID":"f16ab1a9-0844-4452-9908-48adfc0378d2","Type":"ContainerDied","Data":"19cd11527d67a841fb9d0f62ca535c9fbf4c21432b0d0b775b18683f5155d867"}
Jul 10 18:19:01.333094 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:01.333007    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"
Jul 10 18:19:01.497751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:01.497704    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvl59\" (UniqueName: \"kubernetes.io/projected/f16ab1a9-0844-4452-9908-48adfc0378d2-kube-api-access-rvl59\") pod \"f16ab1a9-0844-4452-9908-48adfc0378d2\" (UID: \"f16ab1a9-0844-4452-9908-48adfc0378d2\") "
Jul 10 18:19:01.497960 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:01.497792    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f16ab1a9-0844-4452-9908-48adfc0378d2-extensions-socket-volume\") pod \"f16ab1a9-0844-4452-9908-48adfc0378d2\" (UID: \"f16ab1a9-0844-4452-9908-48adfc0378d2\") "
Jul 10 18:19:01.498169 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:01.498145    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16ab1a9-0844-4452-9908-48adfc0378d2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f16ab1a9-0844-4452-9908-48adfc0378d2" (UID: "f16ab1a9-0844-4452-9908-48adfc0378d2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:19:01.499896 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:01.499860    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f16ab1a9-0844-4452-9908-48adfc0378d2-kube-api-access-rvl59" (OuterVolumeSpecName: "kube-api-access-rvl59") pod "f16ab1a9-0844-4452-9908-48adfc0378d2" (UID: "f16ab1a9-0844-4452-9908-48adfc0378d2"). InnerVolumeSpecName "kube-api-access-rvl59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:19:01.598713 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:01.598621    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvl59\" (UniqueName: \"kubernetes.io/projected/f16ab1a9-0844-4452-9908-48adfc0378d2-kube-api-access-rvl59\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:19:01.598713 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:01.598651    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f16ab1a9-0844-4452-9908-48adfc0378d2-extensions-socket-volume\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:19:02.238406 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:02.238374    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"
Jul 10 18:19:02.238406 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:02.238382    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9" event={"ID":"f16ab1a9-0844-4452-9908-48adfc0378d2","Type":"ContainerDied","Data":"45473795270ee6688c0b46b486ea13acdad683fa6f0d5d0c6c88e1ed4b16f29e"}
Jul 10 18:19:02.238957 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:02.238452    2569 scope.go:117] "RemoveContainer" containerID="19cd11527d67a841fb9d0f62ca535c9fbf4c21432b0d0b775b18683f5155d867"
Jul 10 18:19:02.259170 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:02.259132    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"]
Jul 10 18:19:02.265022 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:02.264984    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7tmz9"]
Jul 10 18:19:04.013453 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:04.013410    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f16ab1a9-0844-4452-9908-48adfc0378d2" path="/var/lib/kubelet/pods/f16ab1a9-0844-4452-9908-48adfc0378d2/volumes"
Jul 10 18:19:58.858905 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:58.858807    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp"]
Jul 10 18:19:58.859551 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:58.859404    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbaf6d87-b290-483d-890b-78664b558b15" containerName="cleanup"
Jul 10 18:19:58.859551 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:58.859424    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbaf6d87-b290-483d-890b-78664b558b15" containerName="cleanup"
Jul 10 18:19:58.859551 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:58.859471    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16ab1a9-0844-4452-9908-48adfc0378d2" containerName="manager"
Jul 10 18:19:58.859551 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:58.859479    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16ab1a9-0844-4452-9908-48adfc0378d2" containerName="manager"
Jul 10 18:19:58.859777 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:58.859562    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbaf6d87-b290-483d-890b-78664b558b15" containerName="cleanup"
Jul 10 18:19:58.859777 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:58.859573    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16ab1a9-0844-4452-9908-48adfc0378d2" containerName="manager"
Jul 10 18:19:58.862550 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:58.862526    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp"
Jul 10 18:19:58.865925 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:58.865901    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x4xtj\""
Jul 10 18:19:58.879031 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:58.878993    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp"]
Jul 10 18:19:58.988158 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:58.988116    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xsf6\" (UniqueName: \"kubernetes.io/projected/653e7672-bb3f-4f00-9d76-5e3009eb5b5f-kube-api-access-6xsf6\") pod \"kuadrant-operator-controller-manager-86878c769f-zgtzp\" (UID: \"653e7672-bb3f-4f00-9d76-5e3009eb5b5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp"
Jul 10 18:19:58.988385 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:58.988254    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/653e7672-bb3f-4f00-9d76-5e3009eb5b5f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zgtzp\" (UID: \"653e7672-bb3f-4f00-9d76-5e3009eb5b5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp"
Jul 10 18:19:59.089345 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:59.089275    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xsf6\" (UniqueName: \"kubernetes.io/projected/653e7672-bb3f-4f00-9d76-5e3009eb5b5f-kube-api-access-6xsf6\") pod \"kuadrant-operator-controller-manager-86878c769f-zgtzp\" (UID: \"653e7672-bb3f-4f00-9d76-5e3009eb5b5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp"
Jul 10 18:19:59.089525 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:59.089408    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/653e7672-bb3f-4f00-9d76-5e3009eb5b5f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zgtzp\" (UID: \"653e7672-bb3f-4f00-9d76-5e3009eb5b5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp"
Jul 10 18:19:59.089860 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:59.089840    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/653e7672-bb3f-4f00-9d76-5e3009eb5b5f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zgtzp\" (UID: \"653e7672-bb3f-4f00-9d76-5e3009eb5b5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp"
Jul 10 18:19:59.101556 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:59.101522    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xsf6\" (UniqueName: \"kubernetes.io/projected/653e7672-bb3f-4f00-9d76-5e3009eb5b5f-kube-api-access-6xsf6\") pod \"kuadrant-operator-controller-manager-86878c769f-zgtzp\" (UID: \"653e7672-bb3f-4f00-9d76-5e3009eb5b5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp"
Jul 10 18:19:59.173548 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:59.173448    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp"
Jul 10 18:19:59.331446 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:59.331407    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp"]
Jul 10 18:19:59.335665 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:19:59.335622    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653e7672_bb3f_4f00_9d76_5e3009eb5b5f.slice/crio-8b5d0f376ecb991a0d51b225c676094b840991d6cd311137308fc93ca54f775c WatchSource:0}: Error finding container 8b5d0f376ecb991a0d51b225c676094b840991d6cd311137308fc93ca54f775c: Status 404 returned error can't find the container with id 8b5d0f376ecb991a0d51b225c676094b840991d6cd311137308fc93ca54f775c
Jul 10 18:19:59.507981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:59.507942    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp" event={"ID":"653e7672-bb3f-4f00-9d76-5e3009eb5b5f","Type":"ContainerStarted","Data":"6334c232dfdd8e4f45722f180067d24d8fcd4b4de8cc68865c73983f2cf3e5aa"}
Jul 10 18:19:59.508191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:59.507997    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp" event={"ID":"653e7672-bb3f-4f00-9d76-5e3009eb5b5f","Type":"ContainerStarted","Data":"8b5d0f376ecb991a0d51b225c676094b840991d6cd311137308fc93ca54f775c"}
Jul 10 18:19:59.508191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:59.508071    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp"
Jul 10 18:19:59.534596 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:19:59.534546    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp" podStartSLOduration=1.53452453 podStartE2EDuration="1.53452453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:19:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:19:59.53229871 +0000 UTC m=+1192.210566289" watchObservedRunningTime="2026-07-10 18:19:59.53452453 +0000 UTC m=+1192.212792109"
Jul 10 18:20:07.848571 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:20:07.848543    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:20:07.848571 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:20:07.848564    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:20:08.554251 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:20:08.554215    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:20:10.515019 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:20:10.514983    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zgtzp"
Jul 10 18:21:45.309046 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:21:45.309007    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:23:15.034246 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:23:15.034190    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:23:53.129973 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:23:53.129937    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:23:53.230953 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:23:53.230916    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:25:07.878440 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:25:07.878408    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:25:07.879465 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:25:07.879442    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:25:52.227115 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:25:52.227028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:25:58.667604 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:25:58.667564    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:06.906509 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:06.906473    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:12.017690 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:12.017650    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:14.751597 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:14.751555    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:14.864920 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:14.864878    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:15.179940 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:15.179853    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:21.192494 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:21.192457    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:21.372688 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:21.372651    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:21.511323 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:21.511274    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:21.592738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:21.592704    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:22.628262 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.628233    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:22.703891 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.703839    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"]
Jul 10 18:26:22.707503 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.707474    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:22.710443 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.710400    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vkbgh\""
Jul 10 18:26:22.710630 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.710489    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-033a05f0-serving-cert\""
Jul 10 18:26:22.723229 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.723195    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"]
Jul 10 18:26:22.726023 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.725988    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz9kw\" (UniqueName: \"kubernetes.io/projected/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-kube-api-access-tz9kw\") pod \"maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n\" (UID: \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:22.726207 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.726047    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-maas-api-tls\") pod \"maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n\" (UID: \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:22.726207 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.726118    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-openshift-service-ca\") pod \"maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n\" (UID: \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:22.731989 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.731960    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:22.811335 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.811270    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:22.827614 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.827579    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-openshift-service-ca\") pod \"maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n\" (UID: \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:22.827758 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.827666    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz9kw\" (UniqueName: \"kubernetes.io/projected/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-kube-api-access-tz9kw\") pod \"maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n\" (UID: \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:22.827758 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.827721    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-maas-api-tls\") pod \"maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n\" (UID: \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:22.827876 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:26:22.827824    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-serving-cert: secret "maas-api-e2e-ait-033a05f0-serving-cert" not found
Jul 10 18:26:22.827931 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:26:22.827907    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-maas-api-tls podName:5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:23.327883985 +0000 UTC m=+1576.006151544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-maas-api-tls") pod "maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n" (UID: "5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5") : secret "maas-api-e2e-ait-033a05f0-serving-cert" not found
Jul 10 18:26:22.828413 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.828392    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-openshift-service-ca\") pod \"maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n\" (UID: \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:22.838857 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:22.838826    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz9kw\" (UniqueName: \"kubernetes.io/projected/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-kube-api-access-tz9kw\") pod \"maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n\" (UID: \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:23.302039 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:23.301968    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:23.331699 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:23.331663    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-maas-api-tls\") pod \"maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n\" (UID: \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:23.334258 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:23.334232    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-maas-api-tls\") pod \"maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n\" (UID: \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:23.401734 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:23.401699    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:23.502851 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:23.502806    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:23.619883 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:23.619760    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:23.786288 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:23.786260    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"]
Jul 10 18:26:23.789838 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:26:23.789793    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb0c7f2_493e_4ae7_b9b8_d88f279c3da5.slice/crio-c65b22e3fc18d8ad0a29954a70bc10acc211595209ffd2acb4e3afdbd15d77a5 WatchSource:0}: Error finding container c65b22e3fc18d8ad0a29954a70bc10acc211595209ffd2acb4e3afdbd15d77a5: Status 404 returned error can't find the container with id c65b22e3fc18d8ad0a29954a70bc10acc211595209ffd2acb4e3afdbd15d77a5
Jul 10 18:26:23.791499 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:23.791477    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:26:24.425861 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:24.425822    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n" event={"ID":"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5","Type":"ContainerStarted","Data":"c65b22e3fc18d8ad0a29954a70bc10acc211595209ffd2acb4e3afdbd15d77a5"}
Jul 10 18:26:25.432863 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:25.432824    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n" event={"ID":"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5","Type":"ContainerStarted","Data":"bcdb36957f2ebd3bebdb32610cb47339c39fe73bffe2e5d0a83c22055ab2707c"}
Jul 10 18:26:25.433383 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:25.432955    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:25.450945 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:25.450885    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n" podStartSLOduration=2.807866044 podStartE2EDuration="3.450865964s" totalImagesPullingTime="642.99992ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:25.449551124 +0000 UTC m=+1578.127818683" watchObservedRunningTime="2026-07-10 18:26:25.450865964 +0000 UTC m=+1578.129133542"
Jul 10 18:26:25.699128 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:25.699045    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:27.641268 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:27.641229    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:27.798696 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:27.798657    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:27.899092 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:27.898997    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:28.132652 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.132614    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"]
Jul 10 18:26:28.132894 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.132837    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n" podUID="5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5" containerName="maas-api" containerID="cri-o://bcdb36957f2ebd3bebdb32610cb47339c39fe73bffe2e5d0a83c22055ab2707c" gracePeriod=30
Jul 10 18:26:28.170898 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.170810    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:28.397982 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.397951    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:28.448691 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.448594    2569 generic.go:356] "Generic (PLEG): container finished" podID="5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5" containerID="bcdb36957f2ebd3bebdb32610cb47339c39fe73bffe2e5d0a83c22055ab2707c" exitCode=0
Jul 10 18:26:28.448691 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.448643    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"
Jul 10 18:26:28.448691 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.448678    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n" event={"ID":"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5","Type":"ContainerDied","Data":"bcdb36957f2ebd3bebdb32610cb47339c39fe73bffe2e5d0a83c22055ab2707c"}
Jul 10 18:26:28.448901 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.448738    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n" event={"ID":"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5","Type":"ContainerDied","Data":"c65b22e3fc18d8ad0a29954a70bc10acc211595209ffd2acb4e3afdbd15d77a5"}
Jul 10 18:26:28.448901 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.448769    2569 scope.go:117] "RemoveContainer" containerID="bcdb36957f2ebd3bebdb32610cb47339c39fe73bffe2e5d0a83c22055ab2707c"
Jul 10 18:26:28.457803 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.457781    2569 scope.go:117] "RemoveContainer" containerID="bcdb36957f2ebd3bebdb32610cb47339c39fe73bffe2e5d0a83c22055ab2707c"
Jul 10 18:26:28.458177 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:26:28.458153    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcdb36957f2ebd3bebdb32610cb47339c39fe73bffe2e5d0a83c22055ab2707c\": container with ID starting with bcdb36957f2ebd3bebdb32610cb47339c39fe73bffe2e5d0a83c22055ab2707c not found: ID does not exist" containerID="bcdb36957f2ebd3bebdb32610cb47339c39fe73bffe2e5d0a83c22055ab2707c"
Jul 10 18:26:28.458219 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.458190    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcdb36957f2ebd3bebdb32610cb47339c39fe73bffe2e5d0a83c22055ab2707c"} err="failed to get container status \"bcdb36957f2ebd3bebdb32610cb47339c39fe73bffe2e5d0a83c22055ab2707c\": rpc error: code = NotFound desc = could not find container \"bcdb36957f2ebd3bebdb32610cb47339c39fe73bffe2e5d0a83c22055ab2707c\": container with ID starting with bcdb36957f2ebd3bebdb32610cb47339c39fe73bffe2e5d0a83c22055ab2707c not found: ID does not exist"
Jul 10 18:26:28.478548 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.478512    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-maas-api-tls\") pod \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\" (UID: \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\") "
Jul 10 18:26:28.478680 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.478585    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-openshift-service-ca\") pod \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\" (UID: \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\") "
Jul 10 18:26:28.478680 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.478637    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz9kw\" (UniqueName: \"kubernetes.io/projected/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-kube-api-access-tz9kw\") pod \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\" (UID: \"5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5\") "
Jul 10 18:26:28.478946 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.478916    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5" (UID: "5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:26:28.480892 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.480855    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-kube-api-access-tz9kw" (OuterVolumeSpecName: "kube-api-access-tz9kw") pod "5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5" (UID: "5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5"). InnerVolumeSpecName "kube-api-access-tz9kw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:26:28.481015 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.480935    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5" (UID: "5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:26:28.579147 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.579103    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-openshift-service-ca\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:26:28.579147 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.579137    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz9kw\" (UniqueName: \"kubernetes.io/projected/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-kube-api-access-tz9kw\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:26:28.579147 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.579148    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5-maas-api-tls\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:26:28.773397 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.773358    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"]
Jul 10 18:26:28.784334 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:28.782954    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-033a05f0-64cff8b59d-jgt8n"]
Jul 10 18:26:29.511578 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:29.511534    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:30.013421 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:30.013379    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5" path="/var/lib/kubelet/pods/5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5/volumes"
Jul 10 18:26:33.739035 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:33.739001    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:33.809336 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:33.809274    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:34.028965 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:34.028877    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:34.159976 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:34.159936    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:35.092908 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.092852    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:35.153146 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.153113    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"]
Jul 10 18:26:35.153604 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.153576    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5" containerName="maas-api"
Jul 10 18:26:35.153604 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.153599    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5" containerName="maas-api"
Jul 10 18:26:35.153993 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.153686    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fb0c7f2-493e-4ae7-b9b8-d88f279c3da5" containerName="maas-api"
Jul 10 18:26:35.158267 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.158233    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:35.160815 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.160787    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vkbgh\""
Jul 10 18:26:35.160993 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.160787    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-65827bae-serving-cert\""
Jul 10 18:26:35.169243 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.169215    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"]
Jul 10 18:26:35.184949 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.184913    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:35.240111 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.240068    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea3ad16-fc9e-4664-8f66-da11de163874-openshift-service-ca\") pod \"maas-api-e2e-ait-65827bae-8447dd86b-cnvrm\" (UID: \"bea3ad16-fc9e-4664-8f66-da11de163874\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:35.240295 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.240140    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bea3ad16-fc9e-4664-8f66-da11de163874-maas-api-tls\") pod \"maas-api-e2e-ait-65827bae-8447dd86b-cnvrm\" (UID: \"bea3ad16-fc9e-4664-8f66-da11de163874\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:35.240295 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.240189    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tql4\" (UniqueName: \"kubernetes.io/projected/bea3ad16-fc9e-4664-8f66-da11de163874-kube-api-access-6tql4\") pod \"maas-api-e2e-ait-65827bae-8447dd86b-cnvrm\" (UID: \"bea3ad16-fc9e-4664-8f66-da11de163874\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:35.264221 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.264185    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:35.340892 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.340855    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea3ad16-fc9e-4664-8f66-da11de163874-openshift-service-ca\") pod \"maas-api-e2e-ait-65827bae-8447dd86b-cnvrm\" (UID: \"bea3ad16-fc9e-4664-8f66-da11de163874\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:35.340892 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.340907    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bea3ad16-fc9e-4664-8f66-da11de163874-maas-api-tls\") pod \"maas-api-e2e-ait-65827bae-8447dd86b-cnvrm\" (UID: \"bea3ad16-fc9e-4664-8f66-da11de163874\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:35.341273 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.340938    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tql4\" (UniqueName: \"kubernetes.io/projected/bea3ad16-fc9e-4664-8f66-da11de163874-kube-api-access-6tql4\") pod \"maas-api-e2e-ait-65827bae-8447dd86b-cnvrm\" (UID: \"bea3ad16-fc9e-4664-8f66-da11de163874\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:35.341273 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:26:35.341071    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-serving-cert: secret "maas-api-e2e-ait-65827bae-serving-cert" not found
Jul 10 18:26:35.341273 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:26:35.341147    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bea3ad16-fc9e-4664-8f66-da11de163874-maas-api-tls podName:bea3ad16-fc9e-4664-8f66-da11de163874 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:35.841124234 +0000 UTC m=+1588.519391799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bea3ad16-fc9e-4664-8f66-da11de163874-maas-api-tls") pod "maas-api-e2e-ait-65827bae-8447dd86b-cnvrm" (UID: "bea3ad16-fc9e-4664-8f66-da11de163874") : secret "maas-api-e2e-ait-65827bae-serving-cert" not found
Jul 10 18:26:35.341947 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.341923    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea3ad16-fc9e-4664-8f66-da11de163874-openshift-service-ca\") pod \"maas-api-e2e-ait-65827bae-8447dd86b-cnvrm\" (UID: \"bea3ad16-fc9e-4664-8f66-da11de163874\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:35.351006 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.350928    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tql4\" (UniqueName: \"kubernetes.io/projected/bea3ad16-fc9e-4664-8f66-da11de163874-kube-api-access-6tql4\") pod \"maas-api-e2e-ait-65827bae-8447dd86b-cnvrm\" (UID: \"bea3ad16-fc9e-4664-8f66-da11de163874\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:35.541700 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.541662    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:35.733365 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.733246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:35.834252 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.834212    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:35.851232 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.845868    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bea3ad16-fc9e-4664-8f66-da11de163874-maas-api-tls\") pod \"maas-api-e2e-ait-65827bae-8447dd86b-cnvrm\" (UID: \"bea3ad16-fc9e-4664-8f66-da11de163874\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:35.853330 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:35.853278    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bea3ad16-fc9e-4664-8f66-da11de163874-maas-api-tls\") pod \"maas-api-e2e-ait-65827bae-8447dd86b-cnvrm\" (UID: \"bea3ad16-fc9e-4664-8f66-da11de163874\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:36.074409 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:36.074354    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:36.228522 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:36.228483    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"]
Jul 10 18:26:36.232281 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:26:36.232242    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea3ad16_fc9e_4664_8f66_da11de163874.slice/crio-d44e23d23a8a8fbfc132eca81e76facbba9e6a24bba38669bae2f2ae0e7f4f7a WatchSource:0}: Error finding container d44e23d23a8a8fbfc132eca81e76facbba9e6a24bba38669bae2f2ae0e7f4f7a: Status 404 returned error can't find the container with id d44e23d23a8a8fbfc132eca81e76facbba9e6a24bba38669bae2f2ae0e7f4f7a
Jul 10 18:26:36.491509 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:36.491401    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm" event={"ID":"bea3ad16-fc9e-4664-8f66-da11de163874","Type":"ContainerStarted","Data":"d44e23d23a8a8fbfc132eca81e76facbba9e6a24bba38669bae2f2ae0e7f4f7a"}
Jul 10 18:26:37.420339 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:37.420266    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:37.499062 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:37.499025    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm" event={"ID":"bea3ad16-fc9e-4664-8f66-da11de163874","Type":"ContainerStarted","Data":"781eb9cbb56eabe4d6335f68f290a50ff4c997f9488a33a21b405711ed2ffeff"}
Jul 10 18:26:37.499254 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:37.499162    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:37.518060 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:37.517998    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm" podStartSLOduration=1.721989049 podStartE2EDuration="2.517979048s" totalImagesPullingTime="795.989999ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:26:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:37.51554527 +0000 UTC m=+1590.193812850" watchObservedRunningTime="2026-07-10 18:26:37.517979048 +0000 UTC m=+1590.196246625"
Jul 10 18:26:40.394027 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.393986    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:40.463790 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.463751    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"]
Jul 10 18:26:40.464073 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.463984    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm" podUID="bea3ad16-fc9e-4664-8f66-da11de163874" containerName="maas-api" containerID="cri-o://781eb9cbb56eabe4d6335f68f290a50ff4c997f9488a33a21b405711ed2ffeff" gracePeriod=30
Jul 10 18:26:40.725718 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.725686    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:40.788598 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.788556    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea3ad16-fc9e-4664-8f66-da11de163874-openshift-service-ca\") pod \"bea3ad16-fc9e-4664-8f66-da11de163874\" (UID: \"bea3ad16-fc9e-4664-8f66-da11de163874\") "
Jul 10 18:26:40.788803 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.788620    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bea3ad16-fc9e-4664-8f66-da11de163874-maas-api-tls\") pod \"bea3ad16-fc9e-4664-8f66-da11de163874\" (UID: \"bea3ad16-fc9e-4664-8f66-da11de163874\") "
Jul 10 18:26:40.788803 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.788653    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tql4\" (UniqueName: \"kubernetes.io/projected/bea3ad16-fc9e-4664-8f66-da11de163874-kube-api-access-6tql4\") pod \"bea3ad16-fc9e-4664-8f66-da11de163874\" (UID: \"bea3ad16-fc9e-4664-8f66-da11de163874\") "
Jul 10 18:26:40.789045 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.789015    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bea3ad16-fc9e-4664-8f66-da11de163874-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bea3ad16-fc9e-4664-8f66-da11de163874" (UID: "bea3ad16-fc9e-4664-8f66-da11de163874"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:26:40.790930 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.790896    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bea3ad16-fc9e-4664-8f66-da11de163874-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bea3ad16-fc9e-4664-8f66-da11de163874" (UID: "bea3ad16-fc9e-4664-8f66-da11de163874"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:26:40.790930 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.790899    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bea3ad16-fc9e-4664-8f66-da11de163874-kube-api-access-6tql4" (OuterVolumeSpecName: "kube-api-access-6tql4") pod "bea3ad16-fc9e-4664-8f66-da11de163874" (UID: "bea3ad16-fc9e-4664-8f66-da11de163874"). InnerVolumeSpecName "kube-api-access-6tql4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:26:40.794864 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.794837    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:40.889224 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.889180    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea3ad16-fc9e-4664-8f66-da11de163874-openshift-service-ca\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:26:40.889224 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.889222    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bea3ad16-fc9e-4664-8f66-da11de163874-maas-api-tls\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:26:40.889224 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:40.889235    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tql4\" (UniqueName: \"kubernetes.io/projected/bea3ad16-fc9e-4664-8f66-da11de163874-kube-api-access-6tql4\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:26:41.519699 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:41.519659    2569 generic.go:356] "Generic (PLEG): container finished" podID="bea3ad16-fc9e-4664-8f66-da11de163874" containerID="781eb9cbb56eabe4d6335f68f290a50ff4c997f9488a33a21b405711ed2ffeff" exitCode=0
Jul 10 18:26:41.520126 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:41.519729    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm" event={"ID":"bea3ad16-fc9e-4664-8f66-da11de163874","Type":"ContainerDied","Data":"781eb9cbb56eabe4d6335f68f290a50ff4c997f9488a33a21b405711ed2ffeff"}
Jul 10 18:26:41.520126 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:41.519803    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm" event={"ID":"bea3ad16-fc9e-4664-8f66-da11de163874","Type":"ContainerDied","Data":"d44e23d23a8a8fbfc132eca81e76facbba9e6a24bba38669bae2f2ae0e7f4f7a"}
Jul 10 18:26:41.520126 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:41.519732    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"
Jul 10 18:26:41.520126 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:41.519834    2569 scope.go:117] "RemoveContainer" containerID="781eb9cbb56eabe4d6335f68f290a50ff4c997f9488a33a21b405711ed2ffeff"
Jul 10 18:26:41.529154 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:41.529130    2569 scope.go:117] "RemoveContainer" containerID="781eb9cbb56eabe4d6335f68f290a50ff4c997f9488a33a21b405711ed2ffeff"
Jul 10 18:26:41.529516 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:26:41.529491    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"781eb9cbb56eabe4d6335f68f290a50ff4c997f9488a33a21b405711ed2ffeff\": container with ID starting with 781eb9cbb56eabe4d6335f68f290a50ff4c997f9488a33a21b405711ed2ffeff not found: ID does not exist" containerID="781eb9cbb56eabe4d6335f68f290a50ff4c997f9488a33a21b405711ed2ffeff"
Jul 10 18:26:41.529650 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:41.529523    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"781eb9cbb56eabe4d6335f68f290a50ff4c997f9488a33a21b405711ed2ffeff"} err="failed to get container status \"781eb9cbb56eabe4d6335f68f290a50ff4c997f9488a33a21b405711ed2ffeff\": rpc error: code = NotFound desc = could not find container \"781eb9cbb56eabe4d6335f68f290a50ff4c997f9488a33a21b405711ed2ffeff\": container with ID starting with 781eb9cbb56eabe4d6335f68f290a50ff4c997f9488a33a21b405711ed2ffeff not found: ID does not exist"
Jul 10 18:26:41.542445 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:41.542406    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"]
Jul 10 18:26:41.546119 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:41.546085    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-65827bae-8447dd86b-cnvrm"]
Jul 10 18:26:42.013346 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:42.013293    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bea3ad16-fc9e-4664-8f66-da11de163874" path="/var/lib/kubelet/pods/bea3ad16-fc9e-4664-8f66-da11de163874/volumes"
Jul 10 18:26:46.186629 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:46.186593    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:46.283981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:46.283891    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:48.608623 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:48.608484    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:52.245423 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:52.245387    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:52.343829 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:52.343791    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:52.458069 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:52.458034    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:52.557657 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:52.557626    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:53.549799 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.549755    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:53.644212 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.644170    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"]
Jul 10 18:26:53.644749 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.644732    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bea3ad16-fc9e-4664-8f66-da11de163874" containerName="maas-api"
Jul 10 18:26:53.644806 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.644754    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bea3ad16-fc9e-4664-8f66-da11de163874" containerName="maas-api"
Jul 10 18:26:53.644865 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.644854    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bea3ad16-fc9e-4664-8f66-da11de163874" containerName="maas-api"
Jul 10 18:26:53.648475 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.648444    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:53.650966 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.650909    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-20053c97-serving-cert\""
Jul 10 18:26:53.651476 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.651189    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vkbgh\""
Jul 10 18:26:53.653199 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.653067    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:53.658601 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.658566    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"]
Jul 10 18:26:53.730277 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.730244    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:53.807985 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.807878    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01811410-987e-4222-a3e1-ce89b8f312bd-openshift-service-ca\") pod \"maas-api-e2e-derive-20053c97-59c8b94f76-btlfq\" (UID: \"01811410-987e-4222-a3e1-ce89b8f312bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:53.807985 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.807934    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01811410-987e-4222-a3e1-ce89b8f312bd-maas-api-tls\") pod \"maas-api-e2e-derive-20053c97-59c8b94f76-btlfq\" (UID: \"01811410-987e-4222-a3e1-ce89b8f312bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:53.808191 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.808039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6bmr\" (UniqueName: \"kubernetes.io/projected/01811410-987e-4222-a3e1-ce89b8f312bd-kube-api-access-x6bmr\") pod \"maas-api-e2e-derive-20053c97-59c8b94f76-btlfq\" (UID: \"01811410-987e-4222-a3e1-ce89b8f312bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:53.909209 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.909165    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01811410-987e-4222-a3e1-ce89b8f312bd-openshift-service-ca\") pod \"maas-api-e2e-derive-20053c97-59c8b94f76-btlfq\" (UID: \"01811410-987e-4222-a3e1-ce89b8f312bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:53.909209 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.909214    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01811410-987e-4222-a3e1-ce89b8f312bd-maas-api-tls\") pod \"maas-api-e2e-derive-20053c97-59c8b94f76-btlfq\" (UID: \"01811410-987e-4222-a3e1-ce89b8f312bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:53.909545 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.909245    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6bmr\" (UniqueName: \"kubernetes.io/projected/01811410-987e-4222-a3e1-ce89b8f312bd-kube-api-access-x6bmr\") pod \"maas-api-e2e-derive-20053c97-59c8b94f76-btlfq\" (UID: \"01811410-987e-4222-a3e1-ce89b8f312bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:53.909545 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:26:53.909388    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-serving-cert: secret "maas-api-e2e-derive-20053c97-serving-cert" not found
Jul 10 18:26:53.909545 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:26:53.909465    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01811410-987e-4222-a3e1-ce89b8f312bd-maas-api-tls podName:01811410-987e-4222-a3e1-ce89b8f312bd nodeName:}" failed. No retries permitted until 2026-07-10 18:26:54.409446249 +0000 UTC m=+1607.087713826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/01811410-987e-4222-a3e1-ce89b8f312bd-maas-api-tls") pod "maas-api-e2e-derive-20053c97-59c8b94f76-btlfq" (UID: "01811410-987e-4222-a3e1-ce89b8f312bd") : secret "maas-api-e2e-derive-20053c97-serving-cert" not found
Jul 10 18:26:53.910060 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.910036    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01811410-987e-4222-a3e1-ce89b8f312bd-openshift-service-ca\") pod \"maas-api-e2e-derive-20053c97-59c8b94f76-btlfq\" (UID: \"01811410-987e-4222-a3e1-ce89b8f312bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:53.918272 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:53.918244    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6bmr\" (UniqueName: \"kubernetes.io/projected/01811410-987e-4222-a3e1-ce89b8f312bd-kube-api-access-x6bmr\") pod \"maas-api-e2e-derive-20053c97-59c8b94f76-btlfq\" (UID: \"01811410-987e-4222-a3e1-ce89b8f312bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:54.149788 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:54.149695    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:54.250208 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:54.250167    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:54.349260 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:54.349218    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:54.413628 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:54.413516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01811410-987e-4222-a3e1-ce89b8f312bd-maas-api-tls\") pod \"maas-api-e2e-derive-20053c97-59c8b94f76-btlfq\" (UID: \"01811410-987e-4222-a3e1-ce89b8f312bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:54.416110 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:54.416074    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01811410-987e-4222-a3e1-ce89b8f312bd-maas-api-tls\") pod \"maas-api-e2e-derive-20053c97-59c8b94f76-btlfq\" (UID: \"01811410-987e-4222-a3e1-ce89b8f312bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:54.563819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:54.563777    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:54.719414 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:54.719384    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"]
Jul 10 18:26:54.721780 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:26:54.721734    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01811410_987e_4222_a3e1_ce89b8f312bd.slice/crio-089cc17ec8035cef22c95445671b94ab8f6855abf671c4ee4ad5c74feec2da80 WatchSource:0}: Error finding container 089cc17ec8035cef22c95445671b94ab8f6855abf671c4ee4ad5c74feec2da80: Status 404 returned error can't find the container with id 089cc17ec8035cef22c95445671b94ab8f6855abf671c4ee4ad5c74feec2da80
Jul 10 18:26:55.595949 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:55.595905    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq" event={"ID":"01811410-987e-4222-a3e1-ce89b8f312bd","Type":"ContainerStarted","Data":"a78266949f1fc261350fc1c4782b27c03b5d40d977480ad02f4b4f9acea81885"}
Jul 10 18:26:55.596443 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:55.595966    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq" event={"ID":"01811410-987e-4222-a3e1-ce89b8f312bd","Type":"ContainerStarted","Data":"089cc17ec8035cef22c95445671b94ab8f6855abf671c4ee4ad5c74feec2da80"}
Jul 10 18:26:55.596443 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:55.596046    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:55.613397 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:55.613341    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq" podStartSLOduration=2.214952662 podStartE2EDuration="2.613262833s" totalImagesPullingTime="398.310171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:55.612358346 +0000 UTC m=+1608.290625925" watchObservedRunningTime="2026-07-10 18:26:55.613262833 +0000 UTC m=+1608.291530409"
Jul 10 18:26:55.654250 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:55.654210    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:58.006734 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.006692    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:58.179517 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.179482    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:58.279424 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.279336    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:58.373667 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.373621    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"]
Jul 10 18:26:58.373947 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.373899    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq" podUID="01811410-987e-4222-a3e1-ce89b8f312bd" containerName="maas-api" containerID="cri-o://a78266949f1fc261350fc1c4782b27c03b5d40d977480ad02f4b4f9acea81885" gracePeriod=30
Jul 10 18:26:58.405169 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.405125    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:26:58.613520 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.613487    2569 generic.go:356] "Generic (PLEG): container finished" podID="01811410-987e-4222-a3e1-ce89b8f312bd" containerID="a78266949f1fc261350fc1c4782b27c03b5d40d977480ad02f4b4f9acea81885" exitCode=0
Jul 10 18:26:58.613701 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.613552    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq" event={"ID":"01811410-987e-4222-a3e1-ce89b8f312bd","Type":"ContainerDied","Data":"a78266949f1fc261350fc1c4782b27c03b5d40d977480ad02f4b4f9acea81885"}
Jul 10 18:26:58.635068 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.635032    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:58.751161 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.751125    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01811410-987e-4222-a3e1-ce89b8f312bd-openshift-service-ca\") pod \"01811410-987e-4222-a3e1-ce89b8f312bd\" (UID: \"01811410-987e-4222-a3e1-ce89b8f312bd\") "
Jul 10 18:26:58.751381 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.751209    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01811410-987e-4222-a3e1-ce89b8f312bd-maas-api-tls\") pod \"01811410-987e-4222-a3e1-ce89b8f312bd\" (UID: \"01811410-987e-4222-a3e1-ce89b8f312bd\") "
Jul 10 18:26:58.751381 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.751231    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6bmr\" (UniqueName: \"kubernetes.io/projected/01811410-987e-4222-a3e1-ce89b8f312bd-kube-api-access-x6bmr\") pod \"01811410-987e-4222-a3e1-ce89b8f312bd\" (UID: \"01811410-987e-4222-a3e1-ce89b8f312bd\") "
Jul 10 18:26:58.751591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.751561    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01811410-987e-4222-a3e1-ce89b8f312bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "01811410-987e-4222-a3e1-ce89b8f312bd" (UID: "01811410-987e-4222-a3e1-ce89b8f312bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:26:58.753407 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.753380    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01811410-987e-4222-a3e1-ce89b8f312bd-kube-api-access-x6bmr" (OuterVolumeSpecName: "kube-api-access-x6bmr") pod "01811410-987e-4222-a3e1-ce89b8f312bd" (UID: "01811410-987e-4222-a3e1-ce89b8f312bd"). InnerVolumeSpecName "kube-api-access-x6bmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:26:58.753511 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.753483    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01811410-987e-4222-a3e1-ce89b8f312bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "01811410-987e-4222-a3e1-ce89b8f312bd" (UID: "01811410-987e-4222-a3e1-ce89b8f312bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:26:58.852138 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.851996    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01811410-987e-4222-a3e1-ce89b8f312bd-maas-api-tls\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:26:58.852138 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.852046    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6bmr\" (UniqueName: \"kubernetes.io/projected/01811410-987e-4222-a3e1-ce89b8f312bd-kube-api-access-x6bmr\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:26:58.852138 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:58.852057    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01811410-987e-4222-a3e1-ce89b8f312bd-openshift-service-ca\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:26:59.619884 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:59.619847    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq" event={"ID":"01811410-987e-4222-a3e1-ce89b8f312bd","Type":"ContainerDied","Data":"089cc17ec8035cef22c95445671b94ab8f6855abf671c4ee4ad5c74feec2da80"}
Jul 10 18:26:59.620377 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:59.619913    2569 scope.go:117] "RemoveContainer" containerID="a78266949f1fc261350fc1c4782b27c03b5d40d977480ad02f4b4f9acea81885"
Jul 10 18:26:59.620377 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:59.619854    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"
Jul 10 18:26:59.643229 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:59.643120    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"]
Jul 10 18:26:59.649280 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:59.649244    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-20053c97-59c8b94f76-btlfq"]
Jul 10 18:26:59.803655 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:26:59.803618    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:00.013898 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:00.013869    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01811410-987e-4222-a3e1-ce89b8f312bd" path="/var/lib/kubelet/pods/01811410-987e-4222-a3e1-ce89b8f312bd/volumes"
Jul 10 18:27:03.953721 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:03.953675    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:04.027381 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:04.027343    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:04.421381 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:04.421338    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:04.525292 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:04.525259    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:04.619788 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:04.619758    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:05.975697 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:05.975656    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:11.748819 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:11.748781    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:11.850098 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:11.850058    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:11.948452 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:11.948418    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:12.047026 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:12.046989    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:12.483836 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:12.483743    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:38.403959 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:38.403920    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:44.223703 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:44.223661    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:44.408192 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:44.408152    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:27:44.506525 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:27:44.506493    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:00.307452 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:00.307417    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:06.035558 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:06.035528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:06.096514 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:06.096473    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:06.240752 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:06.240714    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:06.379198 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:06.379102    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:16.767690 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:16.767652    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:17.681499 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:17.681452    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:23.436974 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:23.436939    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:23.540239 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:23.540202    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:23.640544 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:23.640511    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:23.707380 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:23.707263    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:24.520588 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:24.520550    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:24.620543 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:24.620508    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:24.721620 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:24.721582    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:26.243995 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:26.243962    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:32.304876 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:32.304785    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:32.410234 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:32.410182    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:33.018222 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:33.018183    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:38.852538 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:38.852494    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:38.918650 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:38.918618    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:39.089574 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:39.089538    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:39.402980 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:39.402937    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:39.812570 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:39.812532    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:42.592453 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.592413    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:42.675181 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.675149    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:42.679492 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.679448    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"]
Jul 10 18:28:42.679966 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.679936    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01811410-987e-4222-a3e1-ce89b8f312bd" containerName="maas-api"
Jul 10 18:28:42.679966 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.679961    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="01811410-987e-4222-a3e1-ce89b8f312bd" containerName="maas-api"
Jul 10 18:28:42.680197 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.680060    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="01811410-987e-4222-a3e1-ce89b8f312bd" containerName="maas-api"
Jul 10 18:28:42.683597 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.683567    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:42.687345 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.687098    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e737ea6a-serving-cert\""
Jul 10 18:28:42.687345 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.687334    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vkbgh\""
Jul 10 18:28:42.695656 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.695412    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"]
Jul 10 18:28:42.748097 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.748061    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:42.850707 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.850580    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cadaaf01-adbb-4325-9fc9-a2da687b1320-openshift-service-ca\") pod \"maas-api-e2e-mt-e737ea6a-646db8876d-pc86v\" (UID: \"cadaaf01-adbb-4325-9fc9-a2da687b1320\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:42.850707 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.850638    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w25nq\" (UniqueName: \"kubernetes.io/projected/cadaaf01-adbb-4325-9fc9-a2da687b1320-kube-api-access-w25nq\") pod \"maas-api-e2e-mt-e737ea6a-646db8876d-pc86v\" (UID: \"cadaaf01-adbb-4325-9fc9-a2da687b1320\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:42.850707 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.850695    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cadaaf01-adbb-4325-9fc9-a2da687b1320-maas-api-tls\") pod \"maas-api-e2e-mt-e737ea6a-646db8876d-pc86v\" (UID: \"cadaaf01-adbb-4325-9fc9-a2da687b1320\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:42.951757 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.951711    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cadaaf01-adbb-4325-9fc9-a2da687b1320-openshift-service-ca\") pod \"maas-api-e2e-mt-e737ea6a-646db8876d-pc86v\" (UID: \"cadaaf01-adbb-4325-9fc9-a2da687b1320\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:42.951757 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.951756    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w25nq\" (UniqueName: \"kubernetes.io/projected/cadaaf01-adbb-4325-9fc9-a2da687b1320-kube-api-access-w25nq\") pod \"maas-api-e2e-mt-e737ea6a-646db8876d-pc86v\" (UID: \"cadaaf01-adbb-4325-9fc9-a2da687b1320\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:42.951987 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.951789    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cadaaf01-adbb-4325-9fc9-a2da687b1320-maas-api-tls\") pod \"maas-api-e2e-mt-e737ea6a-646db8876d-pc86v\" (UID: \"cadaaf01-adbb-4325-9fc9-a2da687b1320\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:42.952025 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:28:42.951979    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-serving-cert: secret "maas-api-e2e-mt-e737ea6a-serving-cert" not found
Jul 10 18:28:42.952073 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:28:42.952062    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cadaaf01-adbb-4325-9fc9-a2da687b1320-maas-api-tls podName:cadaaf01-adbb-4325-9fc9-a2da687b1320 nodeName:}" failed. No retries permitted until 2026-07-10 18:28:43.45203598 +0000 UTC m=+1716.130303543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cadaaf01-adbb-4325-9fc9-a2da687b1320-maas-api-tls") pod "maas-api-e2e-mt-e737ea6a-646db8876d-pc86v" (UID: "cadaaf01-adbb-4325-9fc9-a2da687b1320") : secret "maas-api-e2e-mt-e737ea6a-serving-cert" not found
Jul 10 18:28:42.952488 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.952470    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cadaaf01-adbb-4325-9fc9-a2da687b1320-openshift-service-ca\") pod \"maas-api-e2e-mt-e737ea6a-646db8876d-pc86v\" (UID: \"cadaaf01-adbb-4325-9fc9-a2da687b1320\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:42.963412 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:42.963378    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w25nq\" (UniqueName: \"kubernetes.io/projected/cadaaf01-adbb-4325-9fc9-a2da687b1320-kube-api-access-w25nq\") pod \"maas-api-e2e-mt-e737ea6a-646db8876d-pc86v\" (UID: \"cadaaf01-adbb-4325-9fc9-a2da687b1320\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:43.223914 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:43.223813    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:43.325135 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:43.325095    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:43.456286 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:43.456250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cadaaf01-adbb-4325-9fc9-a2da687b1320-maas-api-tls\") pod \"maas-api-e2e-mt-e737ea6a-646db8876d-pc86v\" (UID: \"cadaaf01-adbb-4325-9fc9-a2da687b1320\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:43.458953 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:43.458911    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cadaaf01-adbb-4325-9fc9-a2da687b1320-maas-api-tls\") pod \"maas-api-e2e-mt-e737ea6a-646db8876d-pc86v\" (UID: \"cadaaf01-adbb-4325-9fc9-a2da687b1320\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:43.599218 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:43.599174    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:43.747519 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:43.747491    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"]
Jul 10 18:28:43.750360 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:28:43.750301    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcadaaf01_adbb_4325_9fc9_a2da687b1320.slice/crio-77f8afa273ee05311325571a3ec37b2426571e4b771b59b4d5da6e84137e2507 WatchSource:0}: Error finding container 77f8afa273ee05311325571a3ec37b2426571e4b771b59b4d5da6e84137e2507: Status 404 returned error can't find the container with id 77f8afa273ee05311325571a3ec37b2426571e4b771b59b4d5da6e84137e2507
Jul 10 18:28:44.141875 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:44.141835    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v" event={"ID":"cadaaf01-adbb-4325-9fc9-a2da687b1320","Type":"ContainerStarted","Data":"77f8afa273ee05311325571a3ec37b2426571e4b771b59b4d5da6e84137e2507"}
Jul 10 18:28:45.148663 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:45.148619    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v" event={"ID":"cadaaf01-adbb-4325-9fc9-a2da687b1320","Type":"ContainerStarted","Data":"dd09f156d247fed4d490f61407af029a7669a3464287ae38848df6797d9b4088"}
Jul 10 18:28:45.149080 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:45.148724    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:45.166698 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:45.166627    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v" podStartSLOduration=2.6330927429999997 podStartE2EDuration="3.166601953s" totalImagesPullingTime="533.50921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:28:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:28:45.16537428 +0000 UTC m=+1717.843641879" watchObservedRunningTime="2026-07-10 18:28:45.166601953 +0000 UTC m=+1717.844869531"
Jul 10 18:28:47.086791 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:47.086755    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:47.698842 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:47.698793    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:47.796540 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:47.796509    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:48.156565 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:48.156530    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:51.159635 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:51.159602    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:53.837889 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:53.837842    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:53.949089 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:53.949052    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:54.440893 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:54.440833    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:54.784471 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:54.784432    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"]
Jul 10 18:28:54.785079 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:54.785029    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v" podUID="cadaaf01-adbb-4325-9fc9-a2da687b1320" containerName="maas-api" containerID="cri-o://dd09f156d247fed4d490f61407af029a7669a3464287ae38848df6797d9b4088" gracePeriod=30
Jul 10 18:28:54.790522 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:54.790488    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:54.854543 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:54.854511    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:28:55.048812 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.048729    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:55.060225 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.060194    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cadaaf01-adbb-4325-9fc9-a2da687b1320-openshift-service-ca\") pod \"cadaaf01-adbb-4325-9fc9-a2da687b1320\" (UID: \"cadaaf01-adbb-4325-9fc9-a2da687b1320\") "
Jul 10 18:28:55.060347 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.060236    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cadaaf01-adbb-4325-9fc9-a2da687b1320-maas-api-tls\") pod \"cadaaf01-adbb-4325-9fc9-a2da687b1320\" (UID: \"cadaaf01-adbb-4325-9fc9-a2da687b1320\") "
Jul 10 18:28:55.060347 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.060270    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w25nq\" (UniqueName: \"kubernetes.io/projected/cadaaf01-adbb-4325-9fc9-a2da687b1320-kube-api-access-w25nq\") pod \"cadaaf01-adbb-4325-9fc9-a2da687b1320\" (UID: \"cadaaf01-adbb-4325-9fc9-a2da687b1320\") "
Jul 10 18:28:55.060661 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.060630    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cadaaf01-adbb-4325-9fc9-a2da687b1320-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cadaaf01-adbb-4325-9fc9-a2da687b1320" (UID: "cadaaf01-adbb-4325-9fc9-a2da687b1320"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:28:55.062488 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.062460    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cadaaf01-adbb-4325-9fc9-a2da687b1320-kube-api-access-w25nq" (OuterVolumeSpecName: "kube-api-access-w25nq") pod "cadaaf01-adbb-4325-9fc9-a2da687b1320" (UID: "cadaaf01-adbb-4325-9fc9-a2da687b1320"). InnerVolumeSpecName "kube-api-access-w25nq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:28:55.062488 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.062472    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cadaaf01-adbb-4325-9fc9-a2da687b1320-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cadaaf01-adbb-4325-9fc9-a2da687b1320" (UID: "cadaaf01-adbb-4325-9fc9-a2da687b1320"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:28:55.161058 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.161018    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cadaaf01-adbb-4325-9fc9-a2da687b1320-openshift-service-ca\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:28:55.161058 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.161051    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cadaaf01-adbb-4325-9fc9-a2da687b1320-maas-api-tls\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:28:55.161058 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.161060    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w25nq\" (UniqueName: \"kubernetes.io/projected/cadaaf01-adbb-4325-9fc9-a2da687b1320-kube-api-access-w25nq\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:28:55.200091 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.200055    2569 generic.go:356] "Generic (PLEG): container finished" podID="cadaaf01-adbb-4325-9fc9-a2da687b1320" containerID="dd09f156d247fed4d490f61407af029a7669a3464287ae38848df6797d9b4088" exitCode=0
Jul 10 18:28:55.200324 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.200103    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"
Jul 10 18:28:55.200324 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.200145    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v" event={"ID":"cadaaf01-adbb-4325-9fc9-a2da687b1320","Type":"ContainerDied","Data":"dd09f156d247fed4d490f61407af029a7669a3464287ae38848df6797d9b4088"}
Jul 10 18:28:55.200324 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.200204    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v" event={"ID":"cadaaf01-adbb-4325-9fc9-a2da687b1320","Type":"ContainerDied","Data":"77f8afa273ee05311325571a3ec37b2426571e4b771b59b4d5da6e84137e2507"}
Jul 10 18:28:55.200324 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.200236    2569 scope.go:117] "RemoveContainer" containerID="dd09f156d247fed4d490f61407af029a7669a3464287ae38848df6797d9b4088"
Jul 10 18:28:55.209719 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.209697    2569 scope.go:117] "RemoveContainer" containerID="dd09f156d247fed4d490f61407af029a7669a3464287ae38848df6797d9b4088"
Jul 10 18:28:55.210032 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:28:55.210009    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd09f156d247fed4d490f61407af029a7669a3464287ae38848df6797d9b4088\": container with ID starting with dd09f156d247fed4d490f61407af029a7669a3464287ae38848df6797d9b4088 not found: ID does not exist" containerID="dd09f156d247fed4d490f61407af029a7669a3464287ae38848df6797d9b4088"
Jul 10 18:28:55.210101 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.210040    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd09f156d247fed4d490f61407af029a7669a3464287ae38848df6797d9b4088"} err="failed to get container status \"dd09f156d247fed4d490f61407af029a7669a3464287ae38848df6797d9b4088\": rpc error: code = NotFound desc = could not find container \"dd09f156d247fed4d490f61407af029a7669a3464287ae38848df6797d9b4088\": container with ID starting with dd09f156d247fed4d490f61407af029a7669a3464287ae38848df6797d9b4088 not found: ID does not exist"
Jul 10 18:28:55.221772 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.221738    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"]
Jul 10 18:28:55.225954 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:55.225924    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e737ea6a-646db8876d-pc86v"]
Jul 10 18:28:56.013892 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:28:56.013853    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cadaaf01-adbb-4325-9fc9-a2da687b1320" path="/var/lib/kubelet/pods/cadaaf01-adbb-4325-9fc9-a2da687b1320/volumes"
Jul 10 18:29:01.073661 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:01.073626    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:01.179724 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:01.179690    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:01.338410 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:01.338329    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:01.584022 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:01.583979    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:01.756625 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:01.756592    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:01.843110 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:01.843072    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:01.913197 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:01.913164    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:07.440973 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:07.440914    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:07.547526 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:07.547491    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:07.644343 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:07.644295    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:07.798003 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:07.797962    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:13.774284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:13.774247    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:13.875289 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:13.875241    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:20.470091 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:20.470044    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:20.757453 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:20.757413    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:20.856927 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:20.856892    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:23.834879 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:23.834843    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:23.919079 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:23.919046    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:23.920018 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:23.919995    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"]
Jul 10 18:29:23.920395 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:23.920381    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cadaaf01-adbb-4325-9fc9-a2da687b1320" containerName="maas-api"
Jul 10 18:29:23.920459 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:23.920396    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cadaaf01-adbb-4325-9fc9-a2da687b1320" containerName="maas-api"
Jul 10 18:29:23.920459 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:23.920456    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="cadaaf01-adbb-4325-9fc9-a2da687b1320" containerName="maas-api"
Jul 10 18:29:23.923519 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:23.923497    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:29:23.926195 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:23.926166    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-95637065-serving-cert\""
Jul 10 18:29:23.926195 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:23.926195    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vkbgh\""
Jul 10 18:29:23.934291 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:23.934258    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"]
Jul 10 18:29:23.995799 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:23.995767    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:24.004919 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.004882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wc8m\" (UniqueName: \"kubernetes.io/projected/2bf580bb-55ca-4424-a5d8-492b99c9e409-kube-api-access-8wc8m\") pod \"maas-api-e2e-mt-95637065-695d95d6cd-4ghh7\" (UID: \"2bf580bb-55ca-4424-a5d8-492b99c9e409\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:29:24.005098 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.004926    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf580bb-55ca-4424-a5d8-492b99c9e409-openshift-service-ca\") pod \"maas-api-e2e-mt-95637065-695d95d6cd-4ghh7\" (UID: \"2bf580bb-55ca-4424-a5d8-492b99c9e409\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:29:24.005098 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.005008    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bf580bb-55ca-4424-a5d8-492b99c9e409-maas-api-tls\") pod \"maas-api-e2e-mt-95637065-695d95d6cd-4ghh7\" (UID: \"2bf580bb-55ca-4424-a5d8-492b99c9e409\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:29:24.106478 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.106383    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wc8m\" (UniqueName: \"kubernetes.io/projected/2bf580bb-55ca-4424-a5d8-492b99c9e409-kube-api-access-8wc8m\") pod \"maas-api-e2e-mt-95637065-695d95d6cd-4ghh7\" (UID: \"2bf580bb-55ca-4424-a5d8-492b99c9e409\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:29:24.106478 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.106424    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf580bb-55ca-4424-a5d8-492b99c9e409-openshift-service-ca\") pod \"maas-api-e2e-mt-95637065-695d95d6cd-4ghh7\" (UID: \"2bf580bb-55ca-4424-a5d8-492b99c9e409\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:29:24.106478 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.106464    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bf580bb-55ca-4424-a5d8-492b99c9e409-maas-api-tls\") pod \"maas-api-e2e-mt-95637065-695d95d6cd-4ghh7\" (UID: \"2bf580bb-55ca-4424-a5d8-492b99c9e409\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:29:24.107176 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.107151    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf580bb-55ca-4424-a5d8-492b99c9e409-openshift-service-ca\") pod \"maas-api-e2e-mt-95637065-695d95d6cd-4ghh7\" (UID: \"2bf580bb-55ca-4424-a5d8-492b99c9e409\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:29:24.108933 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.108912    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bf580bb-55ca-4424-a5d8-492b99c9e409-maas-api-tls\") pod \"maas-api-e2e-mt-95637065-695d95d6cd-4ghh7\" (UID: \"2bf580bb-55ca-4424-a5d8-492b99c9e409\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:29:24.116880 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.116837    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wc8m\" (UniqueName: \"kubernetes.io/projected/2bf580bb-55ca-4424-a5d8-492b99c9e409-kube-api-access-8wc8m\") pod \"maas-api-e2e-mt-95637065-695d95d6cd-4ghh7\" (UID: \"2bf580bb-55ca-4424-a5d8-492b99c9e409\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:29:24.156850 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.156818    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:24.236066 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.236022    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:29:24.387349 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.387240    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"]
Jul 10 18:29:24.391484 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:29:24.391453    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf580bb_55ca_4424_a5d8_492b99c9e409.slice/crio-65595835e326f2b590bc7f57fe286d9c6c605951a45209b84e4ff6ad82588492 WatchSource:0}: Error finding container 65595835e326f2b590bc7f57fe286d9c6c605951a45209b84e4ff6ad82588492: Status 404 returned error can't find the container with id 65595835e326f2b590bc7f57fe286d9c6c605951a45209b84e4ff6ad82588492
Jul 10 18:29:24.503620 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.503582    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:24.616901 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:24.616865    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:25.356704 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:25.356655    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7" event={"ID":"2bf580bb-55ca-4424-a5d8-492b99c9e409","Type":"ContainerStarted","Data":"594c53f05c749a5ed25b7c2851927edefcb96464b29625b2ccdaa95dc57a4933"}
Jul 10 18:29:25.357146 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:25.356725    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7" event={"ID":"2bf580bb-55ca-4424-a5d8-492b99c9e409","Type":"ContainerStarted","Data":"65595835e326f2b590bc7f57fe286d9c6c605951a45209b84e4ff6ad82588492"}
Jul 10 18:29:25.357146 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:25.356768    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:29:25.374456 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:25.374399    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7" podStartSLOduration=2.05941226 podStartE2EDuration="2.374379054s" totalImagesPullingTime="314.966794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:29:25.372652376 +0000 UTC m=+1758.050919955" watchObservedRunningTime="2026-07-10 18:29:25.374379054 +0000 UTC m=+1758.052646632"
Jul 10 18:29:27.061055 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:27.061017    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:27.163343 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:27.163287    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:28.285593 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:28.285547    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:31.367023 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:31.366996    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:29:40.162768 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:40.162731    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:43.328485 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:43.328446    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:43.392739 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:43.392699    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:46.234166 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:46.234130    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:29:46.334480 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:29:46.334446    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:00.137202 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.137101    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7"]
Jul 10 18:30:00.140798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.140772    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46"]
Jul 10 18:30:00.140935 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.140908    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7"
Jul 10 18:30:00.144549 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.144525    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46"
Jul 10 18:30:00.148435 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.148406    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7"]
Jul 10 18:30:00.151369 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.151337    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46"]
Jul 10 18:30:00.203574 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.203533    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrx5b\" (UniqueName: \"kubernetes.io/projected/a1e75431-8d00-46bf-bd76-9087867ff647-kube-api-access-xrx5b\") pod \"maas-api-key-cleanup-29728470-dpzl7\" (UID: \"a1e75431-8d00-46bf-bd76-9087867ff647\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7"
Jul 10 18:30:00.203762 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.203593    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hgjc\" (UniqueName: \"kubernetes.io/projected/4291cfea-848b-4bd2-b581-50e110df3e9f-kube-api-access-7hgjc\") pod \"maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46\" (UID: \"4291cfea-848b-4bd2-b581-50e110df3e9f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46"
Jul 10 18:30:00.304977 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.304928    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hgjc\" (UniqueName: \"kubernetes.io/projected/4291cfea-848b-4bd2-b581-50e110df3e9f-kube-api-access-7hgjc\") pod \"maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46\" (UID: \"4291cfea-848b-4bd2-b581-50e110df3e9f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46"
Jul 10 18:30:00.305176 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.305039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrx5b\" (UniqueName: \"kubernetes.io/projected/a1e75431-8d00-46bf-bd76-9087867ff647-kube-api-access-xrx5b\") pod \"maas-api-key-cleanup-29728470-dpzl7\" (UID: \"a1e75431-8d00-46bf-bd76-9087867ff647\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7"
Jul 10 18:30:00.314161 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.314117    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hgjc\" (UniqueName: \"kubernetes.io/projected/4291cfea-848b-4bd2-b581-50e110df3e9f-kube-api-access-7hgjc\") pod \"maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46\" (UID: \"4291cfea-848b-4bd2-b581-50e110df3e9f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46"
Jul 10 18:30:00.314161 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.314138    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrx5b\" (UniqueName: \"kubernetes.io/projected/a1e75431-8d00-46bf-bd76-9087867ff647-kube-api-access-xrx5b\") pod \"maas-api-key-cleanup-29728470-dpzl7\" (UID: \"a1e75431-8d00-46bf-bd76-9087867ff647\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7"
Jul 10 18:30:00.455974 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.455870    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7"
Jul 10 18:30:00.463161 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.463136    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46"
Jul 10 18:30:00.580117 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.580076    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:00.628347 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.628294    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7"]
Jul 10 18:30:00.632511 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:30:00.632469    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e75431_8d00_46bf_bd76_9087867ff647.slice/crio-7f4f149b7bd633ca78451826289d2b5360898185886ed78667765cdc710442da WatchSource:0}: Error finding container 7f4f149b7bd633ca78451826289d2b5360898185886ed78667765cdc710442da: Status 404 returned error can't find the container with id 7f4f149b7bd633ca78451826289d2b5360898185886ed78667765cdc710442da
Jul 10 18:30:00.650999 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:00.650971    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46"]
Jul 10 18:30:01.008936 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.008898    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"]
Jul 10 18:30:01.009118 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.009096    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7" podUID="2bf580bb-55ca-4424-a5d8-492b99c9e409" containerName="maas-api" containerID="cri-o://594c53f05c749a5ed25b7c2851927edefcb96464b29625b2ccdaa95dc57a4933" gracePeriod=30
Jul 10 18:30:01.041345 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.041299    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:01.046689 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.046653    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46"]
Jul 10 18:30:01.255468 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.255433    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:30:01.315257 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.315224    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wc8m\" (UniqueName: \"kubernetes.io/projected/2bf580bb-55ca-4424-a5d8-492b99c9e409-kube-api-access-8wc8m\") pod \"2bf580bb-55ca-4424-a5d8-492b99c9e409\" (UID: \"2bf580bb-55ca-4424-a5d8-492b99c9e409\") "
Jul 10 18:30:01.315461 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.315298    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf580bb-55ca-4424-a5d8-492b99c9e409-openshift-service-ca\") pod \"2bf580bb-55ca-4424-a5d8-492b99c9e409\" (UID: \"2bf580bb-55ca-4424-a5d8-492b99c9e409\") "
Jul 10 18:30:01.315461 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.315367    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bf580bb-55ca-4424-a5d8-492b99c9e409-maas-api-tls\") pod \"2bf580bb-55ca-4424-a5d8-492b99c9e409\" (UID: \"2bf580bb-55ca-4424-a5d8-492b99c9e409\") "
Jul 10 18:30:01.315752 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.315721    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf580bb-55ca-4424-a5d8-492b99c9e409-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2bf580bb-55ca-4424-a5d8-492b99c9e409" (UID: "2bf580bb-55ca-4424-a5d8-492b99c9e409"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:30:01.317430 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.317398    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf580bb-55ca-4424-a5d8-492b99c9e409-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2bf580bb-55ca-4424-a5d8-492b99c9e409" (UID: "2bf580bb-55ca-4424-a5d8-492b99c9e409"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:30:01.317520 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.317423    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf580bb-55ca-4424-a5d8-492b99c9e409-kube-api-access-8wc8m" (OuterVolumeSpecName: "kube-api-access-8wc8m") pod "2bf580bb-55ca-4424-a5d8-492b99c9e409" (UID: "2bf580bb-55ca-4424-a5d8-492b99c9e409"). InnerVolumeSpecName "kube-api-access-8wc8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:30:01.416244 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.416205    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wc8m\" (UniqueName: \"kubernetes.io/projected/2bf580bb-55ca-4424-a5d8-492b99c9e409-kube-api-access-8wc8m\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:30:01.416244 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.416239    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf580bb-55ca-4424-a5d8-492b99c9e409-openshift-service-ca\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:30:01.416244 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.416250    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bf580bb-55ca-4424-a5d8-492b99c9e409-maas-api-tls\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:30:01.552889 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.552852    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7" event={"ID":"a1e75431-8d00-46bf-bd76-9087867ff647","Type":"ContainerStarted","Data":"56993ab50e4f4eacf84240c2d5d5e8d47b52005b00e70ec97a1461374cfc5dd6"}
Jul 10 18:30:01.553099 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.552917    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7" event={"ID":"a1e75431-8d00-46bf-bd76-9087867ff647","Type":"ContainerStarted","Data":"7f4f149b7bd633ca78451826289d2b5360898185886ed78667765cdc710442da"}
Jul 10 18:30:01.554491 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.554462    2569 generic.go:356] "Generic (PLEG): container finished" podID="4291cfea-848b-4bd2-b581-50e110df3e9f" containerID="6b49488f8b085cb4304849f7a2529cb382d406dad2b49b82c9b315e9feff46af" exitCode=6
Jul 10 18:30:01.554609 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.554543    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46" event={"ID":"4291cfea-848b-4bd2-b581-50e110df3e9f","Type":"ContainerDied","Data":"6b49488f8b085cb4304849f7a2529cb382d406dad2b49b82c9b315e9feff46af"}
Jul 10 18:30:01.554609 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.554578    2569 scope.go:117] "RemoveContainer" containerID="6b49488f8b085cb4304849f7a2529cb382d406dad2b49b82c9b315e9feff46af"
Jul 10 18:30:01.554609 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.554587    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46" event={"ID":"4291cfea-848b-4bd2-b581-50e110df3e9f","Type":"ContainerStarted","Data":"a0e68bcd397dd242f2389c847c5686b7a47d95831b708222d9a9dbcf3f09ca37"}
Jul 10 18:30:01.562696 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.562370    2569 generic.go:356] "Generic (PLEG): container finished" podID="2bf580bb-55ca-4424-a5d8-492b99c9e409" containerID="594c53f05c749a5ed25b7c2851927edefcb96464b29625b2ccdaa95dc57a4933" exitCode=0
Jul 10 18:30:01.562696 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.562453    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7" event={"ID":"2bf580bb-55ca-4424-a5d8-492b99c9e409","Type":"ContainerDied","Data":"594c53f05c749a5ed25b7c2851927edefcb96464b29625b2ccdaa95dc57a4933"}
Jul 10 18:30:01.562696 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.562535    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7" event={"ID":"2bf580bb-55ca-4424-a5d8-492b99c9e409","Type":"ContainerDied","Data":"65595835e326f2b590bc7f57fe286d9c6c605951a45209b84e4ff6ad82588492"}
Jul 10 18:30:01.562696 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.562567    2569 scope.go:117] "RemoveContainer" containerID="594c53f05c749a5ed25b7c2851927edefcb96464b29625b2ccdaa95dc57a4933"
Jul 10 18:30:01.562696 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.562577    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"
Jul 10 18:30:01.573393 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.573132    2569 scope.go:117] "RemoveContainer" containerID="594c53f05c749a5ed25b7c2851927edefcb96464b29625b2ccdaa95dc57a4933"
Jul 10 18:30:01.573580 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:30:01.573534    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"594c53f05c749a5ed25b7c2851927edefcb96464b29625b2ccdaa95dc57a4933\": container with ID starting with 594c53f05c749a5ed25b7c2851927edefcb96464b29625b2ccdaa95dc57a4933 not found: ID does not exist" containerID="594c53f05c749a5ed25b7c2851927edefcb96464b29625b2ccdaa95dc57a4933"
Jul 10 18:30:01.573707 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.573592    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"594c53f05c749a5ed25b7c2851927edefcb96464b29625b2ccdaa95dc57a4933"} err="failed to get container status \"594c53f05c749a5ed25b7c2851927edefcb96464b29625b2ccdaa95dc57a4933\": rpc error: code = NotFound desc = could not find container \"594c53f05c749a5ed25b7c2851927edefcb96464b29625b2ccdaa95dc57a4933\": container with ID starting with 594c53f05c749a5ed25b7c2851927edefcb96464b29625b2ccdaa95dc57a4933 not found: ID does not exist"
Jul 10 18:30:01.574747 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.574702    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7" podStartSLOduration=1.57468903 podStartE2EDuration="1.57468903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:01.57262476 +0000 UTC m=+1794.250892340" watchObservedRunningTime="2026-07-10 18:30:01.57468903 +0000 UTC m=+1794.252956608"
Jul 10 18:30:01.589788 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.589738    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"]
Jul 10 18:30:01.592185 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:01.592154    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-95637065-695d95d6cd-4ghh7"]
Jul 10 18:30:02.014449 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:02.014417    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bf580bb-55ca-4424-a5d8-492b99c9e409" path="/var/lib/kubelet/pods/2bf580bb-55ca-4424-a5d8-492b99c9e409/volumes"
Jul 10 18:30:02.569519 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:02.569488    2569 generic.go:356] "Generic (PLEG): container finished" podID="4291cfea-848b-4bd2-b581-50e110df3e9f" containerID="6792d51f240447642d5c3d40c1061ee7858a79370c9ffd287f700fcb5cb889d5" exitCode=6
Jul 10 18:30:02.570027 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:02.569555    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46" event={"ID":"4291cfea-848b-4bd2-b581-50e110df3e9f","Type":"ContainerDied","Data":"6792d51f240447642d5c3d40c1061ee7858a79370c9ffd287f700fcb5cb889d5"}
Jul 10 18:30:02.570027 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:02.569649    2569 scope.go:117] "RemoveContainer" containerID="6b49488f8b085cb4304849f7a2529cb382d406dad2b49b82c9b315e9feff46af"
Jul 10 18:30:02.716590 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:02.716558    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46"
Jul 10 18:30:02.829242 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:02.829208    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hgjc\" (UniqueName: \"kubernetes.io/projected/4291cfea-848b-4bd2-b581-50e110df3e9f-kube-api-access-7hgjc\") pod \"4291cfea-848b-4bd2-b581-50e110df3e9f\" (UID: \"4291cfea-848b-4bd2-b581-50e110df3e9f\") "
Jul 10 18:30:02.831407 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:02.831373    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4291cfea-848b-4bd2-b581-50e110df3e9f-kube-api-access-7hgjc" (OuterVolumeSpecName: "kube-api-access-7hgjc") pod "4291cfea-848b-4bd2-b581-50e110df3e9f" (UID: "4291cfea-848b-4bd2-b581-50e110df3e9f"). InnerVolumeSpecName "kube-api-access-7hgjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:30:02.929772 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:02.929733    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hgjc\" (UniqueName: \"kubernetes.io/projected/4291cfea-848b-4bd2-b581-50e110df3e9f-kube-api-access-7hgjc\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:30:03.577836 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:03.577802    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46"
Jul 10 18:30:03.578284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:03.577856    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46" event={"ID":"4291cfea-848b-4bd2-b581-50e110df3e9f","Type":"ContainerDied","Data":"a0e68bcd397dd242f2389c847c5686b7a47d95831b708222d9a9dbcf3f09ca37"}
Jul 10 18:30:03.578284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:03.577913    2569 scope.go:117] "RemoveContainer" containerID="6792d51f240447642d5c3d40c1061ee7858a79370c9ffd287f700fcb5cb889d5"
Jul 10 18:30:03.601686 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:03.601642    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46"]
Jul 10 18:30:03.608292 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:03.608260    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-95637065-29728470-z9n46"]
Jul 10 18:30:04.014903 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:04.014855    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4291cfea-848b-4bd2-b581-50e110df3e9f" path="/var/lib/kubelet/pods/4291cfea-848b-4bd2-b581-50e110df3e9f/volumes"
Jul 10 18:30:06.687098 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:06.687062    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:07.910911 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:07.910880    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:30:07.914155 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:07.914131    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:30:11.698541 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:11.698502    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:49.001016 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:49.000980    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:49.134353 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:49.134289    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:30:54.860273 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:30:54.860236    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:00.025004 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:00.024967    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7"]
Jul 10 18:31:00.025435 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:00.025176    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7" podUID="a1e75431-8d00-46bf-bd76-9087867ff647" containerName="cleanup" containerID="cri-o://56993ab50e4f4eacf84240c2d5d5e8d47b52005b00e70ec97a1461374cfc5dd6" gracePeriod=30
Jul 10 18:31:00.739359 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:00.739290    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:00.809910 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:00.809862    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:01.035215 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:01.035181    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:01.241198 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:01.241163    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:02.306727 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:02.306690    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:02.405582 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:02.405537    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:02.506905 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:02.506862    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:03.174066 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:03.174006    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:03.298642 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:03.298608    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:03.468078 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:03.467988    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:04.757065 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:04.757036    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:10.518526 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:10.518482    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:10.637794 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:10.637739    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:11.181472 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:11.181437    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:17.037570 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:17.037536    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:17.143522 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:17.143480    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:17.237474 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:17.237435    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:24.276097 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:24.276052    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:27.729558 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:27.729524    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:28.061173 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:28.061133    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:29.332007 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:29.331921    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:29.432489 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:29.432455    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:30.218590 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:30.218554    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7"
Jul 10 18:31:30.270323 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:30.270267    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrx5b\" (UniqueName: \"kubernetes.io/projected/a1e75431-8d00-46bf-bd76-9087867ff647-kube-api-access-xrx5b\") pod \"a1e75431-8d00-46bf-bd76-9087867ff647\" (UID: \"a1e75431-8d00-46bf-bd76-9087867ff647\") "
Jul 10 18:31:30.272413 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:30.272383    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1e75431-8d00-46bf-bd76-9087867ff647-kube-api-access-xrx5b" (OuterVolumeSpecName: "kube-api-access-xrx5b") pod "a1e75431-8d00-46bf-bd76-9087867ff647" (UID: "a1e75431-8d00-46bf-bd76-9087867ff647"). InnerVolumeSpecName "kube-api-access-xrx5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:31:30.371291 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:30.371194    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrx5b\" (UniqueName: \"kubernetes.io/projected/a1e75431-8d00-46bf-bd76-9087867ff647-kube-api-access-xrx5b\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:31:31.008340 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:31.008282    2569 generic.go:356] "Generic (PLEG): container finished" podID="a1e75431-8d00-46bf-bd76-9087867ff647" containerID="56993ab50e4f4eacf84240c2d5d5e8d47b52005b00e70ec97a1461374cfc5dd6" exitCode=137
Jul 10 18:31:31.008340 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:31.008336    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7"
Jul 10 18:31:31.008589 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:31.008356    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7" event={"ID":"a1e75431-8d00-46bf-bd76-9087867ff647","Type":"ContainerDied","Data":"56993ab50e4f4eacf84240c2d5d5e8d47b52005b00e70ec97a1461374cfc5dd6"}
Jul 10 18:31:31.008589 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:31.008405    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7" event={"ID":"a1e75431-8d00-46bf-bd76-9087867ff647","Type":"ContainerDied","Data":"7f4f149b7bd633ca78451826289d2b5360898185886ed78667765cdc710442da"}
Jul 10 18:31:31.008589 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:31.008428    2569 scope.go:117] "RemoveContainer" containerID="56993ab50e4f4eacf84240c2d5d5e8d47b52005b00e70ec97a1461374cfc5dd6"
Jul 10 18:31:31.018128 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:31.018104    2569 scope.go:117] "RemoveContainer" containerID="56993ab50e4f4eacf84240c2d5d5e8d47b52005b00e70ec97a1461374cfc5dd6"
Jul 10 18:31:31.018487 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:31:31.018464    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56993ab50e4f4eacf84240c2d5d5e8d47b52005b00e70ec97a1461374cfc5dd6\": container with ID starting with 56993ab50e4f4eacf84240c2d5d5e8d47b52005b00e70ec97a1461374cfc5dd6 not found: ID does not exist" containerID="56993ab50e4f4eacf84240c2d5d5e8d47b52005b00e70ec97a1461374cfc5dd6"
Jul 10 18:31:31.018578 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:31.018497    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56993ab50e4f4eacf84240c2d5d5e8d47b52005b00e70ec97a1461374cfc5dd6"} err="failed to get container status \"56993ab50e4f4eacf84240c2d5d5e8d47b52005b00e70ec97a1461374cfc5dd6\": rpc error: code = NotFound desc = could not find container \"56993ab50e4f4eacf84240c2d5d5e8d47b52005b00e70ec97a1461374cfc5dd6\": container with ID starting with 56993ab50e4f4eacf84240c2d5d5e8d47b52005b00e70ec97a1461374cfc5dd6 not found: ID does not exist"
Jul 10 18:31:31.052134 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:31.052102    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7"]
Jul 10 18:31:31.058916 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:31.058886    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728470-dpzl7"]
Jul 10 18:31:32.014325 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:32.014272    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1e75431-8d00-46bf-bd76-9087867ff647" path="/var/lib/kubelet/pods/a1e75431-8d00-46bf-bd76-9087867ff647/volumes"
Jul 10 18:31:48.993581 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:48.993542    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:54.719959 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:54.719923    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:56.060368 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:56.060334    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:58.698925 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.698872    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:58.772209 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.772169    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"]
Jul 10 18:31:58.772811 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.772791    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4291cfea-848b-4bd2-b581-50e110df3e9f" containerName="cleanup"
Jul 10 18:31:58.772911 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.772814    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4291cfea-848b-4bd2-b581-50e110df3e9f" containerName="cleanup"
Jul 10 18:31:58.772911 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.772832    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4291cfea-848b-4bd2-b581-50e110df3e9f" containerName="cleanup"
Jul 10 18:31:58.772911 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.772841    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4291cfea-848b-4bd2-b581-50e110df3e9f" containerName="cleanup"
Jul 10 18:31:58.772911 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.772878    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1e75431-8d00-46bf-bd76-9087867ff647" containerName="cleanup"
Jul 10 18:31:58.772911 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.772886    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1e75431-8d00-46bf-bd76-9087867ff647" containerName="cleanup"
Jul 10 18:31:58.772911 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.772895    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bf580bb-55ca-4424-a5d8-492b99c9e409" containerName="maas-api"
Jul 10 18:31:58.772911 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.772903    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf580bb-55ca-4424-a5d8-492b99c9e409" containerName="maas-api"
Jul 10 18:31:58.773292 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.772991    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bf580bb-55ca-4424-a5d8-492b99c9e409" containerName="maas-api"
Jul 10 18:31:58.773292 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.773003    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4291cfea-848b-4bd2-b581-50e110df3e9f" containerName="cleanup"
Jul 10 18:31:58.773292 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.773015    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1e75431-8d00-46bf-bd76-9087867ff647" containerName="cleanup"
Jul 10 18:31:58.773292 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.773024    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4291cfea-848b-4bd2-b581-50e110df3e9f" containerName="cleanup"
Jul 10 18:31:58.776322 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.776283    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:31:58.778297 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.778254    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:58.778902 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.778884    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-ea8030-serving-cert\""
Jul 10 18:31:58.778969 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.778930    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vkbgh\""
Jul 10 18:31:58.784830 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.784800    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"]
Jul 10 18:31:58.816035 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.815994    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9faa2bb5-ba09-4534-a21e-994b82cc330f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8\" (UID: \"9faa2bb5-ba09-4534-a21e-994b82cc330f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:31:58.816225 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.816105    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlbvd\" (UniqueName: \"kubernetes.io/projected/9faa2bb5-ba09-4534-a21e-994b82cc330f-kube-api-access-mlbvd\") pod \"maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8\" (UID: \"9faa2bb5-ba09-4534-a21e-994b82cc330f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:31:58.816225 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.816182    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9faa2bb5-ba09-4534-a21e-994b82cc330f-maas-api-tls\") pod \"maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8\" (UID: \"9faa2bb5-ba09-4534-a21e-994b82cc330f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:31:58.840217 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.840185    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:58.917434 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.917393    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlbvd\" (UniqueName: \"kubernetes.io/projected/9faa2bb5-ba09-4534-a21e-994b82cc330f-kube-api-access-mlbvd\") pod \"maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8\" (UID: \"9faa2bb5-ba09-4534-a21e-994b82cc330f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:31:58.917655 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.917446    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9faa2bb5-ba09-4534-a21e-994b82cc330f-maas-api-tls\") pod \"maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8\" (UID: \"9faa2bb5-ba09-4534-a21e-994b82cc330f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:31:58.917655 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.917484    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9faa2bb5-ba09-4534-a21e-994b82cc330f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8\" (UID: \"9faa2bb5-ba09-4534-a21e-994b82cc330f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:31:58.917655 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:31:58.917644    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-serving-cert: secret "maas-api-e2e-inf-a-ea8030-serving-cert" not found
Jul 10 18:31:58.917846 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:31:58.917736    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9faa2bb5-ba09-4534-a21e-994b82cc330f-maas-api-tls podName:9faa2bb5-ba09-4534-a21e-994b82cc330f nodeName:}" failed. No retries permitted until 2026-07-10 18:31:59.417712147 +0000 UTC m=+1912.095979716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9faa2bb5-ba09-4534-a21e-994b82cc330f-maas-api-tls") pod "maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8" (UID: "9faa2bb5-ba09-4534-a21e-994b82cc330f") : secret "maas-api-e2e-inf-a-ea8030-serving-cert" not found
Jul 10 18:31:58.918141 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.918122    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9faa2bb5-ba09-4534-a21e-994b82cc330f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8\" (UID: \"9faa2bb5-ba09-4534-a21e-994b82cc330f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:31:58.928699 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:58.928659    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlbvd\" (UniqueName: \"kubernetes.io/projected/9faa2bb5-ba09-4534-a21e-994b82cc330f-kube-api-access-mlbvd\") pod \"maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8\" (UID: \"9faa2bb5-ba09-4534-a21e-994b82cc330f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:31:59.204623 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:59.204580    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:59.302771 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:59.302730    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:59.402632 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:59.402590    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:31:59.421655 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:59.421622    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9faa2bb5-ba09-4534-a21e-994b82cc330f-maas-api-tls\") pod \"maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8\" (UID: \"9faa2bb5-ba09-4534-a21e-994b82cc330f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:31:59.424113 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:59.424086    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9faa2bb5-ba09-4534-a21e-994b82cc330f-maas-api-tls\") pod \"maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8\" (UID: \"9faa2bb5-ba09-4534-a21e-994b82cc330f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:31:59.691737 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:59.691641    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:31:59.848807 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:59.848780    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"]
Jul 10 18:31:59.851173 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:31:59.851141    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9faa2bb5_ba09_4534_a21e_994b82cc330f.slice/crio-bfb295faaf2f4b8afef69a0506d236c2647a84cb71914cb78f4d57d116e3573c WatchSource:0}: Error finding container bfb295faaf2f4b8afef69a0506d236c2647a84cb71914cb78f4d57d116e3573c: Status 404 returned error can't find the container with id bfb295faaf2f4b8afef69a0506d236c2647a84cb71914cb78f4d57d116e3573c
Jul 10 18:31:59.852919 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:31:59.852896    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:32:00.166269 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:00.166232    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8" event={"ID":"9faa2bb5-ba09-4534-a21e-994b82cc330f","Type":"ContainerStarted","Data":"bfb295faaf2f4b8afef69a0506d236c2647a84cb71914cb78f4d57d116e3573c"}
Jul 10 18:32:01.173371 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:01.173334    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8" event={"ID":"9faa2bb5-ba09-4534-a21e-994b82cc330f","Type":"ContainerStarted","Data":"3d4f8f93e314e361d24203568b702353441f0650d1d33a9655f6f22bea76fc69"}
Jul 10 18:32:01.173826 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:01.173472    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:32:01.194284 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:01.194228    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8" podStartSLOduration=2.695307603 podStartE2EDuration="3.194208323s" totalImagesPullingTime="498.90072ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:32:01.192484639 +0000 UTC m=+1913.870752217" watchObservedRunningTime="2026-07-10 18:32:01.194208323 +0000 UTC m=+1913.872475927"
Jul 10 18:32:03.185010 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:03.184970    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:03.492305 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:03.492190    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:03.792343 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:03.792275    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:04.353339 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:04.353289    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:06.733207 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.733164    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:06.803802 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.803760    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"]
Jul 10 18:32:06.807926 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.807896    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:06.810904 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.810876    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-76cdbe-serving-cert\""
Jul 10 18:32:06.817049 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.816975    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"]
Jul 10 18:32:06.823739 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.823710    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:06.889345 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.889263    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05d97b70-b980-4137-bf28-e93461661f25-maas-api-tls\") pod \"maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5\" (UID: \"05d97b70-b980-4137-bf28-e93461661f25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:06.889559 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.889368    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zndv5\" (UniqueName: \"kubernetes.io/projected/05d97b70-b980-4137-bf28-e93461661f25-kube-api-access-zndv5\") pod \"maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5\" (UID: \"05d97b70-b980-4137-bf28-e93461661f25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:06.889559 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.889438    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05d97b70-b980-4137-bf28-e93461661f25-openshift-service-ca\") pod \"maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5\" (UID: \"05d97b70-b980-4137-bf28-e93461661f25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:06.896024 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.895995    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:06.990849 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.990738    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zndv5\" (UniqueName: \"kubernetes.io/projected/05d97b70-b980-4137-bf28-e93461661f25-kube-api-access-zndv5\") pod \"maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5\" (UID: \"05d97b70-b980-4137-bf28-e93461661f25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:06.990849 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.990849    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05d97b70-b980-4137-bf28-e93461661f25-openshift-service-ca\") pod \"maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5\" (UID: \"05d97b70-b980-4137-bf28-e93461661f25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:06.991108 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.990881    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05d97b70-b980-4137-bf28-e93461661f25-maas-api-tls\") pod \"maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5\" (UID: \"05d97b70-b980-4137-bf28-e93461661f25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:06.991108 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:32:06.990996    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-serving-cert: secret "maas-api-e2e-inf-b-76cdbe-serving-cert" not found
Jul 10 18:32:06.991108 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:32:06.991066    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05d97b70-b980-4137-bf28-e93461661f25-maas-api-tls podName:05d97b70-b980-4137-bf28-e93461661f25 nodeName:}" failed. No retries permitted until 2026-07-10 18:32:07.491045187 +0000 UTC m=+1920.169312748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/05d97b70-b980-4137-bf28-e93461661f25-maas-api-tls") pod "maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5" (UID: "05d97b70-b980-4137-bf28-e93461661f25") : secret "maas-api-e2e-inf-b-76cdbe-serving-cert" not found
Jul 10 18:32:06.991609 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:06.991591    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05d97b70-b980-4137-bf28-e93461661f25-openshift-service-ca\") pod \"maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5\" (UID: \"05d97b70-b980-4137-bf28-e93461661f25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:07.003237 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:07.003201    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zndv5\" (UniqueName: \"kubernetes.io/projected/05d97b70-b980-4137-bf28-e93461661f25-kube-api-access-zndv5\") pod \"maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5\" (UID: \"05d97b70-b980-4137-bf28-e93461661f25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:07.183996 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:07.183963    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:32:07.275643 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:07.275610    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:07.352411 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:07.352373    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:07.449448 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:07.449411    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:07.495500 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:07.495459    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05d97b70-b980-4137-bf28-e93461661f25-maas-api-tls\") pod \"maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5\" (UID: \"05d97b70-b980-4137-bf28-e93461661f25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:07.498138 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:07.498110    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05d97b70-b980-4137-bf28-e93461661f25-maas-api-tls\") pod \"maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5\" (UID: \"05d97b70-b980-4137-bf28-e93461661f25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:07.721493 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:07.721397    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:07.875979 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:07.875931    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"]
Jul 10 18:32:07.879880 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:32:07.879844    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d97b70_b980_4137_bf28_e93461661f25.slice/crio-29da5fa8f3b1cf9e41670181bc1f15b1a28c3b8e7b661e039fa56a267865f7e0 WatchSource:0}: Error finding container 29da5fa8f3b1cf9e41670181bc1f15b1a28c3b8e7b661e039fa56a267865f7e0: Status 404 returned error can't find the container with id 29da5fa8f3b1cf9e41670181bc1f15b1a28c3b8e7b661e039fa56a267865f7e0
Jul 10 18:32:08.215738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:08.215699    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5" event={"ID":"05d97b70-b980-4137-bf28-e93461661f25","Type":"ContainerStarted","Data":"29da5fa8f3b1cf9e41670181bc1f15b1a28c3b8e7b661e039fa56a267865f7e0"}
Jul 10 18:32:09.222803 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:09.222767    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5" event={"ID":"05d97b70-b980-4137-bf28-e93461661f25","Type":"ContainerStarted","Data":"84d749cac83c5f81352d3ff7a43ded95d0d309103142e39ef2387afa189d47a7"}
Jul 10 18:32:09.223213 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:09.222887    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:09.241415 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:09.241364    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5" podStartSLOduration=2.811962703 podStartE2EDuration="3.241346026s" totalImagesPullingTime="429.383323ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:32:09.240260851 +0000 UTC m=+1921.918528430" watchObservedRunningTime="2026-07-10 18:32:09.241346026 +0000 UTC m=+1921.919613626"
Jul 10 18:32:11.207578 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:11.207547    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:12.849578 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:12.849546    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:15.234285 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:15.234254    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:32:21.176820 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:21.176779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:21.273347 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:21.273299    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:28.156477 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:28.156434    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:28.269045 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:28.269012    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:32:39.566839 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:32:39.566799    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:19.861153 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:19.861114    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:20.879348 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:20.879274    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:21.045527 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:21.045467    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:21.417855 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:21.417815    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:21.520850 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:21.520812    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:21.618092 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:21.618061    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:21.750095 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:21.749991    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"]
Jul 10 18:33:21.750679 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:21.750640    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8" podUID="9faa2bb5-ba09-4534-a21e-994b82cc330f" containerName="maas-api" containerID="cri-o://3d4f8f93e314e361d24203568b702353441f0650d1d33a9655f6f22bea76fc69" gracePeriod=30
Jul 10 18:33:21.784569 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:21.784524    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:33:22.212571 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.212531    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:33:22.368883 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.368792    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9faa2bb5-ba09-4534-a21e-994b82cc330f-openshift-service-ca\") pod \"9faa2bb5-ba09-4534-a21e-994b82cc330f\" (UID: \"9faa2bb5-ba09-4534-a21e-994b82cc330f\") "
Jul 10 18:33:22.368883 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.368852    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlbvd\" (UniqueName: \"kubernetes.io/projected/9faa2bb5-ba09-4534-a21e-994b82cc330f-kube-api-access-mlbvd\") pod \"9faa2bb5-ba09-4534-a21e-994b82cc330f\" (UID: \"9faa2bb5-ba09-4534-a21e-994b82cc330f\") "
Jul 10 18:33:22.369121 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.368899    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9faa2bb5-ba09-4534-a21e-994b82cc330f-maas-api-tls\") pod \"9faa2bb5-ba09-4534-a21e-994b82cc330f\" (UID: \"9faa2bb5-ba09-4534-a21e-994b82cc330f\") "
Jul 10 18:33:22.369186 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.369153    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9faa2bb5-ba09-4534-a21e-994b82cc330f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9faa2bb5-ba09-4534-a21e-994b82cc330f" (UID: "9faa2bb5-ba09-4534-a21e-994b82cc330f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:33:22.371132 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.371103    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9faa2bb5-ba09-4534-a21e-994b82cc330f-kube-api-access-mlbvd" (OuterVolumeSpecName: "kube-api-access-mlbvd") pod "9faa2bb5-ba09-4534-a21e-994b82cc330f" (UID: "9faa2bb5-ba09-4534-a21e-994b82cc330f"). InnerVolumeSpecName "kube-api-access-mlbvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:33:22.371132 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.371115    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9faa2bb5-ba09-4534-a21e-994b82cc330f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9faa2bb5-ba09-4534-a21e-994b82cc330f" (UID: "9faa2bb5-ba09-4534-a21e-994b82cc330f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:33:22.469881 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.469839    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9faa2bb5-ba09-4534-a21e-994b82cc330f-maas-api-tls\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:33:22.469881 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.469880    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9faa2bb5-ba09-4534-a21e-994b82cc330f-openshift-service-ca\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:33:22.470147 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.469895    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlbvd\" (UniqueName: \"kubernetes.io/projected/9faa2bb5-ba09-4534-a21e-994b82cc330f-kube-api-access-mlbvd\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:33:22.598931 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.598891    2569 generic.go:356] "Generic (PLEG): container finished" podID="9faa2bb5-ba09-4534-a21e-994b82cc330f" containerID="3d4f8f93e314e361d24203568b702353441f0650d1d33a9655f6f22bea76fc69" exitCode=0
Jul 10 18:33:22.599181 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.598943    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"
Jul 10 18:33:22.599181 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.598982    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8" event={"ID":"9faa2bb5-ba09-4534-a21e-994b82cc330f","Type":"ContainerDied","Data":"3d4f8f93e314e361d24203568b702353441f0650d1d33a9655f6f22bea76fc69"}
Jul 10 18:33:22.599181 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.599046    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8" event={"ID":"9faa2bb5-ba09-4534-a21e-994b82cc330f","Type":"ContainerDied","Data":"bfb295faaf2f4b8afef69a0506d236c2647a84cb71914cb78f4d57d116e3573c"}
Jul 10 18:33:22.599181 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.599076    2569 scope.go:117] "RemoveContainer" containerID="3d4f8f93e314e361d24203568b702353441f0650d1d33a9655f6f22bea76fc69"
Jul 10 18:33:22.609348 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.609254    2569 scope.go:117] "RemoveContainer" containerID="3d4f8f93e314e361d24203568b702353441f0650d1d33a9655f6f22bea76fc69"
Jul 10 18:33:22.609713 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:33:22.609684    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d4f8f93e314e361d24203568b702353441f0650d1d33a9655f6f22bea76fc69\": container with ID starting with 3d4f8f93e314e361d24203568b702353441f0650d1d33a9655f6f22bea76fc69 not found: ID does not exist" containerID="3d4f8f93e314e361d24203568b702353441f0650d1d33a9655f6f22bea76fc69"
Jul 10 18:33:22.609820 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.609727    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d4f8f93e314e361d24203568b702353441f0650d1d33a9655f6f22bea76fc69"} err="failed to get container status \"3d4f8f93e314e361d24203568b702353441f0650d1d33a9655f6f22bea76fc69\": rpc error: code = NotFound desc = could not find container \"3d4f8f93e314e361d24203568b702353441f0650d1d33a9655f6f22bea76fc69\": container with ID starting with 3d4f8f93e314e361d24203568b702353441f0650d1d33a9655f6f22bea76fc69 not found: ID does not exist"
Jul 10 18:33:22.621210 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.621126    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"]
Jul 10 18:33:22.627620 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:22.627586    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8"]
Jul 10 18:33:24.013551 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:24.013514    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9faa2bb5-ba09-4534-a21e-994b82cc330f" path="/var/lib/kubelet/pods/9faa2bb5-ba09-4534-a21e-994b82cc330f/volumes"
Jul 10 18:33:25.179190 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:25.179144    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ea8030-5c759d7d6b-6fsp8" podUID="9faa2bb5-ba09-4534-a21e-994b82cc330f" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.55:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 10 18:33:26.491537 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:33:26.491504    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:03.326007 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:03.325956    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:03.608610 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:03.608524    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:03.976720 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:03.976634    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:04.077513 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:04.077480    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:04.499270 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:04.499229    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:04.605521 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:04.605486    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:04.705995 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:04.705962    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:04.864105 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:04.864066    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"]
Jul 10 18:34:04.864408 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:04.864371    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5" podUID="05d97b70-b980-4137-bf28-e93461661f25" containerName="maas-api" containerID="cri-o://84d749cac83c5f81352d3ff7a43ded95d0d309103142e39ef2387afa189d47a7" gracePeriod=30
Jul 10 18:34:04.903871 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:04.903840    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:05.126709 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.126626    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:34:05.249573 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.249538    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05d97b70-b980-4137-bf28-e93461661f25-openshift-service-ca\") pod \"05d97b70-b980-4137-bf28-e93461661f25\" (UID: \"05d97b70-b980-4137-bf28-e93461661f25\") "
Jul 10 18:34:05.249769 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.249593    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zndv5\" (UniqueName: \"kubernetes.io/projected/05d97b70-b980-4137-bf28-e93461661f25-kube-api-access-zndv5\") pod \"05d97b70-b980-4137-bf28-e93461661f25\" (UID: \"05d97b70-b980-4137-bf28-e93461661f25\") "
Jul 10 18:34:05.249769 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.249641    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05d97b70-b980-4137-bf28-e93461661f25-maas-api-tls\") pod \"05d97b70-b980-4137-bf28-e93461661f25\" (UID: \"05d97b70-b980-4137-bf28-e93461661f25\") "
Jul 10 18:34:05.250036 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.250007    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05d97b70-b980-4137-bf28-e93461661f25-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "05d97b70-b980-4137-bf28-e93461661f25" (UID: "05d97b70-b980-4137-bf28-e93461661f25"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:34:05.251970 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.251940    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05d97b70-b980-4137-bf28-e93461661f25-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "05d97b70-b980-4137-bf28-e93461661f25" (UID: "05d97b70-b980-4137-bf28-e93461661f25"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:34:05.251970 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.251953    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05d97b70-b980-4137-bf28-e93461661f25-kube-api-access-zndv5" (OuterVolumeSpecName: "kube-api-access-zndv5") pod "05d97b70-b980-4137-bf28-e93461661f25" (UID: "05d97b70-b980-4137-bf28-e93461661f25"). InnerVolumeSpecName "kube-api-access-zndv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:34:05.351172 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.351133    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05d97b70-b980-4137-bf28-e93461661f25-maas-api-tls\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:34:05.351172 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.351165    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05d97b70-b980-4137-bf28-e93461661f25-openshift-service-ca\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:34:05.351172 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.351174    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zndv5\" (UniqueName: \"kubernetes.io/projected/05d97b70-b980-4137-bf28-e93461661f25-kube-api-access-zndv5\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:34:05.806771 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.806736    2569 generic.go:356] "Generic (PLEG): container finished" podID="05d97b70-b980-4137-bf28-e93461661f25" containerID="84d749cac83c5f81352d3ff7a43ded95d0d309103142e39ef2387afa189d47a7" exitCode=0
Jul 10 18:34:05.807185 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.806778    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"
Jul 10 18:34:05.807185 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.806826    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5" event={"ID":"05d97b70-b980-4137-bf28-e93461661f25","Type":"ContainerDied","Data":"84d749cac83c5f81352d3ff7a43ded95d0d309103142e39ef2387afa189d47a7"}
Jul 10 18:34:05.807185 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.806877    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5" event={"ID":"05d97b70-b980-4137-bf28-e93461661f25","Type":"ContainerDied","Data":"29da5fa8f3b1cf9e41670181bc1f15b1a28c3b8e7b661e039fa56a267865f7e0"}
Jul 10 18:34:05.807185 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.806901    2569 scope.go:117] "RemoveContainer" containerID="84d749cac83c5f81352d3ff7a43ded95d0d309103142e39ef2387afa189d47a7"
Jul 10 18:34:05.816795 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.816774    2569 scope.go:117] "RemoveContainer" containerID="84d749cac83c5f81352d3ff7a43ded95d0d309103142e39ef2387afa189d47a7"
Jul 10 18:34:05.817283 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:34:05.817256    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84d749cac83c5f81352d3ff7a43ded95d0d309103142e39ef2387afa189d47a7\": container with ID starting with 84d749cac83c5f81352d3ff7a43ded95d0d309103142e39ef2387afa189d47a7 not found: ID does not exist" containerID="84d749cac83c5f81352d3ff7a43ded95d0d309103142e39ef2387afa189d47a7"
Jul 10 18:34:05.817410 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.817289    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84d749cac83c5f81352d3ff7a43ded95d0d309103142e39ef2387afa189d47a7"} err="failed to get container status \"84d749cac83c5f81352d3ff7a43ded95d0d309103142e39ef2387afa189d47a7\": rpc error: code = NotFound desc = could not find container \"84d749cac83c5f81352d3ff7a43ded95d0d309103142e39ef2387afa189d47a7\": container with ID starting with 84d749cac83c5f81352d3ff7a43ded95d0d309103142e39ef2387afa189d47a7 not found: ID does not exist"
Jul 10 18:34:05.836993 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.836952    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"]
Jul 10 18:34:05.838563 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:05.838533    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76cdbe-6c675cf649-gxst5"]
Jul 10 18:34:06.013833 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:06.013796    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05d97b70-b980-4137-bf28-e93461661f25" path="/var/lib/kubelet/pods/05d97b70-b980-4137-bf28-e93461661f25/volumes"
Jul 10 18:34:10.241895 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:10.241852    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:10.342615 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:10.342577    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:10.492272 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:10.492172    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:11.072270 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:11.072219    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:11.187970 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:11.187920    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:11.445633 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:11.445538    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:11.596863 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:11.596823    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:14.476075 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.476040    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:14.554896 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.554861    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"]
Jul 10 18:34:14.555250 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.555236    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9faa2bb5-ba09-4534-a21e-994b82cc330f" containerName="maas-api"
Jul 10 18:34:14.555294 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.555252    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9faa2bb5-ba09-4534-a21e-994b82cc330f" containerName="maas-api"
Jul 10 18:34:14.555294 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.555273    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05d97b70-b980-4137-bf28-e93461661f25" containerName="maas-api"
Jul 10 18:34:14.555294 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.555279    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="05d97b70-b980-4137-bf28-e93461661f25" containerName="maas-api"
Jul 10 18:34:14.555406 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.555384    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9faa2bb5-ba09-4534-a21e-994b82cc330f" containerName="maas-api"
Jul 10 18:34:14.555406 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.555394    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="05d97b70-b980-4137-bf28-e93461661f25" containerName="maas-api"
Jul 10 18:34:14.558483 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.558460    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:14.560818 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.560793    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-487078-serving-cert\""
Jul 10 18:34:14.560943 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.560906    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vkbgh\""
Jul 10 18:34:14.570561 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.570515    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"]
Jul 10 18:34:14.571032 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.571008    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:14.636985 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.636937    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/685a2fc6-2b96-4bb6-a08f-63e6a578647c-maas-api-tls\") pod \"maas-api-e2e-api-a-487078-5996fff4f4-whwdf\" (UID: \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:14.637177 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.637012    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf6qh\" (UniqueName: \"kubernetes.io/projected/685a2fc6-2b96-4bb6-a08f-63e6a578647c-kube-api-access-gf6qh\") pod \"maas-api-e2e-api-a-487078-5996fff4f4-whwdf\" (UID: \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:14.637177 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.637066    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/685a2fc6-2b96-4bb6-a08f-63e6a578647c-openshift-service-ca\") pod \"maas-api-e2e-api-a-487078-5996fff4f4-whwdf\" (UID: \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:14.669778 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.669745    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:14.738224 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.738118    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/685a2fc6-2b96-4bb6-a08f-63e6a578647c-maas-api-tls\") pod \"maas-api-e2e-api-a-487078-5996fff4f4-whwdf\" (UID: \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:14.738224 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.738176    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf6qh\" (UniqueName: \"kubernetes.io/projected/685a2fc6-2b96-4bb6-a08f-63e6a578647c-kube-api-access-gf6qh\") pod \"maas-api-e2e-api-a-487078-5996fff4f4-whwdf\" (UID: \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:14.738502 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:34:14.738278    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-487078-serving-cert: secret "maas-api-e2e-api-a-487078-serving-cert" not found
Jul 10 18:34:14.738502 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.738300    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/685a2fc6-2b96-4bb6-a08f-63e6a578647c-openshift-service-ca\") pod \"maas-api-e2e-api-a-487078-5996fff4f4-whwdf\" (UID: \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:14.738502 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:34:14.738370    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/685a2fc6-2b96-4bb6-a08f-63e6a578647c-maas-api-tls podName:685a2fc6-2b96-4bb6-a08f-63e6a578647c nodeName:}" failed. No retries permitted until 2026-07-10 18:34:15.238350619 +0000 UTC m=+2047.916618178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/685a2fc6-2b96-4bb6-a08f-63e6a578647c-maas-api-tls") pod "maas-api-e2e-api-a-487078-5996fff4f4-whwdf" (UID: "685a2fc6-2b96-4bb6-a08f-63e6a578647c") : secret "maas-api-e2e-api-a-487078-serving-cert" not found
Jul 10 18:34:14.738981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.738956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/685a2fc6-2b96-4bb6-a08f-63e6a578647c-openshift-service-ca\") pod \"maas-api-e2e-api-a-487078-5996fff4f4-whwdf\" (UID: \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:14.747587 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.747548    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf6qh\" (UniqueName: \"kubernetes.io/projected/685a2fc6-2b96-4bb6-a08f-63e6a578647c-kube-api-access-gf6qh\") pod \"maas-api-e2e-api-a-487078-5996fff4f4-whwdf\" (UID: \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:14.967182 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:14.967126    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:15.129445 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:15.129390    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:15.235180 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:15.235140    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:15.244398 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:15.244357    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/685a2fc6-2b96-4bb6-a08f-63e6a578647c-maas-api-tls\") pod \"maas-api-e2e-api-a-487078-5996fff4f4-whwdf\" (UID: \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:15.246968 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:15.246931    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/685a2fc6-2b96-4bb6-a08f-63e6a578647c-maas-api-tls\") pod \"maas-api-e2e-api-a-487078-5996fff4f4-whwdf\" (UID: \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:15.470678 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:15.470570    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:15.622774 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:15.622743    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"]
Jul 10 18:34:15.625243 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:34:15.625211    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685a2fc6_2b96_4bb6_a08f_63e6a578647c.slice/crio-3b7a1eb4ace657787424b8c37f5737768b16b16b9685b5a3dbca31bf9a0149a9 WatchSource:0}: Error finding container 3b7a1eb4ace657787424b8c37f5737768b16b16b9685b5a3dbca31bf9a0149a9: Status 404 returned error can't find the container with id 3b7a1eb4ace657787424b8c37f5737768b16b16b9685b5a3dbca31bf9a0149a9
Jul 10 18:34:15.854612 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:15.854576    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf" event={"ID":"685a2fc6-2b96-4bb6-a08f-63e6a578647c","Type":"ContainerStarted","Data":"3b7a1eb4ace657787424b8c37f5737768b16b16b9685b5a3dbca31bf9a0149a9"}
Jul 10 18:34:16.861236 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:16.861195    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf" event={"ID":"685a2fc6-2b96-4bb6-a08f-63e6a578647c","Type":"ContainerStarted","Data":"219c54eae30991b80c3d2a6c21c3276548b40c73d6ce8713b8219fd4de582755"}
Jul 10 18:34:16.861745 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:16.861269    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:16.877211 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:16.877154    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf" podStartSLOduration=2.424609676 podStartE2EDuration="2.877134214s" totalImagesPullingTime="452.524538ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:16.876449836 +0000 UTC m=+2049.554717416" watchObservedRunningTime="2026-07-10 18:34:16.877134214 +0000 UTC m=+2049.555401790"
Jul 10 18:34:18.961775 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:18.961737    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:19.416935 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:19.416894    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:19.748271 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:19.748170    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:20.763265 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:20.763230    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:22.626187 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:22.626149    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:22.725338 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:22.725279    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:22.847737 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:22.847700    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"]
Jul 10 18:34:22.852102 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:22.852071    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:22.854660 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:22.854630    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-c93b3e-serving-cert\""
Jul 10 18:34:22.862616 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:22.862424    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"]
Jul 10 18:34:22.872485 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:22.872453    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:22.892532 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:22.892427    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:23.016574 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.016534    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59ced675-3e5f-4714-a0ae-5e3d3e753e16-openshift-service-ca\") pod \"maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr\" (UID: \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:23.016761 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.016590    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d96dd\" (UniqueName: \"kubernetes.io/projected/59ced675-3e5f-4714-a0ae-5e3d3e753e16-kube-api-access-d96dd\") pod \"maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr\" (UID: \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:23.016761 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.016629    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59ced675-3e5f-4714-a0ae-5e3d3e753e16-maas-api-tls\") pod \"maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr\" (UID: \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:23.046428 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.046397    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:23.118129 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.118090    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d96dd\" (UniqueName: \"kubernetes.io/projected/59ced675-3e5f-4714-a0ae-5e3d3e753e16-kube-api-access-d96dd\") pod \"maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr\" (UID: \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:23.118129 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.118132    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59ced675-3e5f-4714-a0ae-5e3d3e753e16-maas-api-tls\") pod \"maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr\" (UID: \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:23.118381 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.118187    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59ced675-3e5f-4714-a0ae-5e3d3e753e16-openshift-service-ca\") pod \"maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr\" (UID: \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:23.118959 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.118937    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59ced675-3e5f-4714-a0ae-5e3d3e753e16-openshift-service-ca\") pod \"maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr\" (UID: \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:23.120969 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.120937    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59ced675-3e5f-4714-a0ae-5e3d3e753e16-maas-api-tls\") pod \"maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr\" (UID: \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:23.127084 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.127044    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d96dd\" (UniqueName: \"kubernetes.io/projected/59ced675-3e5f-4714-a0ae-5e3d3e753e16-kube-api-access-d96dd\") pod \"maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr\" (UID: \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:23.166086 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.165983    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:23.324167 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.324136    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"]
Jul 10 18:34:23.326361 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:34:23.326328    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ced675_3e5f_4714_a0ae_5e3d3e753e16.slice/crio-d7293beb4c56294e2dea0c44d2a4a10550614fe885f42d673467ad8faa788182 WatchSource:0}: Error finding container d7293beb4c56294e2dea0c44d2a4a10550614fe885f42d673467ad8faa788182: Status 404 returned error can't find the container with id d7293beb4c56294e2dea0c44d2a4a10550614fe885f42d673467ad8faa788182
Jul 10 18:34:23.379386 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.379354    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:23.480389 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.480273    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:23.899672 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:23.899635    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr" event={"ID":"59ced675-3e5f-4714-a0ae-5e3d3e753e16","Type":"ContainerStarted","Data":"d7293beb4c56294e2dea0c44d2a4a10550614fe885f42d673467ad8faa788182"}
Jul 10 18:34:24.906516 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:24.906473    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr" event={"ID":"59ced675-3e5f-4714-a0ae-5e3d3e753e16","Type":"ContainerStarted","Data":"0263cafa13697553bbde2ff0722042fb0894012ca27231d72e7a742c4ef76ead"}
Jul 10 18:34:24.906941 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:24.906551    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:24.943382 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:24.943284    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr" podStartSLOduration=2.203870737 podStartE2EDuration="2.943266591s" totalImagesPullingTime="739.395854ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:24.942970745 +0000 UTC m=+2057.621238327" watchObservedRunningTime="2026-07-10 18:34:24.943266591 +0000 UTC m=+2057.621534167"
Jul 10 18:34:27.073212 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:27.073179    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:27.824159 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:27.824122    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:27.925586 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:27.925553    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:30.918461 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:30.918376    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:35.067887 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:35.067853    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:35.490611 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:35.490507    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:35.702263 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:35.702224    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:35.802631 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:35.802596    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:35.984945 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:35.984907    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"]
Jul 10 18:34:35.985467 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:35.985432    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf" podUID="685a2fc6-2b96-4bb6-a08f-63e6a578647c" containerName="maas-api" containerID="cri-o://219c54eae30991b80c3d2a6c21c3276548b40c73d6ce8713b8219fd4de582755" gracePeriod=30
Jul 10 18:34:36.022921 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.022884    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:36.250618 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.250586    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:36.345963 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.345922    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf6qh\" (UniqueName: \"kubernetes.io/projected/685a2fc6-2b96-4bb6-a08f-63e6a578647c-kube-api-access-gf6qh\") pod \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\" (UID: \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\") "
Jul 10 18:34:36.346157 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.345976    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/685a2fc6-2b96-4bb6-a08f-63e6a578647c-openshift-service-ca\") pod \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\" (UID: \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\") "
Jul 10 18:34:36.346157 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.346025    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/685a2fc6-2b96-4bb6-a08f-63e6a578647c-maas-api-tls\") pod \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\" (UID: \"685a2fc6-2b96-4bb6-a08f-63e6a578647c\") "
Jul 10 18:34:36.346423 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.346391    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/685a2fc6-2b96-4bb6-a08f-63e6a578647c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "685a2fc6-2b96-4bb6-a08f-63e6a578647c" (UID: "685a2fc6-2b96-4bb6-a08f-63e6a578647c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:34:36.348199 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.348165    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/685a2fc6-2b96-4bb6-a08f-63e6a578647c-kube-api-access-gf6qh" (OuterVolumeSpecName: "kube-api-access-gf6qh") pod "685a2fc6-2b96-4bb6-a08f-63e6a578647c" (UID: "685a2fc6-2b96-4bb6-a08f-63e6a578647c"). InnerVolumeSpecName "kube-api-access-gf6qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:34:36.348305 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.348201    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685a2fc6-2b96-4bb6-a08f-63e6a578647c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "685a2fc6-2b96-4bb6-a08f-63e6a578647c" (UID: "685a2fc6-2b96-4bb6-a08f-63e6a578647c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:34:36.446936 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.446824    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/685a2fc6-2b96-4bb6-a08f-63e6a578647c-maas-api-tls\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:34:36.446936 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.446858    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf6qh\" (UniqueName: \"kubernetes.io/projected/685a2fc6-2b96-4bb6-a08f-63e6a578647c-kube-api-access-gf6qh\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:34:36.446936 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.446868    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/685a2fc6-2b96-4bb6-a08f-63e6a578647c-openshift-service-ca\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:34:36.968286 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.968248    2569 generic.go:356] "Generic (PLEG): container finished" podID="685a2fc6-2b96-4bb6-a08f-63e6a578647c" containerID="219c54eae30991b80c3d2a6c21c3276548b40c73d6ce8713b8219fd4de582755" exitCode=0
Jul 10 18:34:36.968493 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.968296    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"
Jul 10 18:34:36.968493 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.968338    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf" event={"ID":"685a2fc6-2b96-4bb6-a08f-63e6a578647c","Type":"ContainerDied","Data":"219c54eae30991b80c3d2a6c21c3276548b40c73d6ce8713b8219fd4de582755"}
Jul 10 18:34:36.968493 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.968399    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf" event={"ID":"685a2fc6-2b96-4bb6-a08f-63e6a578647c","Type":"ContainerDied","Data":"3b7a1eb4ace657787424b8c37f5737768b16b16b9685b5a3dbca31bf9a0149a9"}
Jul 10 18:34:36.968493 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.968430    2569 scope.go:117] "RemoveContainer" containerID="219c54eae30991b80c3d2a6c21c3276548b40c73d6ce8713b8219fd4de582755"
Jul 10 18:34:36.977658 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.977634    2569 scope.go:117] "RemoveContainer" containerID="219c54eae30991b80c3d2a6c21c3276548b40c73d6ce8713b8219fd4de582755"
Jul 10 18:34:36.977992 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:34:36.977972    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"219c54eae30991b80c3d2a6c21c3276548b40c73d6ce8713b8219fd4de582755\": container with ID starting with 219c54eae30991b80c3d2a6c21c3276548b40c73d6ce8713b8219fd4de582755 not found: ID does not exist" containerID="219c54eae30991b80c3d2a6c21c3276548b40c73d6ce8713b8219fd4de582755"
Jul 10 18:34:36.978038 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.978003    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"219c54eae30991b80c3d2a6c21c3276548b40c73d6ce8713b8219fd4de582755"} err="failed to get container status \"219c54eae30991b80c3d2a6c21c3276548b40c73d6ce8713b8219fd4de582755\": rpc error: code = NotFound desc = could not find container \"219c54eae30991b80c3d2a6c21c3276548b40c73d6ce8713b8219fd4de582755\": container with ID starting with 219c54eae30991b80c3d2a6c21c3276548b40c73d6ce8713b8219fd4de582755 not found: ID does not exist"
Jul 10 18:34:36.990751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.990717    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"]
Jul 10 18:34:36.993423 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:36.993385    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-487078-5996fff4f4-whwdf"]
Jul 10 18:34:38.014048 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:38.014007    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="685a2fc6-2b96-4bb6-a08f-63e6a578647c" path="/var/lib/kubelet/pods/685a2fc6-2b96-4bb6-a08f-63e6a578647c/volumes"
Jul 10 18:34:41.393509 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:41.393468    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:41.494032 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:41.493990    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:41.654037 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:41.653938    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:41.918331 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:41.918225    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:42.072066 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:42.072028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:42.446235 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:42.446199    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:42.550261 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:42.550222    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:42.646370 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:42.646328    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:42.791328 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:42.791275    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"]
Jul 10 18:34:42.791829 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:42.791763    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr" podUID="59ced675-3e5f-4714-a0ae-5e3d3e753e16" containerName="maas-api" containerID="cri-o://0263cafa13697553bbde2ff0722042fb0894012ca27231d72e7a742c4ef76ead" gracePeriod=30
Jul 10 18:34:42.820139 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:42.820112    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:43.001507 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:43.001472    2569 generic.go:356] "Generic (PLEG): container finished" podID="59ced675-3e5f-4714-a0ae-5e3d3e753e16" containerID="0263cafa13697553bbde2ff0722042fb0894012ca27231d72e7a742c4ef76ead" exitCode=0
Jul 10 18:34:43.001706 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:43.001552    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr" event={"ID":"59ced675-3e5f-4714-a0ae-5e3d3e753e16","Type":"ContainerDied","Data":"0263cafa13697553bbde2ff0722042fb0894012ca27231d72e7a742c4ef76ead"}
Jul 10 18:34:43.046548 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:43.046489    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:43.110397 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:43.110354    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59ced675-3e5f-4714-a0ae-5e3d3e753e16-maas-api-tls\") pod \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\" (UID: \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\") "
Jul 10 18:34:43.110566 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:43.110418    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59ced675-3e5f-4714-a0ae-5e3d3e753e16-openshift-service-ca\") pod \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\" (UID: \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\") "
Jul 10 18:34:43.110566 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:43.110475    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d96dd\" (UniqueName: \"kubernetes.io/projected/59ced675-3e5f-4714-a0ae-5e3d3e753e16-kube-api-access-d96dd\") pod \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\" (UID: \"59ced675-3e5f-4714-a0ae-5e3d3e753e16\") "
Jul 10 18:34:43.110832 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:43.110801    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59ced675-3e5f-4714-a0ae-5e3d3e753e16-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "59ced675-3e5f-4714-a0ae-5e3d3e753e16" (UID: "59ced675-3e5f-4714-a0ae-5e3d3e753e16"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:34:43.112562 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:43.112531    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59ced675-3e5f-4714-a0ae-5e3d3e753e16-kube-api-access-d96dd" (OuterVolumeSpecName: "kube-api-access-d96dd") pod "59ced675-3e5f-4714-a0ae-5e3d3e753e16" (UID: "59ced675-3e5f-4714-a0ae-5e3d3e753e16"). InnerVolumeSpecName "kube-api-access-d96dd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:34:43.112562 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:43.112556    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59ced675-3e5f-4714-a0ae-5e3d3e753e16-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "59ced675-3e5f-4714-a0ae-5e3d3e753e16" (UID: "59ced675-3e5f-4714-a0ae-5e3d3e753e16"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:34:43.211451 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:43.211408    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59ced675-3e5f-4714-a0ae-5e3d3e753e16-maas-api-tls\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:34:43.211451 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:43.211447    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59ced675-3e5f-4714-a0ae-5e3d3e753e16-openshift-service-ca\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:34:43.211451 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:43.211459    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d96dd\" (UniqueName: \"kubernetes.io/projected/59ced675-3e5f-4714-a0ae-5e3d3e753e16-kube-api-access-d96dd\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:34:44.007569 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:44.007543    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"
Jul 10 18:34:44.012967 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:44.012938    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr" event={"ID":"59ced675-3e5f-4714-a0ae-5e3d3e753e16","Type":"ContainerDied","Data":"d7293beb4c56294e2dea0c44d2a4a10550614fe885f42d673467ad8faa788182"}
Jul 10 18:34:44.013098 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:44.012983    2569 scope.go:117] "RemoveContainer" containerID="0263cafa13697553bbde2ff0722042fb0894012ca27231d72e7a742c4ef76ead"
Jul 10 18:34:44.032686 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:44.032660    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"]
Jul 10 18:34:44.038615 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:44.038591    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c93b3e-c49f8868-dcdfr"]
Jul 10 18:34:46.013919 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:46.013882    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59ced675-3e5f-4714-a0ae-5e3d3e753e16" path="/var/lib/kubelet/pods/59ced675-3e5f-4714-a0ae-5e3d3e753e16/volumes"
Jul 10 18:34:48.642791 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:48.642744    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:48.741560 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:48.741520    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:48.907488 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:48.907398    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:49.123799 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:49.123757    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:49.450382 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:49.450333    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:49.742276 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:49.742175    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:49.837817 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:49.837773    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:52.727326 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.727262    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:52.811396 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.811352    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"]
Jul 10 18:34:52.811913 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.811892    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685a2fc6-2b96-4bb6-a08f-63e6a578647c" containerName="maas-api"
Jul 10 18:34:52.811981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.811919    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="685a2fc6-2b96-4bb6-a08f-63e6a578647c" containerName="maas-api"
Jul 10 18:34:52.811981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.811942    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59ced675-3e5f-4714-a0ae-5e3d3e753e16" containerName="maas-api"
Jul 10 18:34:52.811981 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.811951    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="59ced675-3e5f-4714-a0ae-5e3d3e753e16" containerName="maas-api"
Jul 10 18:34:52.812101 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.812086    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="59ced675-3e5f-4714-a0ae-5e3d3e753e16" containerName="maas-api"
Jul 10 18:34:52.812145 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.812108    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="685a2fc6-2b96-4bb6-a08f-63e6a578647c" containerName="maas-api"
Jul 10 18:34:52.817026 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.816994    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:52.819668 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.819624    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-48683a-serving-cert\""
Jul 10 18:34:52.819850 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.819721    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vkbgh\""
Jul 10 18:34:52.824088 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.824055    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"]
Jul 10 18:34:52.834442 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.834405    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:52.902037 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.901996    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfq4s\" (UniqueName: \"kubernetes.io/projected/624c7b43-ddfa-4a78-96fd-f686dc0c712e-kube-api-access-vfq4s\") pod \"maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:52.902241 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.902044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/624c7b43-ddfa-4a78-96fd-f686dc0c712e-maas-api-tls\") pod \"maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:52.902241 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.902075    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/624c7b43-ddfa-4a78-96fd-f686dc0c712e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:52.942160 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:52.942125    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:53.003398 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:53.003360    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfq4s\" (UniqueName: \"kubernetes.io/projected/624c7b43-ddfa-4a78-96fd-f686dc0c712e-kube-api-access-vfq4s\") pod \"maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:53.003578 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:53.003402    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/624c7b43-ddfa-4a78-96fd-f686dc0c712e-maas-api-tls\") pod \"maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:53.003578 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:53.003439    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/624c7b43-ddfa-4a78-96fd-f686dc0c712e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:53.003651 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:34:53.003588    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-serving-cert: secret "maas-api-e2e-shared-a-48683a-serving-cert" not found
Jul 10 18:34:53.003710 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:34:53.003698    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/624c7b43-ddfa-4a78-96fd-f686dc0c712e-maas-api-tls podName:624c7b43-ddfa-4a78-96fd-f686dc0c712e nodeName:}" failed. No retries permitted until 2026-07-10 18:34:53.503674563 +0000 UTC m=+2086.181942125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/624c7b43-ddfa-4a78-96fd-f686dc0c712e-maas-api-tls") pod "maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s" (UID: "624c7b43-ddfa-4a78-96fd-f686dc0c712e") : secret "maas-api-e2e-shared-a-48683a-serving-cert" not found
Jul 10 18:34:53.004066 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:53.004047    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/624c7b43-ddfa-4a78-96fd-f686dc0c712e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:53.011758 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:53.011726    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfq4s\" (UniqueName: \"kubernetes.io/projected/624c7b43-ddfa-4a78-96fd-f686dc0c712e-kube-api-access-vfq4s\") pod \"maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:53.297044 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:53.296958    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:53.398122 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:53.398091    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:53.508403 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:53.508355    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/624c7b43-ddfa-4a78-96fd-f686dc0c712e-maas-api-tls\") pod \"maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:53.508566 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:34:53.508506    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-serving-cert: secret "maas-api-e2e-shared-a-48683a-serving-cert" not found
Jul 10 18:34:53.508625 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:34:53.508579    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/624c7b43-ddfa-4a78-96fd-f686dc0c712e-maas-api-tls podName:624c7b43-ddfa-4a78-96fd-f686dc0c712e nodeName:}" failed. No retries permitted until 2026-07-10 18:34:54.508561603 +0000 UTC m=+2087.186829166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/624c7b43-ddfa-4a78-96fd-f686dc0c712e-maas-api-tls") pod "maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s" (UID: "624c7b43-ddfa-4a78-96fd-f686dc0c712e") : secret "maas-api-e2e-shared-a-48683a-serving-cert" not found
Jul 10 18:34:53.708463 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:53.708371    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:54.519141 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:54.519094    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/624c7b43-ddfa-4a78-96fd-f686dc0c712e-maas-api-tls\") pod \"maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:54.521690 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:54.521658    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/624c7b43-ddfa-4a78-96fd-f686dc0c712e-maas-api-tls\") pod \"maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:54.630552 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:54.630505    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:54.776174 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:54.776145    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"]
Jul 10 18:34:54.778743 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:34:54.778703    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624c7b43_ddfa_4a78_96fd_f686dc0c712e.slice/crio-f331cd80a0f96d918c83b17dc27e7cd4f90fe34a21bc03b797131a57f71e6751 WatchSource:0}: Error finding container f331cd80a0f96d918c83b17dc27e7cd4f90fe34a21bc03b797131a57f71e6751: Status 404 returned error can't find the container with id f331cd80a0f96d918c83b17dc27e7cd4f90fe34a21bc03b797131a57f71e6751
Jul 10 18:34:55.063337 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:55.063216    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s" event={"ID":"624c7b43-ddfa-4a78-96fd-f686dc0c712e","Type":"ContainerStarted","Data":"f331cd80a0f96d918c83b17dc27e7cd4f90fe34a21bc03b797131a57f71e6751"}
Jul 10 18:34:56.069343 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:56.069289    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s" event={"ID":"624c7b43-ddfa-4a78-96fd-f686dc0c712e","Type":"ContainerStarted","Data":"fce3ec9b3f0d4da15846f80b58c5ed2ec34568dd6ff1b3a7f9c206bc0e698740"}
Jul 10 18:34:56.069760 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:56.069432    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:34:56.088815 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:56.088747    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s" podStartSLOduration=3.701390596 podStartE2EDuration="4.08872351s" totalImagesPullingTime="387.332914ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:56.086487841 +0000 UTC m=+2088.764755450" watchObservedRunningTime="2026-07-10 18:34:56.08872351 +0000 UTC m=+2088.766991090"
Jul 10 18:34:57.197620 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:57.197585    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:57.493221 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:57.493101    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:58.134266 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:58.134219    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:34:58.222278 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:34:58.222246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:00.793994 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:00.793961    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:00.877268 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:00.877225    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"]
Jul 10 18:35:00.881540 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:00.881509    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:00.883949 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:00.883923    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-35792e-serving-cert\""
Jul 10 18:35:00.884734 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:00.884709    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:00.896002 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:00.895963    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"]
Jul 10 18:35:00.973657 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:00.973622    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:00.981291 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:00.981258    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae2f15a-1eef-433a-adc7-dd6b644a104c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-35792e-645b55b679-w24pn\" (UID: \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:00.981500 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:00.981395    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae2f15a-1eef-433a-adc7-dd6b644a104c-maas-api-tls\") pod \"maas-api-e2e-shared-b-35792e-645b55b679-w24pn\" (UID: \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:00.981500 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:00.981434    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4mt7\" (UniqueName: \"kubernetes.io/projected/8ae2f15a-1eef-433a-adc7-dd6b644a104c-kube-api-access-p4mt7\") pod \"maas-api-e2e-shared-b-35792e-645b55b679-w24pn\" (UID: \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:01.082348 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:01.082218    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae2f15a-1eef-433a-adc7-dd6b644a104c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-35792e-645b55b679-w24pn\" (UID: \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:01.082348 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:01.082282    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae2f15a-1eef-433a-adc7-dd6b644a104c-maas-api-tls\") pod \"maas-api-e2e-shared-b-35792e-645b55b679-w24pn\" (UID: \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:01.082348 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:01.082306    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4mt7\" (UniqueName: \"kubernetes.io/projected/8ae2f15a-1eef-433a-adc7-dd6b644a104c-kube-api-access-p4mt7\") pod \"maas-api-e2e-shared-b-35792e-645b55b679-w24pn\" (UID: \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:01.082664 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:35:01.082517    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-serving-cert: secret "maas-api-e2e-shared-b-35792e-serving-cert" not found
Jul 10 18:35:01.082664 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:35:01.082632    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ae2f15a-1eef-433a-adc7-dd6b644a104c-maas-api-tls podName:8ae2f15a-1eef-433a-adc7-dd6b644a104c nodeName:}" failed. No retries permitted until 2026-07-10 18:35:01.582609743 +0000 UTC m=+2094.260877314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8ae2f15a-1eef-433a-adc7-dd6b644a104c-maas-api-tls") pod "maas-api-e2e-shared-b-35792e-645b55b679-w24pn" (UID: "8ae2f15a-1eef-433a-adc7-dd6b644a104c") : secret "maas-api-e2e-shared-b-35792e-serving-cert" not found
Jul 10 18:35:01.082984 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:01.082962    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae2f15a-1eef-433a-adc7-dd6b644a104c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-35792e-645b55b679-w24pn\" (UID: \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:01.091615 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:01.091570    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4mt7\" (UniqueName: \"kubernetes.io/projected/8ae2f15a-1eef-433a-adc7-dd6b644a104c-kube-api-access-p4mt7\") pod \"maas-api-e2e-shared-b-35792e-645b55b679-w24pn\" (UID: \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:01.200560 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:01.200498    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:01.461405 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:01.461297    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:01.564086 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:01.564037    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:01.588436 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:01.588396    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae2f15a-1eef-433a-adc7-dd6b644a104c-maas-api-tls\") pod \"maas-api-e2e-shared-b-35792e-645b55b679-w24pn\" (UID: \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:01.590952 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:01.590928    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae2f15a-1eef-433a-adc7-dd6b644a104c-maas-api-tls\") pod \"maas-api-e2e-shared-b-35792e-645b55b679-w24pn\" (UID: \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:01.796772 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:01.796720    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:01.966337 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:01.966290    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"]
Jul 10 18:35:01.968629 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:35:01.968598    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae2f15a_1eef_433a_adc7_dd6b644a104c.slice/crio-3ce14faf49f98145af4c6812a32144bfe45ebf327375d2a3e18317efef1032d1 WatchSource:0}: Error finding container 3ce14faf49f98145af4c6812a32144bfe45ebf327375d2a3e18317efef1032d1: Status 404 returned error can't find the container with id 3ce14faf49f98145af4c6812a32144bfe45ebf327375d2a3e18317efef1032d1
Jul 10 18:35:02.080048 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:02.079964    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:35:02.102266 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:02.102230    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn" event={"ID":"8ae2f15a-1eef-433a-adc7-dd6b644a104c","Type":"ContainerStarted","Data":"3ce14faf49f98145af4c6812a32144bfe45ebf327375d2a3e18317efef1032d1"}
Jul 10 18:35:03.109276 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:03.109216    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn" event={"ID":"8ae2f15a-1eef-433a-adc7-dd6b644a104c","Type":"ContainerStarted","Data":"0aedb6ef555c6e4c2724ad6fb732703508ca120486132dd48a1a1a093ac164a8"}
Jul 10 18:35:03.109817 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:03.109332    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:03.126197 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:03.126131    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn" podStartSLOduration=2.4157762099999998 podStartE2EDuration="3.126107004s" totalImagesPullingTime="710.330794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:35:03.125267514 +0000 UTC m=+2095.803535106" watchObservedRunningTime="2026-07-10 18:35:03.126107004 +0000 UTC m=+2095.804374583"
Jul 10 18:35:05.272020 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:05.271987    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:07.943376 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:07.943339    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:35:07.948230 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:07.948205    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:35:09.121046 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:09.121018    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:35:14.250951 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:14.250902    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:14.350778 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:14.350740    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:20.283983 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:20.283942    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:23.441543 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:23.441507    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:23.548961 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:23.548927    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:38.057489 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:38.057448    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:55.556390 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:55.556350    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:35:57.199751 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:35:57.199714    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:37:01.597749 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:37:01.597712    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:38:01.669864 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:01.669779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:38:02.550359 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:02.550323    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:38:14.040405 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.040368    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"]
Jul 10 18:38:14.043757 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.043723    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.047408 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.046451    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-48683a\"/\"kube-root-ca.crt\""
Jul 10 18:38:14.047408 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.047250    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-48683a\"/\"default-dockercfg-ghzjg\""
Jul 10 18:38:14.047683 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.047601    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-48683a\"/\"openshift-service-ca.crt\""
Jul 10 18:38:14.047683 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.047644    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-48683a\"/\"sub-test-model-48683a-kserve-self-signed-certs\""
Jul 10 18:38:14.055513 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.055486    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"]
Jul 10 18:38:14.078709 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.078669    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q9jx\" (UniqueName: \"kubernetes.io/projected/11930ab0-0553-4897-8125-0c9ef943c3ca-kube-api-access-6q9jx\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.078709 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.078722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-dshm\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.078933 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.078828    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-model-cache\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.078933 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.078862    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11930ab0-0553-4897-8125-0c9ef943c3ca-tls-certs\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.078933 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.078904    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-tmp-dir\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.079034 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.078949    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-home\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.144592 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.144551    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:38:14.179696 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.179661    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q9jx\" (UniqueName: \"kubernetes.io/projected/11930ab0-0553-4897-8125-0c9ef943c3ca-kube-api-access-6q9jx\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.179860 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.179708    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-dshm\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.179860 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.179747    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-model-cache\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.179860 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.179763    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11930ab0-0553-4897-8125-0c9ef943c3ca-tls-certs\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.179860 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.179796    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-tmp-dir\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.179860 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.179814    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-home\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.180236 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.180210    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-model-cache\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.180384 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.180273    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-home\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.180384 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.180281    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-tmp-dir\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.182654 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.182621    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-dshm\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.182824 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.182689    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11930ab0-0553-4897-8125-0c9ef943c3ca-tls-certs\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.188432 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.188395    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q9jx\" (UniqueName: \"kubernetes.io/projected/11930ab0-0553-4897-8125-0c9ef943c3ca-kube-api-access-6q9jx\") pod \"sub-test-model-48683a-kserve-7944d44b67-sv55t\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") " pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.361268 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.361163    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:14.504799 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:14.504772    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"]
Jul 10 18:38:14.507815 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:38:14.507782    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11930ab0_0553_4897_8125_0c9ef943c3ca.slice/crio-835c797e7d8598e2762fe34e28ca6a880c578827ced661c8449ca2ada6bfc85c WatchSource:0}: Error finding container 835c797e7d8598e2762fe34e28ca6a880c578827ced661c8449ca2ada6bfc85c: Status 404 returned error can't find the container with id 835c797e7d8598e2762fe34e28ca6a880c578827ced661c8449ca2ada6bfc85c
Jul 10 18:38:15.062214 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:15.062176    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t" event={"ID":"11930ab0-0553-4897-8125-0c9ef943c3ca","Type":"ContainerStarted","Data":"231e2557ff11a392fbaf723a1d891f3830807d5d73122793cb16f0143128ce4a"}
Jul 10 18:38:15.062666 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:15.062225    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t" event={"ID":"11930ab0-0553-4897-8125-0c9ef943c3ca","Type":"ContainerStarted","Data":"835c797e7d8598e2762fe34e28ca6a880c578827ced661c8449ca2ada6bfc85c"}
Jul 10 18:38:15.081223 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:15.081151    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t" podStartSLOduration=1.081124463 podStartE2EDuration="1.081124463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:38:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:38:15.078841329 +0000 UTC m=+2287.757108908" watchObservedRunningTime="2026-07-10 18:38:15.081124463 +0000 UTC m=+2287.759392042"
Jul 10 18:38:24.362181 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:24.362136    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:24.362696 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:24.362199    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:24.374772 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:24.374735    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:25.124932 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:25.124899    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:38:33.206212 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:33.206175    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:38:37.871538 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:37.871502    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:38:38.580169 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:38.580135    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:38:50.763763 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:38:50.763729    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:39:09.939194 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:09.939095    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"]
Jul 10 18:39:09.962091 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:09.962058    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:39:10.962219 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:10.962174    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:39:24.960076 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:24.960010    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t" podUID="11930ab0-0553-4897-8125-0c9ef943c3ca" containerName="main" containerID="cri-o://231e2557ff11a392fbaf723a1d891f3830807d5d73122793cb16f0143128ce4a" gracePeriod=45
Jul 10 18:39:25.114515 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.114461    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t" podUID="11930ab0-0553-4897-8125-0c9ef943c3ca" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": dial tcp 10.134.0.61:8000: connect: connection refused"
Jul 10 18:39:25.222823 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.222753    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:39:25.339844 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.339800    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-home\") pod \"11930ab0-0553-4897-8125-0c9ef943c3ca\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") "
Jul 10 18:39:25.339844 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.339841    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-model-cache\") pod \"11930ab0-0553-4897-8125-0c9ef943c3ca\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") "
Jul 10 18:39:25.340118 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.339883    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6q9jx\" (UniqueName: \"kubernetes.io/projected/11930ab0-0553-4897-8125-0c9ef943c3ca-kube-api-access-6q9jx\") pod \"11930ab0-0553-4897-8125-0c9ef943c3ca\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") "
Jul 10 18:39:25.340118 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.339899    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-dshm\") pod \"11930ab0-0553-4897-8125-0c9ef943c3ca\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") "
Jul 10 18:39:25.340118 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.339951    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11930ab0-0553-4897-8125-0c9ef943c3ca-tls-certs\") pod \"11930ab0-0553-4897-8125-0c9ef943c3ca\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") "
Jul 10 18:39:25.340118 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.339998    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-tmp-dir\") pod \"11930ab0-0553-4897-8125-0c9ef943c3ca\" (UID: \"11930ab0-0553-4897-8125-0c9ef943c3ca\") "
Jul 10 18:39:25.340370 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.340117    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-home" (OuterVolumeSpecName: "home") pod "11930ab0-0553-4897-8125-0c9ef943c3ca" (UID: "11930ab0-0553-4897-8125-0c9ef943c3ca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:39:25.340370 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.340198    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-model-cache" (OuterVolumeSpecName: "model-cache") pod "11930ab0-0553-4897-8125-0c9ef943c3ca" (UID: "11930ab0-0553-4897-8125-0c9ef943c3ca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:39:25.340370 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.340347    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-home\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:39:25.340370 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.340352    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "11930ab0-0553-4897-8125-0c9ef943c3ca" (UID: "11930ab0-0553-4897-8125-0c9ef943c3ca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:39:25.340599 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.340367    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-model-cache\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:39:25.342230 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.342201    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-dshm" (OuterVolumeSpecName: "dshm") pod "11930ab0-0553-4897-8125-0c9ef943c3ca" (UID: "11930ab0-0553-4897-8125-0c9ef943c3ca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 18:39:25.342394 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.342244    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11930ab0-0553-4897-8125-0c9ef943c3ca-kube-api-access-6q9jx" (OuterVolumeSpecName: "kube-api-access-6q9jx") pod "11930ab0-0553-4897-8125-0c9ef943c3ca" (UID: "11930ab0-0553-4897-8125-0c9ef943c3ca"). InnerVolumeSpecName "kube-api-access-6q9jx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:39:25.342394 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.342320    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11930ab0-0553-4897-8125-0c9ef943c3ca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "11930ab0-0553-4897-8125-0c9ef943c3ca" (UID: "11930ab0-0553-4897-8125-0c9ef943c3ca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:39:25.413202 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.413165    2569 generic.go:356] "Generic (PLEG): container finished" podID="11930ab0-0553-4897-8125-0c9ef943c3ca" containerID="231e2557ff11a392fbaf723a1d891f3830807d5d73122793cb16f0143128ce4a" exitCode=0
Jul 10 18:39:25.413202 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.413207    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"
Jul 10 18:39:25.413503 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.413250    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t" event={"ID":"11930ab0-0553-4897-8125-0c9ef943c3ca","Type":"ContainerDied","Data":"231e2557ff11a392fbaf723a1d891f3830807d5d73122793cb16f0143128ce4a"}
Jul 10 18:39:25.413503 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.413292    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t" event={"ID":"11930ab0-0553-4897-8125-0c9ef943c3ca","Type":"ContainerDied","Data":"835c797e7d8598e2762fe34e28ca6a880c578827ced661c8449ca2ada6bfc85c"}
Jul 10 18:39:25.413503 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.413339    2569 scope.go:117] "RemoveContainer" containerID="231e2557ff11a392fbaf723a1d891f3830807d5d73122793cb16f0143128ce4a"
Jul 10 18:39:25.423136 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.423115    2569 scope.go:117] "RemoveContainer" containerID="231e2557ff11a392fbaf723a1d891f3830807d5d73122793cb16f0143128ce4a"
Jul 10 18:39:25.423500 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:39:25.423473    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"231e2557ff11a392fbaf723a1d891f3830807d5d73122793cb16f0143128ce4a\": container with ID starting with 231e2557ff11a392fbaf723a1d891f3830807d5d73122793cb16f0143128ce4a not found: ID does not exist" containerID="231e2557ff11a392fbaf723a1d891f3830807d5d73122793cb16f0143128ce4a"
Jul 10 18:39:25.423572 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.423510    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"231e2557ff11a392fbaf723a1d891f3830807d5d73122793cb16f0143128ce4a"} err="failed to get container status \"231e2557ff11a392fbaf723a1d891f3830807d5d73122793cb16f0143128ce4a\": rpc error: code = NotFound desc = could not find container \"231e2557ff11a392fbaf723a1d891f3830807d5d73122793cb16f0143128ce4a\": container with ID starting with 231e2557ff11a392fbaf723a1d891f3830807d5d73122793cb16f0143128ce4a not found: ID does not exist"
Jul 10 18:39:25.435597 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.435565    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"]
Jul 10 18:39:25.437204 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.437179    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-48683a/sub-test-model-48683a-kserve-7944d44b67-sv55t"]
Jul 10 18:39:25.441096 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.441069    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q9jx\" (UniqueName: \"kubernetes.io/projected/11930ab0-0553-4897-8125-0c9ef943c3ca-kube-api-access-6q9jx\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:39:25.441179 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.441099    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-dshm\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:39:25.441179 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.441111    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11930ab0-0553-4897-8125-0c9ef943c3ca-tls-certs\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:39:25.441179 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:25.441120    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11930ab0-0553-4897-8125-0c9ef943c3ca-tmp-dir\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:39:26.014168 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:26.014120    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11930ab0-0553-4897-8125-0c9ef943c3ca" path="/var/lib/kubelet/pods/11930ab0-0553-4897-8125-0c9ef943c3ca/volumes"
Jul 10 18:39:28.139949 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:28.139894    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:39:28.740217 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:28.740173    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:39:28.847398 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:28.847364    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:39:49.841600 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:39:49.841557    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:40:07.972238 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:07.972207    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:40:07.976406 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:07.976380    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fqn7g_e176d398-2a86-4a7e-97c0-d62f73823291/ovn-acl-logging/0.log"
Jul 10 18:40:15.007476 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:15.007420    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:40:15.108932 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:15.108902    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:40:24.377892 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:24.377854    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:40:24.484016 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:24.483973    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:40:49.157437 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:49.157336    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:40:50.152462 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:50.152429    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:40:51.074533 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.074496    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7151-140327017735728"]
Jul 10 18:40:51.074940 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.074869    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11930ab0-0553-4897-8125-0c9ef943c3ca" containerName="main"
Jul 10 18:40:51.074940 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.074881    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="11930ab0-0553-4897-8125-0c9ef943c3ca" containerName="main"
Jul 10 18:40:51.075018 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.074958    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="11930ab0-0553-4897-8125-0c9ef943c3ca" containerName="main"
Jul 10 18:40:51.077937 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.077917    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327017735728"
Jul 10 18:40:51.080358 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.080301    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-xk98h\""
Jul 10 18:40:51.084272 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.084241    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7151-140327017735728"]
Jul 10 18:40:51.208305 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.208264    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwj8g\" (UniqueName: \"kubernetes.io/projected/a26752a6-76dc-4adf-bf45-6b018bdc43e0-kube-api-access-qwj8g\") pod \"test-curl-7151-140327017735728\" (UID: \"a26752a6-76dc-4adf-bf45-6b018bdc43e0\") " pod="openshift-ingress/test-curl-7151-140327017735728"
Jul 10 18:40:51.309019 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.308967    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwj8g\" (UniqueName: \"kubernetes.io/projected/a26752a6-76dc-4adf-bf45-6b018bdc43e0-kube-api-access-qwj8g\") pod \"test-curl-7151-140327017735728\" (UID: \"a26752a6-76dc-4adf-bf45-6b018bdc43e0\") " pod="openshift-ingress/test-curl-7151-140327017735728"
Jul 10 18:40:51.317528 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.317493    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwj8g\" (UniqueName: \"kubernetes.io/projected/a26752a6-76dc-4adf-bf45-6b018bdc43e0-kube-api-access-qwj8g\") pod \"test-curl-7151-140327017735728\" (UID: \"a26752a6-76dc-4adf-bf45-6b018bdc43e0\") " pod="openshift-ingress/test-curl-7151-140327017735728"
Jul 10 18:40:51.389898 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.389801    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327017735728"
Jul 10 18:40:51.541799 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.541592    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7151-140327017735728"]
Jul 10 18:40:51.544139 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:40:51.544111    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda26752a6_76dc_4adf_bf45_6b018bdc43e0.slice/crio-8a3e138e1b1495283afa0117b4f0de14031210dff06f2dec4bb85ac8efe1b69e WatchSource:0}: Error finding container 8a3e138e1b1495283afa0117b4f0de14031210dff06f2dec4bb85ac8efe1b69e: Status 404 returned error can't find the container with id 8a3e138e1b1495283afa0117b4f0de14031210dff06f2dec4bb85ac8efe1b69e
Jul 10 18:40:51.547911 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.547888    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:40:51.851767 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:51.851727    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7151-140327017735728" event={"ID":"a26752a6-76dc-4adf-bf45-6b018bdc43e0","Type":"ContainerStarted","Data":"8a3e138e1b1495283afa0117b4f0de14031210dff06f2dec4bb85ac8efe1b69e"}
Jul 10 18:40:52.858298 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:52.858256    2569 generic.go:356] "Generic (PLEG): container finished" podID="a26752a6-76dc-4adf-bf45-6b018bdc43e0" containerID="2d69dc956cd39336ec97ac2ab64fa309935dc0f5b3940017927a2922604527c1" exitCode=0
Jul 10 18:40:52.858727 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:52.858347    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7151-140327017735728" event={"ID":"a26752a6-76dc-4adf-bf45-6b018bdc43e0","Type":"ContainerDied","Data":"2d69dc956cd39336ec97ac2ab64fa309935dc0f5b3940017927a2922604527c1"}
Jul 10 18:40:54.010787 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.010760    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327017735728"
Jul 10 18:40:54.033441 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.033409    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7151-140327017735728_a26752a6-76dc-4adf-bf45-6b018bdc43e0/test-curl-7151-140327017735728/0.log"
Jul 10 18:40:54.055350 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.055298    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7151-140327017735728"]
Jul 10 18:40:54.059399 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.059365    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7151-140327017735728"]
Jul 10 18:40:54.133265 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.133164    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwj8g\" (UniqueName: \"kubernetes.io/projected/a26752a6-76dc-4adf-bf45-6b018bdc43e0-kube-api-access-qwj8g\") pod \"a26752a6-76dc-4adf-bf45-6b018bdc43e0\" (UID: \"a26752a6-76dc-4adf-bf45-6b018bdc43e0\") "
Jul 10 18:40:54.135475 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.135441    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26752a6-76dc-4adf-bf45-6b018bdc43e0-kube-api-access-qwj8g" (OuterVolumeSpecName: "kube-api-access-qwj8g") pod "a26752a6-76dc-4adf-bf45-6b018bdc43e0" (UID: "a26752a6-76dc-4adf-bf45-6b018bdc43e0"). InnerVolumeSpecName "kube-api-access-qwj8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:40:54.176457 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.176423    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7151-140327017736240"]
Jul 10 18:40:54.176826 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.176812    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26752a6-76dc-4adf-bf45-6b018bdc43e0" containerName="test-curl-7151-140327017735728"
Jul 10 18:40:54.176876 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.176827    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26752a6-76dc-4adf-bf45-6b018bdc43e0" containerName="test-curl-7151-140327017735728"
Jul 10 18:40:54.176918 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.176892    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26752a6-76dc-4adf-bf45-6b018bdc43e0" containerName="test-curl-7151-140327017735728"
Jul 10 18:40:54.179919 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.179897    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327017736240"
Jul 10 18:40:54.184820 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.184783    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7151-140327017736240"]
Jul 10 18:40:54.233781 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.233732    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwj8g\" (UniqueName: \"kubernetes.io/projected/a26752a6-76dc-4adf-bf45-6b018bdc43e0-kube-api-access-qwj8g\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:40:54.335151 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.335107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmq6v\" (UniqueName: \"kubernetes.io/projected/9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84-kube-api-access-dmq6v\") pod \"test-curl-7151-140327017736240\" (UID: \"9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84\") " pod="openshift-ingress/test-curl-7151-140327017736240"
Jul 10 18:40:54.436154 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.436059    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmq6v\" (UniqueName: \"kubernetes.io/projected/9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84-kube-api-access-dmq6v\") pod \"test-curl-7151-140327017736240\" (UID: \"9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84\") " pod="openshift-ingress/test-curl-7151-140327017736240"
Jul 10 18:40:54.445123 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.445087    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmq6v\" (UniqueName: \"kubernetes.io/projected/9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84-kube-api-access-dmq6v\") pod \"test-curl-7151-140327017736240\" (UID: \"9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84\") " pod="openshift-ingress/test-curl-7151-140327017736240"
Jul 10 18:40:54.493035 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.492997    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327017736240"
Jul 10 18:40:54.639919 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.639895    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7151-140327017736240"]
Jul 10 18:40:54.642098 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:40:54.642067    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f7ac7f5_5fc5_4c2e_9d9d_f95a13beee84.slice/crio-679de9bbcd13ee984ac376114c924d1ac42f808e518255b7351ab9c39094c554 WatchSource:0}: Error finding container 679de9bbcd13ee984ac376114c924d1ac42f808e518255b7351ab9c39094c554: Status 404 returned error can't find the container with id 679de9bbcd13ee984ac376114c924d1ac42f808e518255b7351ab9c39094c554
Jul 10 18:40:54.869477 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.869440    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327017735728"
Jul 10 18:40:54.869691 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.869450    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a3e138e1b1495283afa0117b4f0de14031210dff06f2dec4bb85ac8efe1b69e"
Jul 10 18:40:54.870752 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:54.870722    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7151-140327017736240" event={"ID":"9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84","Type":"ContainerStarted","Data":"679de9bbcd13ee984ac376114c924d1ac42f808e518255b7351ab9c39094c554"}
Jul 10 18:40:54.880164 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:40:54.880122    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7151-140327017735728\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="a26752a6-76dc-4adf-bf45-6b018bdc43e0" pod="openshift-ingress/test-curl-7151-140327017735728"
Jul 10 18:40:55.877574 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:55.877534    2569 generic.go:356] "Generic (PLEG): container finished" podID="9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84" containerID="d8d60db5efadbee1d45c921eee931b0f446799990e8259f9fdb9e327b69dfd14" exitCode=0
Jul 10 18:40:55.877574 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:55.877577    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7151-140327017736240" event={"ID":"9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84","Type":"ContainerDied","Data":"d8d60db5efadbee1d45c921eee931b0f446799990e8259f9fdb9e327b69dfd14"}
Jul 10 18:40:55.880019 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:40:55.879989    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7151-140327017735728\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="a26752a6-76dc-4adf-bf45-6b018bdc43e0" pod="openshift-ingress/test-curl-7151-140327017735728"
Jul 10 18:40:56.014250 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:56.014208    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a26752a6-76dc-4adf-bf45-6b018bdc43e0" path="/var/lib/kubelet/pods/a26752a6-76dc-4adf-bf45-6b018bdc43e0/volumes"
Jul 10 18:40:57.041173 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.041141    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327017736240"
Jul 10 18:40:57.064379 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.064344    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7151-140327017736240_9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84/test-curl-7151-140327017736240/0.log"
Jul 10 18:40:57.091339 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.091288    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7151-140327017736240"]
Jul 10 18:40:57.095681 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.095654    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7151-140327017736240"]
Jul 10 18:40:57.157806 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.157704    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmq6v\" (UniqueName: \"kubernetes.io/projected/9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84-kube-api-access-dmq6v\") pod \"9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84\" (UID: \"9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84\") "
Jul 10 18:40:57.159826 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.159797    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84-kube-api-access-dmq6v" (OuterVolumeSpecName: "kube-api-access-dmq6v") pod "9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84" (UID: "9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84"). InnerVolumeSpecName "kube-api-access-dmq6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:40:57.248622 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.248583    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7151-140327022565248"]
Jul 10 18:40:57.248975 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.248961    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84" containerName="test-curl-7151-140327017736240"
Jul 10 18:40:57.249024 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.248976    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84" containerName="test-curl-7151-140327017736240"
Jul 10 18:40:57.249060 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.249038    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84" containerName="test-curl-7151-140327017736240"
Jul 10 18:40:57.252097 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.252077    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:40:57.258721 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.258693    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmq6v\" (UniqueName: \"kubernetes.io/projected/9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84-kube-api-access-dmq6v\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:40:57.258984 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.258957    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7151-140327022565248"]
Jul 10 18:40:57.359427 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.359380    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hljm6\" (UniqueName: \"kubernetes.io/projected/51f2b9fa-b6b8-4484-87d3-3da567f9201f-kube-api-access-hljm6\") pod \"test-curl-7151-140327022565248\" (UID: \"51f2b9fa-b6b8-4484-87d3-3da567f9201f\") " pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:40:57.460787 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.460691    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hljm6\" (UniqueName: \"kubernetes.io/projected/51f2b9fa-b6b8-4484-87d3-3da567f9201f-kube-api-access-hljm6\") pod \"test-curl-7151-140327022565248\" (UID: \"51f2b9fa-b6b8-4484-87d3-3da567f9201f\") " pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:40:57.470152 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.470118    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hljm6\" (UniqueName: \"kubernetes.io/projected/51f2b9fa-b6b8-4484-87d3-3da567f9201f-kube-api-access-hljm6\") pod \"test-curl-7151-140327022565248\" (UID: \"51f2b9fa-b6b8-4484-87d3-3da567f9201f\") " pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:40:57.563419 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.563375    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:40:57.706583 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.706553    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7151-140327022565248"]
Jul 10 18:40:57.708873 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:40:57.708846    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51f2b9fa_b6b8_4484_87d3_3da567f9201f.slice/crio-efbf690987ebd065747346d65885de9706ad27af1427393e9822ed17f552bb40 WatchSource:0}: Error finding container efbf690987ebd065747346d65885de9706ad27af1427393e9822ed17f552bb40: Status 404 returned error can't find the container with id efbf690987ebd065747346d65885de9706ad27af1427393e9822ed17f552bb40
Jul 10 18:40:57.896135 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.896096    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7151-140327022565248" event={"ID":"51f2b9fa-b6b8-4484-87d3-3da567f9201f","Type":"ContainerStarted","Data":"efbf690987ebd065747346d65885de9706ad27af1427393e9822ed17f552bb40"}
Jul 10 18:40:57.897463 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.897444    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="679de9bbcd13ee984ac376114c924d1ac42f808e518255b7351ab9c39094c554"
Jul 10 18:40:57.897585 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:57.897473    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327017736240"
Jul 10 18:40:57.908494 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:40:57.908457    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7151-140327017736240\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84" pod="openshift-ingress/test-curl-7151-140327017736240"
Jul 10 18:40:58.013149 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:40:58.013108    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7151-140327017736240\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84" pod="openshift-ingress/test-curl-7151-140327017736240"
Jul 10 18:40:58.015497 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:58.015468    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84" path="/var/lib/kubelet/pods/9f7ac7f5-5fc5-4c2e-9d9d-f95a13beee84/volumes"
Jul 10 18:40:58.904509 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:58.904470    2569 generic.go:356] "Generic (PLEG): container finished" podID="51f2b9fa-b6b8-4484-87d3-3da567f9201f" containerID="1be80c0f97eb97264776f36b2a628f3f46397a0f94ced0781f73a889f3502a9e" exitCode=0
Jul 10 18:40:58.904917 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:40:58.904550    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7151-140327022565248" event={"ID":"51f2b9fa-b6b8-4484-87d3-3da567f9201f","Type":"ContainerDied","Data":"1be80c0f97eb97264776f36b2a628f3f46397a0f94ced0781f73a889f3502a9e"}
Jul 10 18:41:00.065179 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.065147    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:41:00.086172 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.086147    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7151-140327022565248_51f2b9fa-b6b8-4484-87d3-3da567f9201f/test-curl-7151-140327022565248/0.log"
Jul 10 18:41:00.109775 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.109738    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7151-140327022565248"]
Jul 10 18:41:00.113591 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.113561    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7151-140327022565248"]
Jul 10 18:41:00.183858 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.183767    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hljm6\" (UniqueName: \"kubernetes.io/projected/51f2b9fa-b6b8-4484-87d3-3da567f9201f-kube-api-access-hljm6\") pod \"51f2b9fa-b6b8-4484-87d3-3da567f9201f\" (UID: \"51f2b9fa-b6b8-4484-87d3-3da567f9201f\") "
Jul 10 18:41:00.185995 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.185962    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51f2b9fa-b6b8-4484-87d3-3da567f9201f-kube-api-access-hljm6" (OuterVolumeSpecName: "kube-api-access-hljm6") pod "51f2b9fa-b6b8-4484-87d3-3da567f9201f" (UID: "51f2b9fa-b6b8-4484-87d3-3da567f9201f"). InnerVolumeSpecName "kube-api-access-hljm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:41:00.233030 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.232986    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7151-140327022565248"]
Jul 10 18:41:00.233395 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.233381    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f2b9fa-b6b8-4484-87d3-3da567f9201f" containerName="test-curl-7151-140327022565248"
Jul 10 18:41:00.233444 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.233397    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f2b9fa-b6b8-4484-87d3-3da567f9201f" containerName="test-curl-7151-140327022565248"
Jul 10 18:41:00.233489 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.233479    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f2b9fa-b6b8-4484-87d3-3da567f9201f" containerName="test-curl-7151-140327022565248"
Jul 10 18:41:00.236577 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.236556    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:41:00.243291 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.243256    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7151-140327022565248"]
Jul 10 18:41:00.284435 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.284394    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hljm6\" (UniqueName: \"kubernetes.io/projected/51f2b9fa-b6b8-4484-87d3-3da567f9201f-kube-api-access-hljm6\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:41:00.385381 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.385340    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psrwc\" (UniqueName: \"kubernetes.io/projected/08c1288c-25b3-4725-88ba-2017f2abc104-kube-api-access-psrwc\") pod \"test-curl-7151-140327022565248\" (UID: \"08c1288c-25b3-4725-88ba-2017f2abc104\") " pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:41:00.486846 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.486742    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psrwc\" (UniqueName: \"kubernetes.io/projected/08c1288c-25b3-4725-88ba-2017f2abc104-kube-api-access-psrwc\") pod \"test-curl-7151-140327022565248\" (UID: \"08c1288c-25b3-4725-88ba-2017f2abc104\") " pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:41:00.494799 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.494764    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psrwc\" (UniqueName: \"kubernetes.io/projected/08c1288c-25b3-4725-88ba-2017f2abc104-kube-api-access-psrwc\") pod \"test-curl-7151-140327022565248\" (UID: \"08c1288c-25b3-4725-88ba-2017f2abc104\") " pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:41:00.547295 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.547250    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:41:00.697640 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.691902    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7151-140327022565248"]
Jul 10 18:41:00.915722 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.915677    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7151-140327022565248" event={"ID":"08c1288c-25b3-4725-88ba-2017f2abc104","Type":"ContainerStarted","Data":"6defdc4907017d7b7684f9cc38023d852b26cdc6061c6f74b24af3b798e87b1a"}
Jul 10 18:41:00.916935 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.916912    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efbf690987ebd065747346d65885de9706ad27af1427393e9822ed17f552bb40"
Jul 10 18:41:00.916935 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.916914    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:41:00.929509 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:00.929467    2569 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7151-140327022565248" oldPodUID="51f2b9fa-b6b8-4484-87d3-3da567f9201f" podUID="08c1288c-25b3-4725-88ba-2017f2abc104"
Jul 10 18:41:01.925141 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:01.925106    2569 generic.go:356] "Generic (PLEG): container finished" podID="08c1288c-25b3-4725-88ba-2017f2abc104" containerID="3e4ce7544897b8ecd6dc9456402112f1deba9fb4ee6a18cc5bd3aad4bcdcc744" exitCode=0
Jul 10 18:41:01.925617 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:01.925198    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7151-140327022565248" event={"ID":"08c1288c-25b3-4725-88ba-2017f2abc104","Type":"ContainerDied","Data":"3e4ce7544897b8ecd6dc9456402112f1deba9fb4ee6a18cc5bd3aad4bcdcc744"}
Jul 10 18:41:02.013561 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:02.013528    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51f2b9fa-b6b8-4484-87d3-3da567f9201f" path="/var/lib/kubelet/pods/51f2b9fa-b6b8-4484-87d3-3da567f9201f/volumes"
Jul 10 18:41:03.076658 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.076624    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:41:03.100950 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.100920    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7151-140327022565248_08c1288c-25b3-4725-88ba-2017f2abc104/test-curl-7151-140327022565248/0.log"
Jul 10 18:41:03.128682 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.128648    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7151-140327022565248"]
Jul 10 18:41:03.135397 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.135368    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7151-140327022565248"]
Jul 10 18:41:03.213702 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.213600    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psrwc\" (UniqueName: \"kubernetes.io/projected/08c1288c-25b3-4725-88ba-2017f2abc104-kube-api-access-psrwc\") pod \"08c1288c-25b3-4725-88ba-2017f2abc104\" (UID: \"08c1288c-25b3-4725-88ba-2017f2abc104\") "
Jul 10 18:41:03.215863 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.215830    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08c1288c-25b3-4725-88ba-2017f2abc104-kube-api-access-psrwc" (OuterVolumeSpecName: "kube-api-access-psrwc") pod "08c1288c-25b3-4725-88ba-2017f2abc104" (UID: "08c1288c-25b3-4725-88ba-2017f2abc104"). InnerVolumeSpecName "kube-api-access-psrwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:41:03.250400 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.250358    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7151-140327022566256"]
Jul 10 18:41:03.250747 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.250733    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08c1288c-25b3-4725-88ba-2017f2abc104" containerName="test-curl-7151-140327022565248"
Jul 10 18:41:03.250790 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.250748    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="08c1288c-25b3-4725-88ba-2017f2abc104" containerName="test-curl-7151-140327022565248"
Jul 10 18:41:03.250825 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.250811    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="08c1288c-25b3-4725-88ba-2017f2abc104" containerName="test-curl-7151-140327022565248"
Jul 10 18:41:03.253744 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.253722    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327022566256"
Jul 10 18:41:03.261792 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.261764    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7151-140327022566256"]
Jul 10 18:41:03.314202 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.314155    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psrwc\" (UniqueName: \"kubernetes.io/projected/08c1288c-25b3-4725-88ba-2017f2abc104-kube-api-access-psrwc\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:41:03.415620 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.415569    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j29hd\" (UniqueName: \"kubernetes.io/projected/181651d9-0774-43ea-94a0-af25869e7826-kube-api-access-j29hd\") pod \"test-curl-7151-140327022566256\" (UID: \"181651d9-0774-43ea-94a0-af25869e7826\") " pod="openshift-ingress/test-curl-7151-140327022566256"
Jul 10 18:41:03.516664 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.516620    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j29hd\" (UniqueName: \"kubernetes.io/projected/181651d9-0774-43ea-94a0-af25869e7826-kube-api-access-j29hd\") pod \"test-curl-7151-140327022566256\" (UID: \"181651d9-0774-43ea-94a0-af25869e7826\") " pod="openshift-ingress/test-curl-7151-140327022566256"
Jul 10 18:41:03.525858 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.525828    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j29hd\" (UniqueName: \"kubernetes.io/projected/181651d9-0774-43ea-94a0-af25869e7826-kube-api-access-j29hd\") pod \"test-curl-7151-140327022566256\" (UID: \"181651d9-0774-43ea-94a0-af25869e7826\") " pod="openshift-ingress/test-curl-7151-140327022566256"
Jul 10 18:41:03.563883 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.563842    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327022566256"
Jul 10 18:41:03.706271 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.706240    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7151-140327022566256"]
Jul 10 18:41:03.708866 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:41:03.708836    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod181651d9_0774_43ea_94a0_af25869e7826.slice/crio-8638151fdabc16305c29b972f20840dd7903170d3599535f73d19f0b320fc7bc WatchSource:0}: Error finding container 8638151fdabc16305c29b972f20840dd7903170d3599535f73d19f0b320fc7bc: Status 404 returned error can't find the container with id 8638151fdabc16305c29b972f20840dd7903170d3599535f73d19f0b320fc7bc
Jul 10 18:41:03.936902 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.936805    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:41:03.936902 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.936820    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6defdc4907017d7b7684f9cc38023d852b26cdc6061c6f74b24af3b798e87b1a"
Jul 10 18:41:03.938155 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:03.938122    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7151-140327022566256" event={"ID":"181651d9-0774-43ea-94a0-af25869e7826","Type":"ContainerStarted","Data":"8638151fdabc16305c29b972f20840dd7903170d3599535f73d19f0b320fc7bc"}
Jul 10 18:41:03.947713 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:41:03.947674    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7151-140327022565248\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="08c1288c-25b3-4725-88ba-2017f2abc104" pod="openshift-ingress/test-curl-7151-140327022565248"
Jul 10 18:41:04.014271 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:04.013980    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08c1288c-25b3-4725-88ba-2017f2abc104" path="/var/lib/kubelet/pods/08c1288c-25b3-4725-88ba-2017f2abc104/volumes"
Jul 10 18:41:04.944605 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:04.944569    2569 generic.go:356] "Generic (PLEG): container finished" podID="181651d9-0774-43ea-94a0-af25869e7826" containerID="c6184da7a40a3e53aad6f153005e4f3c9ef9b298372732c90883270bcc6bc2a8" exitCode=0
Jul 10 18:41:04.945027 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:04.944629    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7151-140327022566256" event={"ID":"181651d9-0774-43ea-94a0-af25869e7826","Type":"ContainerDied","Data":"c6184da7a40a3e53aad6f153005e4f3c9ef9b298372732c90883270bcc6bc2a8"}
Jul 10 18:41:06.110560 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:06.110515    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327022566256"
Jul 10 18:41:06.132578 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:06.132543    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7151-140327022566256_181651d9-0774-43ea-94a0-af25869e7826/test-curl-7151-140327022566256/0.log"
Jul 10 18:41:06.155894 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:06.155860    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7151-140327022566256"]
Jul 10 18:41:06.160225 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:06.160195    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7151-140327022566256"]
Jul 10 18:41:06.242612 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:06.242504    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j29hd\" (UniqueName: \"kubernetes.io/projected/181651d9-0774-43ea-94a0-af25869e7826-kube-api-access-j29hd\") pod \"181651d9-0774-43ea-94a0-af25869e7826\" (UID: \"181651d9-0774-43ea-94a0-af25869e7826\") "
Jul 10 18:41:06.244772 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:06.244736    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/181651d9-0774-43ea-94a0-af25869e7826-kube-api-access-j29hd" (OuterVolumeSpecName: "kube-api-access-j29hd") pod "181651d9-0774-43ea-94a0-af25869e7826" (UID: "181651d9-0774-43ea-94a0-af25869e7826"). InnerVolumeSpecName "kube-api-access-j29hd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:41:06.343798 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:06.343756    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j29hd\" (UniqueName: \"kubernetes.io/projected/181651d9-0774-43ea-94a0-af25869e7826-kube-api-access-j29hd\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:41:06.956584 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:06.956554    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7151-140327022566256"
Jul 10 18:41:06.956767 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:06.956591    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8638151fdabc16305c29b972f20840dd7903170d3599535f73d19f0b320fc7bc"
Jul 10 18:41:06.966671 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:41:06.966634    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7151-140327022566256\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="181651d9-0774-43ea-94a0-af25869e7826" pod="openshift-ingress/test-curl-7151-140327022566256"
Jul 10 18:41:08.012247 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:41:08.012204    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7151-140327022566256\" is forbidden: User \"system:node:ip-10-0-139-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-9.ec2.internal' and this object" podUID="181651d9-0774-43ea-94a0-af25869e7826" pod="openshift-ingress/test-curl-7151-140327022566256"
Jul 10 18:41:08.014114 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:08.014087    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="181651d9-0774-43ea-94a0-af25869e7826" path="/var/lib/kubelet/pods/181651d9-0774-43ea-94a0-af25869e7826/volumes"
Jul 10 18:41:09.400257 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:09.400222    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:09.792426 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:09.792387    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:09.894756 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:09.894725    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:09.994460 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:09.994420    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:10.131743 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.131655    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"]
Jul 10 18:41:10.131905 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.131882    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s" podUID="624c7b43-ddfa-4a78-96fd-f686dc0c712e" containerName="maas-api" containerID="cri-o://fce3ec9b3f0d4da15846f80b58c5ed2ec34568dd6ff1b3a7f9c206bc0e698740" gracePeriod=30
Jul 10 18:41:10.157108 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.157058    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:10.594513 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.594473    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:41:10.681814 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.681675    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfq4s\" (UniqueName: \"kubernetes.io/projected/624c7b43-ddfa-4a78-96fd-f686dc0c712e-kube-api-access-vfq4s\") pod \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") "
Jul 10 18:41:10.681814 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.681761    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/624c7b43-ddfa-4a78-96fd-f686dc0c712e-openshift-service-ca\") pod \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") "
Jul 10 18:41:10.681814 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.681805    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/624c7b43-ddfa-4a78-96fd-f686dc0c712e-maas-api-tls\") pod \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\" (UID: \"624c7b43-ddfa-4a78-96fd-f686dc0c712e\") "
Jul 10 18:41:10.682249 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.682197    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/624c7b43-ddfa-4a78-96fd-f686dc0c712e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "624c7b43-ddfa-4a78-96fd-f686dc0c712e" (UID: "624c7b43-ddfa-4a78-96fd-f686dc0c712e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:41:10.683983 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.683939    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/624c7b43-ddfa-4a78-96fd-f686dc0c712e-kube-api-access-vfq4s" (OuterVolumeSpecName: "kube-api-access-vfq4s") pod "624c7b43-ddfa-4a78-96fd-f686dc0c712e" (UID: "624c7b43-ddfa-4a78-96fd-f686dc0c712e"). InnerVolumeSpecName "kube-api-access-vfq4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:41:10.684448 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.684426    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/624c7b43-ddfa-4a78-96fd-f686dc0c712e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "624c7b43-ddfa-4a78-96fd-f686dc0c712e" (UID: "624c7b43-ddfa-4a78-96fd-f686dc0c712e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:41:10.782702 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.782656    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfq4s\" (UniqueName: \"kubernetes.io/projected/624c7b43-ddfa-4a78-96fd-f686dc0c712e-kube-api-access-vfq4s\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:41:10.782702 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.782687    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/624c7b43-ddfa-4a78-96fd-f686dc0c712e-openshift-service-ca\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:41:10.782702 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.782697    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/624c7b43-ddfa-4a78-96fd-f686dc0c712e-maas-api-tls\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:41:10.977790 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.977694    2569 generic.go:356] "Generic (PLEG): container finished" podID="624c7b43-ddfa-4a78-96fd-f686dc0c712e" containerID="fce3ec9b3f0d4da15846f80b58c5ed2ec34568dd6ff1b3a7f9c206bc0e698740" exitCode=0
Jul 10 18:41:10.977790 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.977742    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"
Jul 10 18:41:10.977979 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.977780    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s" event={"ID":"624c7b43-ddfa-4a78-96fd-f686dc0c712e","Type":"ContainerDied","Data":"fce3ec9b3f0d4da15846f80b58c5ed2ec34568dd6ff1b3a7f9c206bc0e698740"}
Jul 10 18:41:10.977979 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.977859    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s" event={"ID":"624c7b43-ddfa-4a78-96fd-f686dc0c712e","Type":"ContainerDied","Data":"f331cd80a0f96d918c83b17dc27e7cd4f90fe34a21bc03b797131a57f71e6751"}
Jul 10 18:41:10.977979 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.977883    2569 scope.go:117] "RemoveContainer" containerID="fce3ec9b3f0d4da15846f80b58c5ed2ec34568dd6ff1b3a7f9c206bc0e698740"
Jul 10 18:41:10.989253 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.989229    2569 scope.go:117] "RemoveContainer" containerID="fce3ec9b3f0d4da15846f80b58c5ed2ec34568dd6ff1b3a7f9c206bc0e698740"
Jul 10 18:41:10.989632 ip-10-0-139-9 kubenswrapper[2569]: E0710 18:41:10.989607    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fce3ec9b3f0d4da15846f80b58c5ed2ec34568dd6ff1b3a7f9c206bc0e698740\": container with ID starting with fce3ec9b3f0d4da15846f80b58c5ed2ec34568dd6ff1b3a7f9c206bc0e698740 not found: ID does not exist" containerID="fce3ec9b3f0d4da15846f80b58c5ed2ec34568dd6ff1b3a7f9c206bc0e698740"
Jul 10 18:41:10.989738 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:10.989642    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce3ec9b3f0d4da15846f80b58c5ed2ec34568dd6ff1b3a7f9c206bc0e698740"} err="failed to get container status \"fce3ec9b3f0d4da15846f80b58c5ed2ec34568dd6ff1b3a7f9c206bc0e698740\": rpc error: code = NotFound desc = could not find container \"fce3ec9b3f0d4da15846f80b58c5ed2ec34568dd6ff1b3a7f9c206bc0e698740\": container with ID starting with fce3ec9b3f0d4da15846f80b58c5ed2ec34568dd6ff1b3a7f9c206bc0e698740 not found: ID does not exist"
Jul 10 18:41:11.001708 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:11.001660    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"]
Jul 10 18:41:11.005443 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:11.005414    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-48683a-7fd78c6cff-8xd9s"]
Jul 10 18:41:12.014349 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:12.014294    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="624c7b43-ddfa-4a78-96fd-f686dc0c712e" path="/var/lib/kubelet/pods/624c7b43-ddfa-4a78-96fd-f686dc0c712e/volumes"
Jul 10 18:41:16.120527 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:16.120487    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:16.188668 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:16.188638    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:16.439962 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:16.439869    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:16.607966 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:16.607928    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:16.783936 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:16.783896    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:17.219960 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:17.219855    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:17.420349 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:17.420295    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:17.521066 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:17.521030    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:17.662958 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:17.662913    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"]
Jul 10 18:41:17.663504 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:17.663468    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn" podUID="8ae2f15a-1eef-433a-adc7-dd6b644a104c" containerName="maas-api" containerID="cri-o://0aedb6ef555c6e4c2724ad6fb732703508ca120486132dd48a1a1a093ac164a8" gracePeriod=30
Jul 10 18:41:17.693945 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:17.693897    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:18.019370 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:18.019331    2569 generic.go:356] "Generic (PLEG): container finished" podID="8ae2f15a-1eef-433a-adc7-dd6b644a104c" containerID="0aedb6ef555c6e4c2724ad6fb732703508ca120486132dd48a1a1a093ac164a8" exitCode=0
Jul 10 18:41:18.019567 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:18.019400    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn" event={"ID":"8ae2f15a-1eef-433a-adc7-dd6b644a104c","Type":"ContainerDied","Data":"0aedb6ef555c6e4c2724ad6fb732703508ca120486132dd48a1a1a093ac164a8"}
Jul 10 18:41:18.131652 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:18.131618    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:41:18.139026 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:18.138993    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae2f15a-1eef-433a-adc7-dd6b644a104c-openshift-service-ca\") pod \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\" (UID: \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\") "
Jul 10 18:41:18.139207 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:18.139058    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae2f15a-1eef-433a-adc7-dd6b644a104c-maas-api-tls\") pod \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\" (UID: \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\") "
Jul 10 18:41:18.139207 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:18.139085    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4mt7\" (UniqueName: \"kubernetes.io/projected/8ae2f15a-1eef-433a-adc7-dd6b644a104c-kube-api-access-p4mt7\") pod \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\" (UID: \"8ae2f15a-1eef-433a-adc7-dd6b644a104c\") "
Jul 10 18:41:18.139406 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:18.139378    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ae2f15a-1eef-433a-adc7-dd6b644a104c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ae2f15a-1eef-433a-adc7-dd6b644a104c" (UID: "8ae2f15a-1eef-433a-adc7-dd6b644a104c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 18:41:18.141354 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:18.141322    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ae2f15a-1eef-433a-adc7-dd6b644a104c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ae2f15a-1eef-433a-adc7-dd6b644a104c" (UID: "8ae2f15a-1eef-433a-adc7-dd6b644a104c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 18:41:18.141467 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:18.141373    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae2f15a-1eef-433a-adc7-dd6b644a104c-kube-api-access-p4mt7" (OuterVolumeSpecName: "kube-api-access-p4mt7") pod "8ae2f15a-1eef-433a-adc7-dd6b644a104c" (UID: "8ae2f15a-1eef-433a-adc7-dd6b644a104c"). InnerVolumeSpecName "kube-api-access-p4mt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 18:41:18.240480 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:18.240380    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae2f15a-1eef-433a-adc7-dd6b644a104c-maas-api-tls\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:41:18.240480 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:18.240411    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4mt7\" (UniqueName: \"kubernetes.io/projected/8ae2f15a-1eef-433a-adc7-dd6b644a104c-kube-api-access-p4mt7\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:41:18.240480 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:18.240422    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae2f15a-1eef-433a-adc7-dd6b644a104c-openshift-service-ca\") on node \"ip-10-0-139-9.ec2.internal\" DevicePath \"\""
Jul 10 18:41:19.026444 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:19.026414    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"
Jul 10 18:41:19.026444 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:19.026446    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn" event={"ID":"8ae2f15a-1eef-433a-adc7-dd6b644a104c","Type":"ContainerDied","Data":"3ce14faf49f98145af4c6812a32144bfe45ebf327375d2a3e18317efef1032d1"}
Jul 10 18:41:19.026703 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:19.026523    2569 scope.go:117] "RemoveContainer" containerID="0aedb6ef555c6e4c2724ad6fb732703508ca120486132dd48a1a1a093ac164a8"
Jul 10 18:41:19.050543 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:19.050507    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"]
Jul 10 18:41:19.054459 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:19.054428    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-35792e-645b55b679-w24pn"]
Jul 10 18:41:20.014041 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:20.014004    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ae2f15a-1eef-433a-adc7-dd6b644a104c" path="/var/lib/kubelet/pods/8ae2f15a-1eef-433a-adc7-dd6b644a104c/volumes"
Jul 10 18:41:21.487160 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:21.487127    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:21.586640 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:21.586600    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:23.213931 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:23.213896    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:23.313028 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:23.312923    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:23.470941 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:23.470843    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:23.701193 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:23.701158    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:24.093161 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:24.093125    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68f46547f5-n68k5_b2729097-18ab-4ee5-97a9-1c3fc774a3a6/authorino/0.log"
Jul 10 18:41:28.776921 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:28.776881    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-z8mvr_cf0e6f18-bc97-445e-8bc4-e86fe2e993fb/manager/0.log"
Jul 10 18:41:28.889949 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:28.889909    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6bzd5_4e958321-d88a-48c1-a80c-787d50044743/manager/0.log"
Jul 10 18:41:29.013145 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:29.013101    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c8d7c5fbd-4r8g7_fd665518-ebbc-433c-bc64-c95875a32c5e/manager/0.log"
Jul 10 18:41:29.268021 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:29.267985    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-f42d8_ae7a77d0-3c7c-49ef-91dd-09303896c369/manager/0.log"
Jul 10 18:41:29.508167 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:29.508134    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6dcc87f-kmh86_97d0ccc3-62a0-4d68-8017-2d6f11607d2f/copy-manifests/0.log"
Jul 10 18:41:29.515374 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:29.515343    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6dcc87f-kmh86_97d0ccc3-62a0-4d68-8017-2d6f11607d2f/manager/0.log"
Jul 10 18:41:29.956424 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:29.956388    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-868ff7b6d7-8j54n_7f61eaf5-6a19-470c-a7d8-e6d4bb5dd4a5/maas-api/0.log"
Jul 10 18:41:30.064117 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:30.064087    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-r6dwl_eb98e350-d73d-4fdc-90ac-eea22ac3a67f/postgres/0.log"
Jul 10 18:41:31.311139 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:31.311108    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68f46547f5-n68k5_b2729097-18ab-4ee5-97a9-1c3fc774a3a6/authorino/0.log"
Jul 10 18:41:31.428585 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:31.428537    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pjws8_832b1102-8da8-4d9d-8d84-cc29a35928f7/manager/0.log"
Jul 10 18:41:31.543650 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:31.543621    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dm4jr_534015d0-bfee-465c-9634-611f2b2eca9d/manager/0.log"
Jul 10 18:41:31.773375 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:31.773345    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-449kc_417b7c0b-e3c0-423d-81f4-071730d9c0b6/registry-server/0.log"
Jul 10 18:41:31.899814 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:31.899784    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zgtzp_653e7672-bb3f-4f00-9d76-5e3009eb5b5f/manager/0.log"
Jul 10 18:41:32.139443 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:32.139362    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rsh2h_b8c517f7-4cc1-4a0b-b40e-4e312811611a/manager/0.log"
Jul 10 18:41:32.695530 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:32.695498    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5486d894ff-jn5ch_9f7f25ac-1be2-4181-859d-420992c69349/kube-auth-proxy/0.log"
Jul 10 18:41:33.038301 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:33.038270    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nv7pm_28088079-664d-4206-9136-2cf28525f281/payload-pre-processing/0.log"
Jul 10 18:41:33.153041 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:33.153005    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5scwn_04f3e571-5fa9-4b35-b0b1-77c56b6735fe/payload-processing/0.log"
Jul 10 18:41:33.592741 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:33.592708    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-svk42_fe4f1302-da52-44c6-a3fe-845d52ea21c6/main/0.log"
Jul 10 18:41:34.052299 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:34.052270    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-frhg5_f3fd9324-72b9-4414-9a32-19f0cc6d2f85/main/0.log"
Jul 10 18:41:38.100558 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:38.100520    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:38.167547 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:38.167509    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log" limit=1024
Jul 10 18:41:41.348631 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:41.348580    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-chhnz_b6d991cf-1886-472c-8bde-025d82091dfd/global-pull-secret-syncer/0.log"
Jul 10 18:41:41.501963 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:41.501927    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dpgcv_f85edd65-07d9-4601-97be-59a36f93f0e1/konnectivity-agent/0.log"
Jul 10 18:41:41.686946 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:41.686858    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-9.ec2.internal_e7d8eb65068a8bb501871987dce52055/haproxy/0.log"
Jul 10 18:41:46.943042 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:46.943008    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68f46547f5-n68k5_b2729097-18ab-4ee5-97a9-1c3fc774a3a6/authorino/0.log"
Jul 10 18:41:47.001632 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:47.001595    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pjws8_832b1102-8da8-4d9d-8d84-cc29a35928f7/manager/0.log"
Jul 10 18:41:47.068075 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:47.068051    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dm4jr_534015d0-bfee-465c-9634-611f2b2eca9d/manager/0.log"
Jul 10 18:41:47.193993 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:47.193914    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-449kc_417b7c0b-e3c0-423d-81f4-071730d9c0b6/registry-server/0.log"
Jul 10 18:41:47.352725 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:47.352687    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zgtzp_653e7672-bb3f-4f00-9d76-5e3009eb5b5f/manager/0.log"
Jul 10 18:41:47.459504 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:47.459405    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rsh2h_b8c517f7-4cc1-4a0b-b40e-4e312811611a/manager/0.log"
Jul 10 18:41:49.865865 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:49.865827    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n45bs_ff2ec86f-f908-428b-9915-2d13a5f9351b/node-exporter/0.log"
Jul 10 18:41:49.894049 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:49.894018    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n45bs_ff2ec86f-f908-428b-9915-2d13a5f9351b/kube-rbac-proxy/0.log"
Jul 10 18:41:49.920045 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:49.920020    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n45bs_ff2ec86f-f908-428b-9915-2d13a5f9351b/init-textfile/0.log"
Jul 10 18:41:52.393781 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.393744    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"]
Jul 10 18:41:52.394186 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.394100    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="181651d9-0774-43ea-94a0-af25869e7826" containerName="test-curl-7151-140327022566256"
Jul 10 18:41:52.394186 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.394111    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="181651d9-0774-43ea-94a0-af25869e7826" containerName="test-curl-7151-140327022566256"
Jul 10 18:41:52.394186 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.394122    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="624c7b43-ddfa-4a78-96fd-f686dc0c712e" containerName="maas-api"
Jul 10 18:41:52.394186 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.394128    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="624c7b43-ddfa-4a78-96fd-f686dc0c712e" containerName="maas-api"
Jul 10 18:41:52.394186 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.394134    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae2f15a-1eef-433a-adc7-dd6b644a104c" containerName="maas-api"
Jul 10 18:41:52.394186 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.394139    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae2f15a-1eef-433a-adc7-dd6b644a104c" containerName="maas-api"
Jul 10 18:41:52.394407 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.394197    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae2f15a-1eef-433a-adc7-dd6b644a104c" containerName="maas-api"
Jul 10 18:41:52.394407 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.394208    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="181651d9-0774-43ea-94a0-af25869e7826" containerName="test-curl-7151-140327022566256"
Jul 10 18:41:52.394407 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.394217    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="624c7b43-ddfa-4a78-96fd-f686dc0c712e" containerName="maas-api"
Jul 10 18:41:52.402468 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.402426    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.404941 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.404913    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5tczq\"/\"default-dockercfg-rt4qw\""
Jul 10 18:41:52.405860 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.405829    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5tczq\"/\"kube-root-ca.crt\""
Jul 10 18:41:52.406080 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.406048    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5tczq\"/\"openshift-service-ca.crt\""
Jul 10 18:41:52.406353 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.406330    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"]
Jul 10 18:41:52.533089 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.533034    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c19696da-3bdd-415c-a00e-ee47d12fb838-sys\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.533089 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.533095    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr8mt\" (UniqueName: \"kubernetes.io/projected/c19696da-3bdd-415c-a00e-ee47d12fb838-kube-api-access-kr8mt\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.533414 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.533219    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c19696da-3bdd-415c-a00e-ee47d12fb838-proc\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.533414 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.533299    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c19696da-3bdd-415c-a00e-ee47d12fb838-podres\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.533414 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.533354    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c19696da-3bdd-415c-a00e-ee47d12fb838-lib-modules\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.634481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.634424    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c19696da-3bdd-415c-a00e-ee47d12fb838-sys\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.634481 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.634492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr8mt\" (UniqueName: \"kubernetes.io/projected/c19696da-3bdd-415c-a00e-ee47d12fb838-kube-api-access-kr8mt\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.634756 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.634541    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c19696da-3bdd-415c-a00e-ee47d12fb838-proc\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.634756 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.634578    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c19696da-3bdd-415c-a00e-ee47d12fb838-sys\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.634756 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.634589    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c19696da-3bdd-415c-a00e-ee47d12fb838-podres\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.634756 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.634647    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c19696da-3bdd-415c-a00e-ee47d12fb838-lib-modules\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.634756 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.634683    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c19696da-3bdd-415c-a00e-ee47d12fb838-podres\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.634756 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.634697    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c19696da-3bdd-415c-a00e-ee47d12fb838-proc\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.634968 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.634790    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c19696da-3bdd-415c-a00e-ee47d12fb838-lib-modules\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.642478 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.642450    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr8mt\" (UniqueName: \"kubernetes.io/projected/c19696da-3bdd-415c-a00e-ee47d12fb838-kube-api-access-kr8mt\") pod \"perf-node-gather-daemonset-r4gzk\" (UID: \"c19696da-3bdd-415c-a00e-ee47d12fb838\") " pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.716005 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.715901    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:52.856578 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:52.856547    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"]
Jul 10 18:41:52.858805 ip-10-0-139-9 kubenswrapper[2569]: W0710 18:41:52.858773    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc19696da_3bdd_415c_a00e_ee47d12fb838.slice/crio-9e295c0d9bf5ee1b982f22861c8761e11599a7a1483630ab37879dfcc1faef55 WatchSource:0}: Error finding container 9e295c0d9bf5ee1b982f22861c8761e11599a7a1483630ab37879dfcc1faef55: Status 404 returned error can't find the container with id 9e295c0d9bf5ee1b982f22861c8761e11599a7a1483630ab37879dfcc1faef55
Jul 10 18:41:53.202270 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:53.202228    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk" event={"ID":"c19696da-3bdd-415c-a00e-ee47d12fb838","Type":"ContainerStarted","Data":"91ab02c442a153270442d45ffe52312250fc1e6064f8f8188d3612060ff1d6d4"}
Jul 10 18:41:53.202515 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:53.202286    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk" event={"ID":"c19696da-3bdd-415c-a00e-ee47d12fb838","Type":"ContainerStarted","Data":"9e295c0d9bf5ee1b982f22861c8761e11599a7a1483630ab37879dfcc1faef55"}
Jul 10 18:41:53.202515 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:53.202438    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:41:53.218398 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:53.218339    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk" podStartSLOduration=1.218322948 podStartE2EDuration="1.218322948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:41:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:41:53.217007399 +0000 UTC m=+2505.895274978" watchObservedRunningTime="2026-07-10 18:41:53.218322948 +0000 UTC m=+2505.896590518"
Jul 10 18:41:55.149277 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:55.149248    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s7gsk_08a38409-e805-44e5-95d9-8adfbf9dd299/dns/0.log"
Jul 10 18:41:55.172747 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:55.172718    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s7gsk_08a38409-e805-44e5-95d9-8adfbf9dd299/kube-rbac-proxy/0.log"
Jul 10 18:41:55.304643 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:55.304611    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hsvnp_08677185-1b3a-4cb6-878a-8f87e68b6286/dns-node-resolver/0.log"
Jul 10 18:41:55.976919 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:55.976881    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qgmdb_9214d3e7-1ca6-470f-b8ce-c030fdbb4737/node-ca/0.log"
Jul 10 18:41:57.185531 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:57.185504    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5486d894ff-jn5ch_9f7f25ac-1be2-4181-859d-420992c69349/kube-auth-proxy/0.log"
Jul 10 18:41:57.340606 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:57.340569    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nv7pm_28088079-664d-4206-9136-2cf28525f281/payload-pre-processing/0.log"
Jul 10 18:41:57.373585 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:57.373547    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5scwn_04f3e571-5fa9-4b35-b0b1-77c56b6735fe/payload-processing/0.log"
Jul 10 18:41:58.148912 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:58.148883    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5zwmc_926b7b00-c6c9-43d2-9502-a23ed2d0ce7b/serve-healthcheck-canary/0.log"
Jul 10 18:41:58.776894 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:58.776861    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4nsr6_ba19b36b-d069-4bee-a3de-303c6b6080b7/kube-rbac-proxy/0.log"
Jul 10 18:41:58.800963 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:58.800937    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4nsr6_ba19b36b-d069-4bee-a3de-303c6b6080b7/exporter/0.log"
Jul 10 18:41:58.824477 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:58.824401    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4nsr6_ba19b36b-d069-4bee-a3de-303c6b6080b7/extractor/0.log"
Jul 10 18:41:59.217391 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:41:59.217290    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5tczq/perf-node-gather-daemonset-r4gzk"
Jul 10 18:42:01.434046 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:42:01.433943    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-z8mvr_cf0e6f18-bc97-445e-8bc4-e86fe2e993fb/manager/0.log"
Jul 10 18:42:01.578173 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:42:01.578138    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6bzd5_4e958321-d88a-48c1-a80c-787d50044743/manager/0.log"
Jul 10 18:42:01.682345 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:42:01.682292    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c8d7c5fbd-4r8g7_fd665518-ebbc-433c-bc64-c95875a32c5e/manager/0.log"
Jul 10 18:42:01.778496 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:42:01.778458    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-f42d8_ae7a77d0-3c7c-49ef-91dd-09303896c369/manager/0.log"
Jul 10 18:42:01.944254 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:42:01.944220    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6dcc87f-kmh86_97d0ccc3-62a0-4d68-8017-2d6f11607d2f/manager/0.log"
Jul 10 18:42:01.966216 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:42:01.966189    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6dcc87f-kmh86_97d0ccc3-62a0-4d68-8017-2d6f11607d2f/copy-manifests/0.log"
Jul 10 18:42:03.333675 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:42:03.333590    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ffhzl_af7ad199-d5d7-430f-b4c8-6c76976b965c/openshift-lws-operator/0.log"
Jul 10 18:42:04.497221 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:42:04.497193    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5486d894ff-jn5ch_9f7f25ac-1be2-4181-859d-420992c69349/kube-auth-proxy/0.log"
Jul 10 18:42:04.617008 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:42:04.616975    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nv7pm_28088079-664d-4206-9136-2cf28525f281/payload-pre-processing/0.log"
Jul 10 18:42:04.637653 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:42:04.637618    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5scwn_04f3e571-5fa9-4b35-b0b1-77c56b6735fe/payload-processing/0.log"
Jul 10 18:42:06.185669 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:42:06.185641    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5486d894ff-jn5ch_9f7f25ac-1be2-4181-859d-420992c69349/kube-auth-proxy/0.log"
Jul 10 18:42:06.313302 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:42:06.313267    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nv7pm_28088079-664d-4206-9136-2cf28525f281/payload-pre-processing/0.log"
Jul 10 18:42:06.334108 ip-10-0-139-9 kubenswrapper[2569]: I0710 18:42:06.334073    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-5scwn_04f3e571-5fa9-4b35-b0b1-77c56b6735fe/payload-processing/0.log"